Data Engineer (with Pipeline/Platform focus)

Software Engineer

**Active TS/SCI w/Polygraph REQUIRED**. Please do not apply if you do not currently possess this level of clearance.

Basic Requirements:

• 7 years of experience as a software engineer
• Bachelor's degree in a technical discipline
  • 2 additional years of experience as a software engineer may be substituted for a degree

Job Description:

• This position requires a proactive approach to software development and system management, as well as the ability to intuitively determine potential automation possibilities for day-to-day processes.
• Potential tasks include creating more efficient monitoring solutions, automating existing dataflow processes via new tool development and improving existing install and upgrade procedures.
• The Software Engineer shall also perform extract, transform and load activities across multiple large datasets. In this role, the Software Engineer shall work closely with various stakeholders to determine appropriate data handling requirements.

Required Experience:

• Experience using the Linux CLI and Linux tools
• Experience writing scripts using Shell/Bash/Python
• Linux administration experience including software integration, service management, configuration management, and routine sustainment operations related to dataflow management and ETL tasks
• Extensive software development experience with Java and Python
• Experience with stream/batch Big Data processing and analytic frameworks including Spark
• Experience with CI/CD principles, methodologies, and tools such as GitLab CI
• Experience with IaC (Infrastructure as Code) principles and automation infrastructure provisioning and configuration using tools such as Ansible
• Experience with containerization technologies such as Docker
• Experience deploying containerized services under Kubernetes orchestration
• Demonstrated experience using system monitoring tools such as Prometheus, Grafana, Kibana, Nagios, etc.
• Experience with Git for source code management, branching strategies, and team collaboration
• Experience with NiFi software to include custom processor development, dataflow management, configuration and installation

Desired Experience:

• Experience with the Atlassian Tool Suite (JIRA, Confluence)
• Experience with Amazon Web Services (AWS)

Salary: $230,000 - $240,000 annually. Excellent benefits package including 25 days PTO, 11 paid holidays, 100% employer-paid healthcare for employees and dependents – available day 1, 8% 401(k) employer match – immediate vesting.

Disclaimer: The salary range provided is an estimate based on current market conditions and may be adjusted based on factors such as experience, skills, and qualifications. The final salary offer will be determined after a thorough review of the candidate's background and alignment with the role. Please note that this range is subject to change and should be considered as a guideline rather than a definitive figure. Shield Consulting Solutions is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.