Sr. Data Engineer

Sr. Data Engineer

Fully Remote • Remote - Baltimore, MD 21244

Overview

Salary Range $129,200.00 - $178,500.00 Salary/year Level Experienced Education Level 4 Year Degree

Sr. Data Engineer

Index Analytics is seeking a Sr. Data Engineer to support government clients to design, build, and optimize scalable data pipelines and cloud-based solutions. The Sr. Data Engineer plays a key role in modernizing the organization's data ecosystem by helping transition legacy solutions to a contemporary infrastructure.

As part of a cross-functional team including data engineers, health policy researchers, analysts, the engineer will support efforts to design and implement a robust environment capable of ingesting diverse data sources to support advanced analytics and reporting needs. Core responsibilities include defining structural, interface, and business requirements for data solutions; designing relational and non-relational databases and their associated integration components; and implementing Python based automated data pipelines.

This role blends advanced data engineering with hands-on cloud solutions engineering, leveraging AWS, Snowflake, and modern DevOps practices. The ideal candidate has experience delivering high-quality solutions in an Agile environment.

Responsibilities

• Collaborate closely with stakeholders, cross-functional and internal technical teams to gather requirements, document business rules and develop thorough understanding of the business context and objectives
• Collaborate to design secure, scalable, and cost-optimized data solutions
• Design, build, and maintain scalable, reliable ETL/ELT data pipelines using AWS and Snowflake and Databricks
• Develop and optimize data models, both conceptual and physical, to support analytics, reporting, and operational consumption
• Implement data quality, validation, and monitoring frameworks to ensure accuracy and reliability
• Ensure data workflows are modular, testable, and properly version-controlled
• Operationalize pipelines with monitoring, alerting, and automated recovery mechanisms
• Conduct advanced data analysis using languages such as Python and SQL.
• Develop documentation to include data models, data dictionaries, and data usage guides
• Improve end-to-end performance of data workflows
• Build and maintain CI/CD pipelines using Jenkins to support automated testing, deployments, and continuous integration
• Meet schedule deadlines and commitments with a high-level of quality of deliverables. Collaborate with a team of cross-functional resources in an Agile delivery environment to deliver iterative value

Qualifications

• US citizen or lived in the US for 3 of the last 5 years. Must be able to obtain a U.S. Federal government client badge and pass a government background investigation
• Bachelor's degree or equivalent with eight (8) or more years of experience as Data Engineer or similar role
• Hands-on experience in SQL and Python is required
• Strong proficiency in AWS services, Snowflake, Databricks
• Strong proficiency in GitHub for source control, branching strategy and reviews
• Knowledge of data integration patterns, data warehousing, and modern data architecture
• Strong analytical and communication skills, including the ability to analyze data, create meaningful insights, and present information clearly to stakeholders.
• Experience with object-oriented programming and building with software engineering principles
• DevOps exposure, including CI/CD tools like Jenkins
• Prior working knowledge of CMS enterprise repositories like IDR.
• Strong written and verbal communication skills are required, ability to collaborate, present, and report to stakeholders on findings.
• Knowledge of Agile framework, Scrum methodologies and knowledge of tools used to support them.
• Prior experience with government agencies is a plus