Senior Data Engineer

Senior Data Engineer

We are seeking a Senior Data Engineer to design, develop, enhance, and implement systems for multiple analytical applications. This role will involve a range of data engineering activities, including maintaining data acquisition processes, executing data validation, building ETL/ELT data pipelines, and developing process notification methods. The position requires developing an understanding of the business domain to apply to all deliverables.

Key Responsibilities

• Participate in data requirements gathering and source-to-target mapping.
• Design, develop, and monitor ETL/ELT data pipelines.
• Maintain and enhance data acquisition and validation processes.
• Develop data validation scripts and conduct reviews.
• Produce datasets to be used as inputs for science models and visualizations.
• Engage in technical reviews with the data engineering team to ensure quality deliverables.
• Utilize code promotion and code management experience within a multi-environment DevOps structure.
• Communicate data engineering progress to the project leadership team.

Required Qualifications

Education & Experience:

• Bachelor's degree in a STEM field with 5+ years of relevant experience.
• Master's degree with 3+ years of relevant experience.
• Bachelor's degree in a non-related field with 11+ years of relevant experience.
• In lieu of a degree, 17+ years of relevant experience is required.

Technical Skills:

• Proficiency with Snowflake, SQL, Python, and Flink.
• Experience with code promotion and code management in a multi-environment DevOps setting.

Preferred Qualifications

• Master's degree in Computer Science, Mathematics, Engineering, or a related field.
• Experience with Infrastructure as Code (IaC), Docker, and containerization with Kubernetes or a similar framework.
• Experience with AWS cloud architecture and product offerings.
• Experience working with large datasets and big data technologies such as Snowflake or Databricks.
• Demonstrated proficiency with API development.

Work Environment

This role requires employees to be on-site four days a week.

We are an equal opportunity employer and welcome applications from all qualified candidates regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.