Staff Data Engineer

Role Description

Design, develop, and maintain robust, scalable, and secure data pipelines for ingesting, transforming, and validating clinical real-world data (RWD) from various sources. Implement software solutions using programming languages (e.g., Python, SQL) and cloud technologies (e.g., AWS) to support clinical data management and analysis workflows. Work closely with the clinical data management specialist and other engineers to ensure software and data are of high-quality, scalable, and compliant with industry standards.

Qualifications

• BS degree in computer science or comparable program.
• 12+ years of overall software development experience, preferably building complex data or process management applications.
• Proficient with SQL databases (Postgres, Snowflake, Redshift, Athena), SQL, and ETL.
• Experience with Excel/Macros, Quicksight and Tableau or similar applications.
• Familiarity with AWS services like Redshift and S3.
• Knowledge of software engineering best practices including agile methodologies, code reviews, source management, build processes, testing, and operations.
• Proficient with data standards (e.g., CDISC, FHIR) and regulatory requirements (e.g., HIPAA, GDPR) for data management and DEID.
• In-depth knowledge of relational databases (e.g., PostgreSQL, MySQL).
• Expert knowledge of version control (Git), CI/CD pipelines, and agile development methodologies.
• Excellent written and verbal communication skills, capable of collaborating with clinical and non-clinical teams.
• Proven ability to work independently, manage time effectively, prioritize and organize tasks, and meet strict productivity and quality deadlines.
• Possess a high level of initiative and self-motivation.
• Team player; can navigate supporting highly visible projects and tasks.
• In-depth attention to detail and a fast learner.
• Ability to respond to shifting priorities and changes.

Requirements

• Collaborate with software/quality engineers/analysts and product managers (technical and non-technical) to make key design and technical implementation decisions.
• Partner with stakeholders and users to define requirements and deliver reliable, extensible, operations-friendly applications, services, solutions, data pipelines, or reports.
• Communicate testing progress, risks, and quality metrics effectively to project stakeholders and senior management.
• Design, build, and optimize production-grade ETL/ELT data pipelines and software components based on product requirements.
• Analyze and fix defects identified within applications, services, solutions, data pipelines, or reports.
• Create unit tests and coordinate testing within the Clinical Data and Software engineering team, and all relevant cross-functional teams.
• Write SQL, Python, ELT code to query raw and structured clinical, and genomic data for various clinical data management activities.
• Create data marts, including performing data transformation and de-identification for internal and external data projects.
• Develop and maintain scalable data pipelines, storage solutions, and processing workflows using AWS services (e.g., S3, Redshift).
• Experience with Apache Airflow for scheduling and managing complex data workflows.
• Accurately scope and estimate work using sound engineering best practices.
• Apply version control (Git), CI/CD pipelines, and agile development methodologies.
• Perform code reviews and provide relevant and timely recommendations and suggestions for solutioning to the leadership team.
• Support staff recruitment and onboarding.
• Provide strong leadership and support to new hires and cross-functional team members.
• Maintain all relevant clinical or technical licensures and attend conferences relevant to role and clinical field.
• Other duties and responsibilities to be performed as assigned.

Benefits

• Comprehensive medical, dental, vision, life and disability plans for eligible employees and their dependents.
• Free testing for Natera employees and their immediate families.
• Fertility care benefits.
• Pregnancy and baby bonding leave.
• 401k benefits.
• Commuter benefits.
• Generous employee referral program.