Senior Data Engineer

Role Description

The Senior Data Engineer role at Nerdery is responsible for designing and implementing the data architecture, storage solutions, and analytics platforms necessary to drive business insights. This role focuses on building scalable, well-governed data platforms on AWS and migrating legacy infrastructure to modern cloud environments.

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, or a related field (or equivalent practical experience).
• 6+ years of professional experience in data engineering or a closely related discipline.
• In-depth knowledge of Snowflake, including warehouse design, role-based access control, performance tuning, and cost optimization.
• Advanced proficiency with dbt for modular, tested, and version-controlled data transformations.
• Hands-on experience with Dagster for pipeline orchestration, asset management, and data observability.
• Proven experience designing and implementing data pipelines, data storage solutions, and analytics platforms on modern cloud data stacks.
• Experience migrating data pipelines and infrastructure to Snowflake from other platforms (legacy warehouses, on-premise systems, or hybrid environments).
• Advanced proficiency in Python with hands-on experience in data-processing libraries such as Pandas, Polars, PySpark, or similar.
• Strong SQL skills across both analytical and transactional workloads.
• Experience with relational and/or columnar databases such as PostgreSQL, SQL Server, or Snowflake.
• Deep understanding of data modeling, ETL/ELT processes, and data warehousing principles.
• Experience implementing data architecture patterns (e.g., medallion/multi-hop, data mesh, lakehouse) to support scalable, well-governed data platforms.
• Familiarity with Infrastructure-as-Code tools such as Pulumi or Terraform.
• Familiarity with event-driven architectures and integrating orchestration platforms with cloud services.
• Strong version-control practices (Git) with experience building CI/CD workflows for data workloads (e.g., GitHub Actions).
• Proven ability to translate business and technical requirements into production-grade, maintainable data pipelines.
• Excellent problem-solving and analytical skills.
• Ability to communicate clearly with both technical and non-technical stakeholders.
• Proactive collaborator who mentors colleagues and raises the technical bar across the team.
• Experience building and consuming RESTful APIs. Exposure to containerisation (Docker) is a plus.
• Familiarity with data quality and observability tooling (e.g., dbt tests, Great Expectations, Monte Carlo) is desirable.

Requirements

• Design and implement end-to-end data pipelines and ETL/ELT processes.
• Architect scalable data platforms using patterns such as medallion/multi-hop, data mesh, or lakehouse.
• Migrate data infrastructure from on-premise or hybrid environments to AWS.
• Manage and optimize AWS data services including Redshift, Glue, EMR, and Kinesis.
• Develop data-processing logic using Python (Pandas, PySpark, Polars) and advanced SQL.
• Automate data workflows using orchestration tools like Airflow/MWAA and Step Functions.
• Implement Infrastructure-as-Code (Terraform/CloudFormation) and CI/CD for data workloads.

Benefits

• Choose from two comprehensive medical plans (including an HSA-eligible option), plus high-quality dental and vision insurance.
• We provide peace of mind by fully covering the cost of several essential plans: Basic Life and AD&D Insurance, Short-Term Disability (STD), and Long-Term Disability (LTD) coverage.
• Take advantage of discounted, employee-paid options to protect your family, pets, and assets, including Voluntary Life and AD&D, Accident, Critical Illness, and Hospital Indemnity insurance, Pet Insurance, and plans offering Legal Support and Identity Theft Protection.
• We offer a 401(k) plan with a company match of up to 3.5% with immediate vesting.
• Nerds enjoy flexible time off with Flex PTO that can be used for vacation, personal time, personal illness, or time off to care for dependents.
• Nerdery is a remote-friendly workplace. Our Minnesota office space is available for Nerds who prefer an in-office environment or collaborative setting.
• All Nerds have dedicated resources and access to funds to pursue professional development, attend industry conferences, and obtain certifications.