Data Engineer PK (Python/PySpark/AWS Glue/Amazon Athena/SQL/Apache Airflow)

Role Description

Let’s be direct: We’re looking for a technical powerhouse. If you’re the developer who:

• Is the clear technical leader on your team
• Consistently solves problems others can’t crack
• Ships complex features in half the time it takes others
• Writes code so clean it could be published as a tutorial
• Takes pride in elevating the entire codebase

This isn’t a role for everyone, and that’s by design. We’re seeking developers who know they’re exceptional and have the track record to prove it.

What you’ll do:

• Build, optimize, and scale data pipelines and infrastructure using Python, TypeScript, Apache Airflow, PySpark, AWS Glue, and Snowflake.
• Design, operationalize, and monitor ingest and transformation workflows: DAGs, alerting, retries, SLAs, lineage, and cost controls.
• Collaborate with platform and AI/ML teams to automate ingestion, validation, and real-time compute workflows; work toward a feature store.
• Integrate pipeline health and metrics into engineering dashboards for full visibility and observability.
• Model data and implement efficient, scalable transformations in Snowflake and PostgreSQL.
• Build reusable frameworks and connectors to standardize internal data publishing and consumption.

Qualifications

• 4+ years of production data engineering experience.
• Deep, hands-on experience with Apache Airflow, AWS Glue, PySpark, and Python-based data pipelines.
• Strong SQL skills and experience operating PostgreSQL in live environments.
• Solid understanding of cloud-native data workflows (AWS preferred) and pipeline observability (metrics, logging, tracing, alerting).
• Proven experience owning pipelines end-to-end: design, implementation, testing, deployment, monitoring, and iteration.

Requirements

• Experience with Snowflake performance tuning (warehouses, partitions, clustering, query profiling) and cost optimization.
• Real-time or near-real-time processing experience (e.g., streaming ingestion, incremental models, CDC).
• Hands-on experience with a backend TypeScript framework (e.g., NestJS) is a strong plus.
• Experience with data quality frameworks, contract testing, or schema management (e.g., Great Expectations, dbt tests, OpenAPI/Protobuf/Avro).
• Background in building internal developer platforms or data platform components (connectors, SDKs, CI/CD for data).

Additional Information

• This is a fully remote position.
• Compensation will be in USD.
• Work hours are aligned with the EST time zone (9 AM to 6 PM EST) or PT time zone.