Staff Software Engineer, Data Platform

Responsibilities

• Own the data platform architecture and technical direction, including reusable frameworks and build-versus-buy decisions.
• Build and operate streaming, batch, CDC, and third-party ingestion systems with safe schema evolution into Snowflake.
• Own workflow orchestration for scheduling, retries, backfills, and dependency management across the data graph.
• Build transformation, compute, self-service pipeline, and real-time stream-processing frameworks.
• Develop data quality, observability, lineage, cataloging, discovery, and alerting capabilities.
• Build tooling for PII classification, masking, retention, access control, and multi-region data residency.
• Set technical standards through design reviews and documentation, and mentor the growing team.

Requirements

• 10+ years of experience building and operating production data infrastructure used by other teams.
• Deep cloud data warehouse experience, preferably Snowflake, including performance tuning and cost management; BigQuery, Databricks, or Redshift experience is transferable.
• Hands-on experience with CDC and streaming pipelines using technologies such as Kafka, Debezium, Flink, or Spark Streaming.
• Experience with managed ingestion tools such as Fivetran or Airbyte and judgment about when to build versus buy connectors.
• Strong experience operating workflow orchestration systems such as Temporal, Airflow, or Dagster at scale.
• Strong programming skills in Python and advanced SQL.
• Experience building frameworks or internal tooling for other engineers, along with practical data quality, observability, lineage, and schema evolution experience.
• Working knowledge of regulated-environment data governance, including PII classification, masking, access control, retention, and data residency.
• Familiarity with Azure, AWS, GCP, Kubernetes, Terraform, or Pulumi.
• Preferred experience includes dbt, lakehouse architectures, Iceberg, Delta Lake, Trino, multi-tenant secure platforms, AI product data infrastructure, or founding data platform work.

Benefits

• The role is based in San Francisco, California or New York, New York.
• Harvey offers an equal opportunity workplace and reasonable accommodations for applicants with disabilities.