Software Engineer III - Analytical Data

Responsibilities

• Build and operate Kotlin and Apache Beam pipelines on Google Cloud Dataflow for streaming and batch ingestion from Kafka and cloud storage into Apache Iceberg tables.
• Maintain large Iceberg tables through partitioning, Spark-based compaction, deduplication, snapshot expiry, orphan-file cleanup, and source reconciliation.
• Expose datasets through BigQuery, Snowflake, and Starburst/Trino using Iceberg catalogs and stable consumer views.
• Collaborate with producer teams on schemas and data contracts and simplify and document new dataset publishing.
• Build Datadog dashboards and monitors for data freshness, completeness, and budget compliance, with future AI-assisted alert triage.
• Own production pipelines end to end, including incident response and corrective fixes.
• Deliver code through review, staged releases, and unit, integration, and end-to-end testing while managing infrastructure with Terraform across GCP and AWS.
• Work with data consumers, producer teams, and platform teams while contributing to the technical roadmap.

Requirements

• At least 3 years of professional software engineering experience focused on data engineering or distributed systems.
• Strong programming ability in Kotlin, Java, or Python, with willingness to work across Kotlin ingestion pipelines and Python maintenance and orchestration.
• Hands-on experience with Apache Beam, preferably on Google Cloud Dataflow, or Apache Spark.
• Production experience with Apache Kafka or a similar streaming platform and very large distributed datasets.
• Understanding of lakehouse architecture, open table formats, and preferably Apache Iceberg.
• Strong SQL skills and working knowledge of BigQuery, Snowflake, or Starburst/Trino.
• Experience with Protobuf or Avro schemas, schema evolution, GCP or AWS, and production pipeline observability.
• Experience with unit, integration, and end-to-end testing, metrics, dashboards, alerts, and end-to-end ownership of production incidents.
• Practical use of AI coding assistants such as Claude Code or Codex, with the ability to review and test generated code.
• Cross-team collaboration experience with producer, consumer, analytics, ML, and platform or infrastructure teams.
• Bachelor’s degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience.
• Preferred qualifications include production Apache Iceberg experience, metadata catalogs and governance tooling, AI agents for pipeline monitoring, multi-cloud data infrastructure, data contract negotiation, technical strategy, Terraform, Apache Airflow, Cloud Composer, or dbt.

Benefits

• Hybrid work arrangement.
• Comprehensive benefits and holistic mind, body, and lifestyle programs for employees and their families.
• US base salary range of $112,000—$176,000, with potential additional bonus, commission, equity, and other benefits.