Data Engineer

The Role As a Data Engineer at Mill, you\'ll touch systems end-to-end — from raw ingestion to the recommendation a customer sees in the app to managing the data warehouse. You\'ll architect a warehouse model one week and tune recommendation logic the next. You\'ll partner closely with product, engineering, data analytics, and marketing teams. What You\'ll Do Design, build, and maintain scalable data pipelines across Mill\'s product and operational systems Build and operate the customer-facing recommendation engine — including LLM-based logic where useful — that turns characterized food waste data into actionable recommendations: purchasing suggestions, anomaly explanations, operational nudges Design transformation and integration pipelines for food data coming from multiple sources — including agent-based reconciliation where it helps — handling schema changes, validation, and consistency issues Partner with data analytics and marketing teams to support self-serve analytics tools Own data quality monitoring — build alerting, validation frameworks, and observability tooling Bring CI/CD discipline to pipeline — automated tests, staged rollouts, and rollback paths — and track recommendation accuracy over time so we know whether a change actually helped Define and maintain the metrics, table endorsements, and business logic that analysts and stakeholders rely on — so everyone across the company is working from the same numbers What We\'re Looking For 5 years of experience operating data engineering systems in production Have built and operated data pipelines in production using Python and tools like dbt, Airflow, Fivetran, or similar — including handling failures, backfills, and schema changes after launch Strong SQL skills and experience with a cloud data warehouse (e.g., Snowflake, BigQuery, Redshift) Experience with recommendation systems or pipelines that combine multiple data sources into a single product-facing output, in production — including recommendation logic built with LLMs Have set up CI/CD for data pipelines or product logic (automated testing, staged rollout, rollback), and have measured whether a change to a recommendation or model actually improved outcomes, not just shipped it A bias toward clarity and action Comfort working in a collaborative environment where data consumers are partners, not just stakeholders Nice to Have Exposure to distributed systems concepts (partitioning, consistency, fault tolerance) Hands-on experience with infrastructure as code (Terraform, Pulumi) in a cloud environment Experience with Hex, Mixpanel, Tableau, or similar BI/analytics tools Familiarity with data contract or data mesh patterns Experience with event tracking or product analytics The estimated base salary range for this position is $185k to $210k, which does not include the value of benefits or a potential equity grant. A wide range of factors are considered in making compensation decisions, including but not limited to skill sets, market conditions, experience and training, licensure and certifications, and business and organizational needs. #J-18808-Ljbffr