Engineer II, Data

About this job The bulk of the data engineer’s work will be in building, managing and optimizing data pipelines, then moving these pipelines into production for key data and analytics consumers such as business/data analysts and data scientists. The engineer must guarantee compliance with data governance and data security requirements while creating, improving and operationalizing these integrated and reusable data pipelines, enabling faster data access, integrated reuse and vastly improved time‑to‑solution for CarMax’s operational and analytical initiatives. Key Responsibilities Design, build, and maintain production‑grade data pipelines (streaming and batch). Implement event‑driven ingestion and near real‑time processing. Build transformations using distributed data processing frameworks. Write and maintain clean, testable Python code following software engineering best practices. Support CI/CD pipelines, automated deployments, and environment promotions. Monitor and troubleshoot pipeline failures, latency issues, and data quality problems. Collaborate closely with Data Scientists, Analysts, and platform engineers. Required Experience & Skills 2+ years of experience as a Data Engineer or Software Engineer working with data. Strong experience writing production Python code. Experience building and supporting pipelines on Azure or an equivalent cloud platform (AWS/GCP). Hands‑on experience with distributed data processing, such as Apache Spark, Databricks, or Spark runners like EMR or Dataproc. Experience working with event streaming or messaging platforms such as Azure Event Hubs, Apache Kafka / Confluent Kafka, or Amazon Kinesis. Practical experience with CI/CD pipelines, version control, and automated deployments. Familiarity with data modeling, schema management, and data reliability concepts. Experience operating systems in an agile, collaborative engineering team. Strongly preferred: Supporting production streaming systems with uptime and latency expectations; Azure‑native services such as Azure Databricks, Azure Functions, or equivalent serverless frameworks; Cosmos DB or comparable NoSQL stores such as DynamoDB or Cassandra; experience working with Analytics or Data Science platform teams; debugging live pipelines and handling operational ownership/on‑call responsibilities. Technology Environment (Primary & Equivalent) Languages: Python (required), SQL, SparkSQL. Streaming: Event Hubs, Kafka, Kinesis. Processing: Databricks, Apache Spark, EMR, Dataproc. Storage: Cosmos DB, DynamoDB, Cassandra. Serverless: Azure Functions, AWS Lambda. Cloud: Azure (primary), AWS, GCP. DevOps: CI/CD pipelines, automated deployments. Who This Role Is For • Has already worked on real, production data systems. • Wants to deepen experience in streaming and cloud‑native data platforms. • Brings a software engineering mindset to data problems. • Values ownership, reliability, and continuous learning. Work Location and Arrangement This role will be based out of the CarMax Midtown office, Richmond VA or the CarMax Technology Hub, Plano TX and have a hybrid work arrangement. Associates based in Richmond work onsite 4 days per week. Associates based in Plano work onsite 2 days per week. Work Authorization Applicants must be currently authorized to work in the United States on a full‑time basis. Sponsorship will not be considered for this specific role. CarMax is an equal opportunity employer, and all qualified candidates will receive consideration for employment without regard to age, race, color, religion, sex, sexual orientation, gender identity, genetic information, national origin, protected veteran status, disability status, or any other characteristic protected by law. Upon an applicant's request, CarMax will consider reasonable accommodation to complete the CarMax Job Application. #J-18808-Ljbffr