Senior Data Engineer

Senior Data EngineerCincinnati, OH; Chicago, IL84.51° is a retail data science, insights and media company. We help The Kroger Co., consumer packaged goods companies, agencies, publishers and affiliates create more personalized and valuable experiences for shoppers across the path to purchase.Powered by cutting-edge science, we utilize first-party retail data from more than 62 million U.S. households sourced through the Kroger Plus loyalty card program to fuel a more customer-centric journey using 84.51° Insights, 84.51° Loyalty Marketing and our retail media advertising solution, Kroger Precision Marketing.84.51° follows a 5-day in-office work schedule to support collaboration, alignment, and team connection.Join us at 84.51°!Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States and with the Kroger Family of Companies (i.e. H1-B visa, F-1 visa (OPT), TN visa or any other non-immigrant status).As a Senior Data Engineer, you will have the opportunity to build solutions that ingest, transform, store, and distribute our big data to be consumed by data scientists and our products.Our data engineers use PySpark/Python, Databricks, and other data engineering technologies and visualization tools to deliver data capabilities and services to our scientists, products, and tools.This role will also have exposure to Python microservice development, leveraging FastAPI, Helm, AKS and other Azure based technologies for building and hosting applications at scale.Responsibilities:Participate in the design and development of Databricks and Cloud-based solutionsImplement automated unit and integration testingCollaborate with architecture and lead engineers to ensure consistent development practicesProvide mentoring to junior engineersParticipate in retrospective reviewsParticipate in the estimation process for new work and releasesCollaborate with other engineers to solve and bring new perspectives to complex problemsDrive improvements in data engineering practices, procedures, and ways of workingEmbrace new technologies and an ever-changing environmentQualifications, Skills & Experience:3+ years proven ability of professional Data Development experience3+ years proven ability of developing with Databricks3+ years of experience with PySpark/Spark3+ years of experience developing with either Python or JavaFull understanding of ETL concepts and Data Warehousing conceptsExperience with Pipeline OrchestrationExperience with CI/CDExperience with version control softwareStrong understanding of Agile Principles (Scrum)Demonstrates an understanding of AI concepts and patterns.Bachelor's Degree (Computer Science, Management Information Systems, Mathematics, Business Analytics, or STEM)Desired Characteristics & Technical Skills:Experience with AzureExperience with Databricks Delta Tables, Delta Lake, Delta Live TablesProficient with Relational Data ModelingExperience with CI/CD pipelinesExperience with Python Library DevelopmentExperience with FastAPI/Flask service developmentExperience working with AKS/Kubernetes/HelmExperience with DevOps / Monitoring & ReliabilityExperience with Structured Streaming (Spark or otherwise)Experience with Kafka and/or Azure Event HubExperience with Github SaaS / Github ActionsExperience with TerraformExposure to BI Tooling (Tableau, Power BI, Cognos, etc.)Pay Range: $98,000 - $169,050 USD