Senior Data Engineer (P4533)

84.51 Overview:84.51 is a retail data science, insights and media company. We help The Kroger Co., consumer packaged goods companies, agencies, publishers and affiliates create more personalized and valuable experiences for shoppers across the path to purchase.Powered by cutting-edge science, we utilize first-party retail data from more than 62 million U.S. households sourced through the Kroger Plus loyalty card program to fuel a more customer-centric journey using 84.51 Insights, 84.51 Loyalty Marketing and our retail media advertising solution, Kroger Precision Marketing.84.51 follows a 5‑day in‑office work schedule to support collaboration, alignment, and team connection.Join us at 84.51!__________________________________________________________Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States and with the Kroger Family of Companies (i.e. H1-B visa, F-1 visa (OPT), TN visa or any other non-immigrant status)We are a full stack data science company and a wholly owned subsidiary of The Kroger Company. We own 10 Petabytes of data, and collect 35+ Terabytes of new data each week sourced from 62 Million households. As a member of our engineering team you will use various cutting edge technologies to develop applications that turn our data into actionable insights used to personalize the customer experience for shoppers at Kroger. We use agile development methodology, starting with Big Room Planning bringing everyone into the planning process to build scalable enterprise applications.SUMMARY:As a data developer, you will cultivate strategies and solutions to ingest, store and distribute our big data. Our developers use Python, Databricks, Spark, JSON, and SQL in scrum teams to developer the products, tools and features.RESPONSIBILITIES:Take ownership of features and drive them to completion through all phases of the entire 84.51 SDLC. This includes external facing and internal applications as well as process improvement activities such as:Participate in the design and development of Databricks and Cloud-based solutionsImplement automated unit and integration testingCollaborate with architecture and lead engineers to ensure consistent development practicesProvide mentoring to junior engineersParticipate in retrospective reviewsParticipate in the estimation process for new work and releasesCollaborate with other engineers to solve and bring new perspectives to complex problemsDrive improvements in data engineering practices, procedures, and ways of workingEmbrace new technologies and an ever-changing environmentQUALIFICATIONS, SKILLS, AND EXPERIENCE:3+ years proven ability of professional Data Development experience3+ years proven ability of developing with Databricks3+ years of experience with PySpark/Spark3+ years of experience developing with either Python or JavaFull understanding of ETL concepts and Data Warehousing conceptsExperience with Pipeline OrchestrationExperience with CI/CDExperience with version control softwareStrong understanding of Agile Principles (Scrum)Bachelor’s Degree (Computer Science, Management Information Systems, Mathematics, Business Analytics, or STEM)PREFERRED SKILLS – Experience in the following is a plusExperience with AzureExperience with Databricks Delta Tables, Delta Lake, Delta Live TablesProficient with Relational Data ModelingExperience with CI/CD pipelinesExperience with Python Library DevelopmentExperience with FastAPI/Flask service developmentExperience working with AKS/Kubernetes/HelmExperience with DevOps / Monitoring & ReliabilityExperience with Structured Streaming (Spark or otherwise)Experience with Kafka and/or Azure Event HubExperience with Github SaaS / Github ActionsExperience with TerraformExposure to BI Tooling (Tableau, Power BI, Cognos, etc.)#LI-AB1Pay Transparency and BenefitsThe stated salary range represents the entire span applicable across all geographic markets from lowest to highest. Actual salary offers will be determined by multiple factors including but not limited to geographic location, relevant experience, knowledge, skills, other job-related qualifications, and alignment with market data and cost of labor. In addition to salary, this position is also eligible for variable compensation.Below is a list of some of the benefits we offer our associates: Health: Medical: with competitive plan designs and support for self-care, wellness and mental health. Dental: with in-network and out-of-network benefit. Vision: with in-network and out-of-network benefit.Wealth: 401(k) with Roth option and matching contribution. Health Savings Account with matching contribution (requires participation in qualifying medical plan). AD&D and supplemental insurance options to help ensure additional protection for you.Happiness: Paid time off with flexibility to meet your life needs, including 5 weeks of vacation time, 7 health and wellness days, 3 floating holidays, as well as 6 company-paid holidays per year. Paid leave for maternity, paternity and family care instances. Pay Range$98,000—$169,050 USD