Senior Data Engineer

Senior Data Engineer

Join us at 84.51°!

84.51° is a retail data science, insights and media company. We help The Kroger Co., consumer packaged goods companies, agencies, publishers and affiliates create more personalized and valuable experiences for shoppers across the path to purchase.

Powered by cutting-edge science, we utilize first-party retail data from more than 62 million U.S. households sourced through the Kroger Plus loyalty card program to fuel a more customer-centric journey using 84.51° Insights, 84.51° Loyalty Marketing and our retail media advertising solution, Kroger Precision Marketing.

84.51° follows a 5-day in-office work schedule to support collaboration, alignment, and team connection.

As a data developer, you will cultivate strategies and solutions to ingest, store and distribute our big data. Our developers use Python, Databricks, Spark, JSON, and SQL in scrum teams to developer the products, tools and features.

Responsibilities:

• Participate in the design and development of Databricks and Cloud-based solutions
• Implement automated unit and integration testing
• Collaborate with architecture and lead engineers to ensure consistent development practices
• Provide mentoring to junior engineers
• Participate in retrospective reviews
• Participate in the estimation process for new work and releases
• Collaborate with other engineers to solve and bring new perspectives to complex problems
• Drive improvements in data engineering practices, procedures, and ways of working
• Embrace new technologies and an ever-changing environment

Qualifications, Skills, and Experience:

• 3+ years proven ability of professional Data Development experience
• 3+ years proven ability of developing with Databricks
• 3+ years of experience with PySpark/Spark
• 3+ years of experience developing with either Python or Java
• Full understanding of ETL concepts and Data Warehousing concepts
• Experience with Pipeline Orchestration
• Experience with CI/CD
• Experience with version control software
• Strong understanding of Agile Principles (Scrum)
• Bachelor's Degree (Computer Science, Management Information Systems, Mathematics, Business Analytics, or STEM)

Preferred Skills – Experience in the following is a plus:

• Experience with Azure
• Experience with Databricks Delta Tables, Delta Lake, Delta Live Tables
• Proficient with Relational Data Modeling
• Experience with CI/CD pipelines
• Experience with Python Library Development
• Experience with FastAPI/Flask service development
• Experience working with AKS/Kubernetes/Helm
• Experience with DevOps / Monitoring & Reliability
• Experience with Structured Streaming (Spark or otherwise)
• Experience with Kafka and/or Azure Event Hub
• Experience with Github SaaS / Github Actions
• Experience with Terraform
• Exposure to BI Tooling (Tableau, Power BI, Cognos, etc.)

Pay Range: $98,000 - $169,050 USD