Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Data Engineer (P3999)

$125k - $207k

84.51˚

84.51 Overview:84.51 is a retail data science, insights and media company. We help The Kroger Co., consumer packaged goods companies, agencies, publishers and affiliates create more personalized and valuable experiences for shoppers across the path to purchase.Powered by cutting-edge science, we utilize first-party retail data from more than 62 million U.S. households sourced through the Kroger Plus loyalty card program to fuel a more customer-centric journey using 84.51 Insights, 84.51 Loyalty Marketing and our retail media advertising solution, Kroger Precision Marketing.84.51 follows a 5‑day in‑office work schedule to support collaboration, alignment, and team connection.Join us at 84.51!__________________________________________________________Lead Data Engineer (P3999)SUMMARY:As a Lead Data Engineer, you will design and implement solutions to ingest, store, transform, and distribute big data on Azure Cloud, using both batch and event-driven patterns. Our engineers use Databricks (Spark, SQL, PySpark), Databricks Workflows, Python, SQL and JSON to build products, tools, and features that power applications serving our commercial products. You will provide technical leadership to a blended onshore/offshore team and work closely with Product, Data Science, and technical architects. Communication and collaboration with these partners are critical to success in this role. RESPONSIBILITIES:Take ownership of features and drive them to completion through all phases of the 84.51 SDLC. This includes external facing and internal applications as well as process improvement activities such as: Provide technical leadership and day-to-day direction to a team of engineers covering operations and development, blended onshore/offshore Lead design and development of Databricks-based solutions, run design reviews, and set engineering standards in partnership with technical architects Design and build event-driven data solutions, including streaming ingestion, event processing, and publishing data as events for downstream consumers Define and maintain event contracts and schemas, including versioning and schema evolution, in partnership with producing and consuming teams Build streaming pipelines that handle ordering, late-arriving data, duplicates, retries, dead-letter handling, and replay or backfill Develop business domain expertise and translate it for technical stakeholders Develop, maintain, and optimize data pipelines supporting different parts of our commercial business Design and document data models, schemas, workflows and operational procedures to support continuity Implement data quality checks, automated testing, monitoring and error handling that improve the reliability of our systems Own operational health of the pipelines you build, including incident response, root cause analysis, and meeting service level expectations, with monitoring of latency and consumer lag for streaming workloads Troubleshoot non-trivial data processing workflows Optimize pipelines for both performance and cost Apply data governance, privacy and security practices, including PII handling, access controls and lineage through Unity Catalog Build and maintain CI/CD pipelines, infrastructure as code, and environment promotion practices Develop REST APIs hosted in Kubernetes Partner with Data Science to deliver the data and feature pipelines needed for model development and deployment Use AI-assisted tools to improve development workflows, and review and validate the output you accept Collaborate with senior engineers to ensure consistent development practices Mentor and coach junior engineers Bring new perspectives to problems and be driven to improve yourself and the way things are done QUALIFICATIONS, SKILLS, AND EXPERIENCE: Bachelor's degree typically in Computer Science, Management Information Systems, Mathematics, Business Analytics or another technically strong program, or equivalent experience 5+ years of professional data engineering experience 5+ years developing with Spark (Databricks, PySpark) 5+ years developing with Python and SQL 2+ years of experience technically leading or mentoring engineers, including blended onshore/offshore or vendor teams Experience building event-driven or streaming data solutions with Spark Structured Streaming and a messaging platform such as Kafka, Azure Service Bus, or similar Solid understanding of event-driven architecture concepts, including publish/subscribe, event sourcing, change data capture, delivery guarantees (at-least-once, exactly-once), idempotent processing, windowing and watermarking, and handling of out-of-order and late-arriving events Experience with schema management for events (for example Avro, Protobuf, or JSON Schema with a schema registry) and backward-compatible schema evolution Experience with Azure data services such as ADLS, Azure Key Vault, Azure Kubernetes Service, and Azure Data Factory Experience with CI/CD, Git-based workflows, code review, and infrastructure as code Strong data modeling skills, including dimensional modeling, layered (medallion) architecture, Delta Lake, and schema evolution Experience with Databricks Unity Catalog or equivalent technology, including data governance and access control Experience building REST APIs (1+ years) and working with Kubernetes (1+ years) Experience with production operations, including monitoring, on-call or incident response, and root cause analysis Strong understanding of Agile principles Strong communication skills, including translating business needs into technical solutions and influencing without direct authority Experience using AI-assisted development tools in daily work, with a disciplined approach to reviewing generated code PREFERRED: Databricks or Azure certification Experience migrating legacy orchestration or ETL to Databricks Experience with Databricks Auto Loader and Delta Live Tables (Lakeflow Declarative Pipelines) for streaming workloads Experience with event-driven API patterns such as webhooks, asynchronous messaging, and event-carried state transfer Experience supporting machine learning workloads or MLOps practices, including real-time or near-real-time feature pipelines Retail, advertising technology, or retail media domain experience #LI-SSSPay Transparency and BenefitsThe stated salary range represents the entire span applicable across all geographic markets from lowest to highest. Actual salary offers will be determined by multiple factors including but not limited to geographic location, relevant experience, knowledge, skills, other job-related qualifications, and alignment with market data and cost of labor. In addition to salary, this position is also eligible for variable compensation.Below is a list of some of the benefits we offer our associates: Health: Medical: with competitive plan designs and support for self-care, wellness and mental health. Dental: with in-network and out-of-network benefit. Vision: with in-network and out-of-network benefit.Wealth: 401(k) with Roth option and matching contribution. Health Savings Account with matching contribution (requires participation in qualifying medical plan). AD&D and supplemental insurance options to help ensure additional protection for you.Happiness: Paid time off with flexibility to meet your life needs, including 5 weeks of vacation time, 7 health and wellness days, 3 floating holidays, as well as 6 company-paid holidays per year. Paid leave for maternity, paternity and family care instances. Base Pay Range$125,000—$207,000 USD

Vacancy posted 10 hours ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer (P3999) in Cincinnati, OH vacancy
  • $125k - $207k

     ...Lead Data Engineer As a Lead Data Engineer, you will design and implement solutions to ingest, store, transform, and distribute big data on Azure Cloud. Our developers use Databricks (Spark, SQL, PySpark), Databricks Workflows, Python, JSON, and SQL to build products... 
    Suggested

    84.51°

    Cincinnati, OH
    4 days ago
  •  ...Description Ready to take your career global?  Make your mark at one of the biggest names in payments. We’re looking for a Lead Data Governance Engineer to join our ever-evolving Data Products team and help shape the future of global commerce. You’ll ensure the data... 
    Suggested

    Global Payments

    Cincinnati, OH
    4 days ago
  • $29 - $50 per hour

     ...Description Are you passionate about data and analytics and eager to drive significant...  ...and analytics domain, including Data Engineers, Data Asset Managers, and AI Engineers. You...  ...asset managers, architects, and development leads to deliver high-quality, fit-for-purpose... 
    Suggested
    Full time
    Summer work
    Internship
    Work at office
    Relocation

    Proctor & Gamble

    Cincinnati, OH
    1 day ago
  •  ...Description On-site in Cincinnati, OH Our client seeks a Data Engineer to design, build, and support scalable, production-ready data solutions using Snowflake, dbt, SQL, and related enterprise technologies. The role translates business problems into technical requirements... 
    Suggested

    Eliassen Group

    Cincinnati, OH
    12 days ago
  •  ...Position Summary We are seeking a highly skilled Senior Data Engineer to join our dynamic team. This role involves leveraging advanced data solutions to enhance personalization and operational efficiency within our organization. The ideal candidate will bring strong expertise... 
    Suggested

    Dexian

    Covington, KY
    13 days ago
  •  ...Data Engineer - Onsite 5 days a week in Cincinnati, OH, 45202 - Duration: 1+ Year - Pay: $50 - $58 per hour W-2 Only - NO (Corp-to-Corp, H1B, OPT) The Data Engineer designs, builds, and supports scalable, production-ready data solutions using Snowflake, dbt, SQL,... 
    Hourly pay
    H1b
    Local area

    CBTS

    Cincinnati, OH
    13 days ago
  •  ...onsite in Cincinnati, Ohio. You must be local to Cincinnati in order to be considered. Agility Partners is seeking a qualified Data Engineer to fill an open position with one of our clients in the financial services industry. This individual will design, build, and... 
    Full time
    Local area

    Agility Partners

    Cincinnati, OH
    1 day ago
  • $134.5k - $224.1k

    Position Summary Join our Deloitte AI & Engineering team to transform technology platforms, drive innovation, and help make a...  ...ventures, and fuel growth through innovation.Work you'll doAs a Lead AI and Data Science Engineer II on the AI & Data team, you will be... 
    Local area

    Deloitte

    Cincinnati, OH
    3 days ago
  •  ...: 41011 Job Description The Expertise and Skills You Bring: 5+ years in Technology with 3 years in developing and deploying data solutions Excellent written and verbal communication skills including experience writing documentation Excellent collaboration... 
    Contract work

    CTI Staffing Inc

    Covington, KY
    2 days ago
  •  ...Data Engineer Location: Blue Ash, OH Duration: Full Time Job Description: ~8-10 years of overall experience ~ Strong proficiency...  ...systems like GitHub and GitHub Actions. ~ Ability to lead a technical group in solving problems and moving forward. ~... 
    Full time
    Remote work
    Afternoon shift

    JConnect Infotech

    Cincinnati, OH
    23 hours ago
  •  ...Data Engineer Cincinnati, Ohio Onsite (5 days) Full time Intelligence Developer Job Description Proficiency in Power BI: Including data modeling, DAX, Power Query, and report/dashboard design. SQL Knowledge: For data querying and manipulation. Data Warehousing... 
    Full time

    E-Solutions

    Cincinnati, OH
    18 hours ago
  •  ...Data Engineer General function: The data engineer designs and builds platforms, tools, and solutions that help the bank manage, secure, and generate value from its data. The person in this role creates scalable and reusable solutions for gathering, collecting, storing... 

    Software Technology Inc

    Cincinnati, OH
    1 day ago
  •  ...Kforce's client in Covington, KY is seeking an expert Senior Data Engineer with a strong database background and passion for understanding and improving on our data to deliver outstanding customer experiences. As a Senior Data Engineer, you will be working in a collaborative... 
    Hourly pay
    Contract work

    Kforce

    Latonia, KY
    23 hours ago
  •  ...Role: Data Engineer Location: Cincinnati, OH Duration: 12 months Pay Rate: $60-65/hour on W2, client will not consider C2C Work Type: Onsite Required Qualifications Key Skills Advanced SQL ETL/ELT pipeline development dbt (data build tool... 
    Immediate start

    CBTS

    Cincinnati, OH
    a month ago
  •  ...Senior Data Engineer A staffing firm is seeking a qualified Senior Data Engineer to fill an open position with a client in the financial services industry, supporting Wealth & Asset Management initiatives. This role focuses on designing and building scalable, secure... 

    Agility Partners

    Cincinnati, OH
    23 hours ago
  •  ...Senior Data Engineer Cincinnati, Ohio, United States AMEND is a management consulting firm based in Cincinnati, OH with areas of focus in operations, analytics, and technology. We are focused on strengthening the people, processes, and systems in organizations to... 
    Work visa
    Flexible hours

    AMEND Consulting

    Cincinnati, OH
    18 hours ago
  •  ...elite tech talent meets world-class opportunities! At Xenon7, we work with leading enterprise clients and innovative startups on high-impact projects across Data, AI, Cloud, and Software Engineering. Our expertise in AI solution architecture and specialized technical... 
    Full time
    Contract work
    For contractors
    3 days per week

    Xenon7

    Cincinnati, OH
    3 days ago
  • $110k - $165.3k

     ...CINCINNATI GENERAL OFFICES Job Description As a Senior Data Engineer, you will be a technical leader and expert, responsible for architecting...  ...Responsibilities Strategic Technical Leadership: Lead the architectural design and implementation of complex, large-... 
    Full time
    Work at office
    Relocation
    Flexible hours

    Procter & Gamble

    Cincinnati, OH
    2 days ago
  • $29 - $50 per hour

     ...business leadership in your everyday work? Data Science is where business, innovation and...  ...information systems and assets, or lead a strategic supplier in our innovative shared...  ...: Work closely with Data and Software Engineering teams to effectively productionize algorithms... 
    Full time
    Summer work
    Internship
    Work at office
    Relocation

    Proctor & Gamble

    Cincinnati, OH
    18 hours ago
  •  ...Senior Data Engineer This role does require to be in the office a large portion of the week. No remote candidates. Please do not submit above max bill rate. Contract Only. Looking for a Senior Data Engineer with DataStage and SQL experience to work on a Mortgage... 
    Contract work
    Work experience placement
    Work at office
    Remote work

    Software Technology Inc

    Cincinnati, OH
    23 hours ago
  •  ...and we are currently seeking a full-time, office-based Senior Data Engineer to join our Information Technology team. This position will build...  ..., and document user requirements; Mentor team members and lead design and code reviews to raise data engineering standards;... 
    Full time
    Contract work
    Work at office
    Work from home

    Medpace

    Cincinnati, OH
    23 hours ago
  • $189k - $238k

     ...partnering with a major US steel manufacturer to hire a Senior Data Engineer for an immediate, on-site FTE role in Charlotte, NC, Irvine...  ...analytical mindset, attention to detail, and the ability to lead technical initiatives in a collaborative environment. Safety... 
    Full time
    H1b
    Immediate start
    Visa sponsorship
    Work visa

    The Talent Mine

    Cincinnati, OH
    2 days ago
  •  ...Title: Data Engineer Location: Cincinnati, Ohio (On-site) Duration: 2+ Month to start with Role Overview The Data Engineer designs, builds, and supports scalable, production-ready data solutions using enterprise technologies. This position requires translating... 

    Apex Systems

    Cincinnati, OH
    18 hours ago
  • $121k - $169k

    84.51 Overview:84.51 is a retail data science, insights and media company. We help The Kroger Co., consumer packaged goods companies...  ...unit and integration testingCollaborate with architecture and lead engineers to ensure consistent development practicesProvide mentoring to... 
    Work at office

    84.51˚

    Cincinnati, OH
    18 hours ago
  • We are looking for an experienced Data Engineer to support enterprise-scale data initiatives for a financial services environment in Cincinnati, Ohio. This Long-term Contract position will focus on building reliable data foundations, shaping data structures that support... 
    Long term contract

    Robert Half

    Cincinnati, OH
    3 days ago
  • $107.66k - $161.7k

     ...working on our Poe product. About the Team and Role: Our small engineering team works on challenging problems every day. We have a culture...  ...end ownership of Machine Learning systems -- from prototyping, data pipelines and training, to realtime LLM application at scale... 
    Remote job
    Full time
    Work experience placement
    Internship

    Quora

    Covington, KY
    3 days ago
  •  ...approach to where we work. About the Role: As a Machine Learning Engineer, you will have the opportunity to collaborate closely with...  ...problems executing on a high throughput system with dynamic data. About the Job: Design, develop, and deploy machine learning... 
    Permanent employment
    Full time
    Work at office
    Remote work
    Work from home
    Flexible hours

    Instacart

    Covington, KY
    3 days ago
  •  ...Must Have Business Intelligence - Data Engineering Experience with non-relational & relational databases (SQL, MySQL, NoSQL, Hadoop, MongoDB, etc.) Experience programming and/or architecting a back-end language (Java, J2EE, etc.) Technical Degree... 
    Work experience placement

    Zortech Solutions

    Cincinnati, OH
    18 hours ago
  • $91.1k - $179.5k

     ...Recruiting for this role ends on 10/30/2026. Work you'll do The Data Engineer Consultant will support data architecture and engineering...  ...strong data governance, lineage, quality controls, and monitoring. Lead the design, development, and delivery of analytics solutions... 
    Local area

    Deloitte

    Cincinnati, OH
    4 days ago
  •  ...Data Engineer Location: Downtown Cincinnati, OH – Onsite 4 days/week Type: Contract Pay Rate: $70/hr on W2 Job Summary Seeking an experienced Data Engineer to support a major bank-to-bank migration. The role will focus on building and maintaining data... 
    Contract work

    CBTS

    Cincinnati, OH
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Engineer (P3999). Be the first to apply!