Data Engineer - Kafka
$101.36k - $152.04kViziRecruiter,LLC.
Introduction
Ahold Delhaize USA, a division of global food retailer Ahold Delhaize, is part of the U.S. family of brands, which also includes five leading omnichannel grocery brands – Food Lion, Giant Food, The GIANT Company, Hannaford and Stop & Shop. Ahold Delhaize USA associates support the brands with a wide range of services, including Finance, Legal, Sustainability, Commercial, Digital and E-commerce, Technology and more.
Overview
The Data Engineer II contributes to the expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. They will contribute to our data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They engage through the entire lifecycle of a project from data mapping, data pipelines, data modeling, and finally data consumption. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products. They will learn to optimize or even re-design our company's data architecture to support our next generation of products and data initiatives. They can take on smaller projects from start to finish, work on problems of moderate scope where analysis of situations or data requires a review of a variety of factors and trace issues to their source. They develop solutions to a variety of problems of moderate scope and complexity.
Our flexible/ hybrid work schedule includes 3 in-person days at one of our core locations and 2 remote days. Our core office locations include Salisbury, NC, Chicago, IL, and Quincy, MA.
Applicants must be currently authorized to work in the United States on a full-time basis.
Responsibilities
- Solves simple to moderate application errors, resolves application problems, following up promptly with all appropriate customers and IT personnel.
- Reviews and contributes to QA test plans and supports QA team during test execution.
- Participates in developing streaming data applications (Kafka), data transformation and data pipelines.
- Ensures change control and change management procedures are followed within the program/project as they relate to requirements.
- Able to interpret requirement documents, contributes to creating functional design documents as a part of data development life cycle.
- Documents all phases of work including gathering requirements, architectural diagrams, and other program technical specifications using current specified design standards for new or revised solutions.
- Relates information from various sources to draw logical conclusions.
- Conducts unit testing on data streams.
- Conducts data lineage and impact analysis as a part of the change management process.
- Conducts data analysis (SQL, Excel, Data Discovery, etc.) on legacy systems and new data sources.
- Creates source to target data mappings for data pipelines and integration activities.
- Assists in identifying the impact of proposed application development/enhancements projects.
- Performs data profiling and process analysis to understand key source systems and uses knowledge of application features and functions to assess scope and impact of business needs.
- Implement and maintain data governance policies and procedures to ensure data quality, security and compliance
- Ensure operational stability of a 24/7/365 grocery retail environment by providing technical support, system monitoring, and issue resolution which may be required during off-hours, weekends, and holidays as needed.
Requirements
- Bachelors Degree in Computer Science or Technical field; equivalent trainings/certifications/experience equivalency will be considered
- 3 or more years of equivalent experience in relevant job or field of technology
Preferred Qualifications
- Masters Degree in relevant field of study preferred, Additional trainings or certifications in relevant field of study preferred
- Experience in Agile teams and or Product/Platform based operating model.
- Experience in retail or grocery preferred.
- Experience with Kafka.
Salary Range
$101,360 - $152,040. Actual compensation offered to a candidate may vary based on their unique qualifications and experience, internal equity, and market conditions. Final compensation decisions will be made in accordance with company policies and applicable laws.
#J-18808-Ljbffr$175k - $225k
IMC Trading is seeking an experienced Data Engineer to join their Chicago team, driving the architecture and deployment of their Big Data... ...strong skills in Java, Python, and data processing tools like Kafka and Spark. This role offers a competitive base salary range of...Suggested$175k - $225k
IMC B.V. is seeking a dedicated Data Engineer in Chicago. The role involves architecting and developing a Big Data environment and building data processing pipelines using technologies such as Kafka, Python, and Spark. The ideal candidate has over 5 years of experience...Suggested- ittihad medical centre is looking for a dedicated Data Engineer to join our Chicago team. The ideal candidate will manage the deployment of... ...5 years of experience in data engineering, particularly with Kafka, Java, and Python. At IMC, we pride ourselves on our high-performance...Suggested
$101.36k - $152.04k
...A leading U.S. grocery brand is hiring a Data Engineer II to enhance and optimize data pipeline architecture. This role involves supporting multiple teams with data initiatives and ensuring operational stability. Applicants need a Bachelor's degree in Computer Science...SuggestedRemote work$100k - $150k
...platform in the world. What you'll do:Your data-driven mindset and ability to work with... ...improve processes. As an accomplished data engineer joining the Data & Analytics team, this... ...pipelinesExperience with streaming technologies (e.g., Kafka, Spark Streaming, Flink) and comfort...SuggestedWork at officeRemote workWorldwideMonday to FridayFlexible hours$200k - $250k
...HudsonEmail: ****@*****.***: (***) ***-****Senior Data Engineer - Core Data PlatformLocation: Chicago, IL or New York, NY (Hybrid... ...and streaming frameworks (e.g., Flink, Spark, Polars, Dask, Kafka).Experience handling binary serialization standards such as...Temporary workFlexible hours$150k - $200k
...and software systems are continually re-engineered, optimized, and maintained to stay on top... ...Belvedere Trading is looking for a proven Senior Data Engineer to work directly with our... ...with real time messaging systems, such as Kafka, Kinesis, and Pulsar, and with developing...Full time$150k - $187k
Chicago, ILDevelopment - Engineering /Full-time /HybridWho We AreArrive Logistics is a leading... ...collaborative environment.Who We WantAs a Senior Data Engineer at Arrive Logistics, you will... ...and the use of messaging systems like Kafka to enable real-time data flow.Experience...Full timeWork experience placementCasual workWork at officeLocal areaRelocationRelocation package$120k - $160k
...flexibility needed for a meaningful work-life balance.Being a Senior Data Engineer at iManage Means…You get excited about data, and you believe... ...-time data streaming, such as Microsoft Event Hub or Apache Kafka.Experience with platform migrations, particularly Synapse to...Work at officeLocal areaWorldwideFlexible hours2 days per week$98k - $182k
...Epsilon Activation Delivery Platform team seeks a senior engineer to build and maintain high-scale data pipelines and integrations with major advertising and... ...REST API integrations Streaming technologies (Kafka) NoSQL databases The position is full-time, based in Chicago...Full timeFlexible hours$175k - $225k
...We are seeking a dedicated and experienced Data Engineer to join our Chicago team. The ideal candidate is energized by working in a cutting... ...Architect, develop and deploy our Big Data environment (Kafka, Hadoop, Dremio, etc.) Build, deploy, and monitor our data processing...Permanent employmentFull time$110k - $125k
...Big Data EngineerWe are seeking an experienced Big Data Engineer to design, develop, and optimize enterprise-scale big data solutions. The ideal candidate will... ...Hadoop ecosystem, Spark, Scala, Hive, Apache NiFi, and Kafka, along with experience building scalable data...- ...Degree in Computer Science, Business Analytics, Engineering, Mathematics, or related field2+ years of professional experience in data engineering, software engineering, or... ...Spark, Dask, Flink) and streaming platforms (Kafka, Kinesis, Pulsar) for real-time and batch processingFamiliarity...ApprenticeshipEasy work
$179.4k - $204.7k
...Lead Data Engineer, (Python, AWS)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems... ...data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)4+ year experience working on real-time...Full timePart timeInternshipH1bLocal area- ...Senior Data EngineerYou will be the Financial Engineer that we hire with cloud experience, and our goal for you is to help us understand best practices for... ...experience with data platforms and technologies such as Kafka, Presto, Delta Lake, Spark, etc.Bachelor's Degree in...
- ...Senior Data EngineerAs a Senior Data Engineer at Grainger, you will play a pivotal role in designing, building, and optimizing robust data pipelines and... ..., PostgreSQL, and event-streaming platforms like Kafka.Strong knowledge of containerization (Docker, Kubernetes...H1bLocal area
- ...As a Senior Data Engineer, you will have the opportunity to build solutions that ingest, transform, store, and distribute our big data to... ...with Structured Streaming (Spark or otherwise) Experience with Kafka and/or Azure Event Hub Experience with GitHub SaaS / GitHub Actions...
- ...Collaborate with product managers, data scientists, engineering, and program management teams to define product features, business deliverables,... ...similar tools, AWS pipelines, Snowpipe, Streaming solutions, Kafka and other industry standard tools and processes is...
$98k - $169.05k
...Senior Data EngineerCincinnati, OH; Chicago, ILOverview: 84.51° is a retail data science... ....Join us at 84.51°!As a Senior Data Engineer, you will have the opportunity to build solutions... ...(Spark or otherwise)Experience with Kafka and/or Azure Event HubExperience with Github...Work at office$130k
...collaboration, cutting-edge technology, data driven solutions, and automation. We specialize... .... What you’ll do as a Software Engineer on the Data Engineering team at Akuna:... ...cloud architecture utilizing Kubernetes/EKS, Kafka/MSK and Databricks/Spark. Mentor junior...Full timeInternshipWork at office- ...FTE About the Role We're looking for an experienced Data Engineer to design, build, and optimize large-scale data pipelines and... ...domains Familiarity with CI/CD practices for data pipelines Experience working with streaming data (Kafka, Kinesis)...
$98k - $182k
...business. We are a small, high-impact team of engineers operating at massive scale—trillions of... ...), your work directly connects our data ecosystem to the biggest platforms in the... ...concurrency. Exposure to streaming technologies (Kafka) or NoSQL databases. Base Salary: $98,00...Local areaFlexible hours$179.4k - $204.7k
Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced... ...data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4+ year experience working on real-...Full timePart timeInternshipH1bLocal area- Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-... ...Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4+ year experience working on real-...InternshipH1bLocal area
$140k - $160k
Fitch Group is currently seeking a Lead/Principal Data Engineer based out of our New York office.As a leading, global financial information... ..., data mesh/fabric architectures, and streaming platforms (Kafka, Kinesis).Proficiency with observability tools (Datadog) and data...Temporary workWork at officeImmediate startWorldwideShift work2 days per week- Job ID: 24363172Reference Number: 24-01226Title: Data Engineer TesterLocation: Chicago, IL, 08830Posted Date: 2024-12-10Company: HAN Staffing... ..., ADLS Gen 2, Cosmos DB Familiarity with Azure Event Hub or Kafka for validating streaming data pipelines. Understanding of...
$133.37k - $156.9k
...One.Job DescriptionWe are seeking a highly skilled Senior Cloud Data Engineer to join our Data Product Engineering team. This role is hands-... ....Understanding of messaging and streaming platforms such as Kafka, MQ, AWS SQS, or RabbitMQ.Security & GovernanceStrong understanding...Full timeWork experience placementLocal area3 days per week$180k - $250k
Job details: Lead Data Engineer | 5+ Years Experience | Scalable Batch & Streaming Pipelines | Cloud Architecture (AWS, Databricks, Kubernetes... ...our hybrid cloud architecture utilizing Kubernetes/EKS, Kafka/MSK, and Databricks/Spark. Mentor junior engineers in software...Local area$180k - $250k
Data Engineer $180000 - $250000 per year | Chicago, IL | On-Site | Permanent Lead Data Engineer | 5+ Years Experience | Scalable Batch &... ...within our hybrid cloud architecture utilizing Kubernetes/EKS, Kafka/MSK, and Databricks/Spark. Mentor junior engineers in software...Permanent employmentLocal area$244.7k - $279.2k
Distinguished Data Engineers are individual contributors who strive to be diverse in thought so we visualize the problem space. At Capital... ...problems with cutting-edge cloud technologies (like Snowflake, Kafka, and AWS). If you thrive on technical challenges, demand data...Full timePart timeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - Kafka. Be the first to apply!
- junior data engineer remote Chicago, IL
- director data engineering Chicago, IL
- hadoop big data developer Chicago, IL
- data engineer intern Chicago, IL
- senior data quality engineer Chicago, IL
- senior cloud data engineer Chicago, IL
- data engineer contract Chicago, IL
- data infrastructure engineer Chicago, IL
- entry level big data engineer Chicago, IL
- data science developer Chicago, IL




