Real-Time Data Engineer: Ab Initio & Kafka Pipelines
Compunnel, Inc.
Compunnel, Inc. is seeking a highly skilled engineer to design and implement high-performance, event-driven data pipelines for a large credit card processing system. You will work with the Ab Initio ecosystem to build stateful services ingesting data from Kafka and other sources, pushing updates to dashboards and downstream databases in near-real-time. You will create complex Ab Initio graphs, implement checkpointing for exactly-once processing, monitor production streams, and optimize #J-18808-Ljbffr Compunnel, Inc.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Real-Time Data Engineer: Ab Initio & Kafka Pipelines in Berkeley Heights, NJ vacancy
- ...in Computer Science, Engineering, or related... ...hands-on experience in Ab Initio development. ~ Strong... ...Conduct ~ It ~ Data Profiler and Continuous... ...and implementing Kafka-based data pipelines. Strong debugging... ...Capture) and near-real-time data processing pipelines...PipelinePermanent employmentTemporary work
PB consulting
Berkeley Heights, NJ17 days ago - ...performance, event-driven data pipelines, ensuring low-latency... ...will work with the Ab Initio ecosystem (GDE, EME,... ...from sources like Kafka or message queues, pushing... ...databases in near-real-time. Key Responsibilities... ...pipelines for data engineering projects. #J-18808-Ljbffr...Pipeline
$45 - $53 per hour
Immediate need for a talented Ab Initio Data Engineer . This is a 06+ Months Contract opportunity... ...CDC (Change Data Capture) and near-real-time data pipelines Troubleshoot production job... ...snowflake schemas) Experience with Kafka Strong debugging and performance-tuning...PipelineContract workWork at officeLocal areaImmediate start- Pyramid Consulting, Inc. has an immediate opening for an Ab Initio Data Engineer on a 6+ months contract in Berkeley Heights, NJ onsite. The role... ...performance optimization, metadata management, and data pipelines. The ideal candidate has 7+ years ETL experience, strong Ab...PipelineContract workImmediate start
- ...2701Reference Number: 24-00675Title: Ab initio DeveloperLocation: Iselin, NJ, 08830Posted... ...processes using Ab Initio to support data warehousing and data integration... ...lifecycle. • Develop and maintain data pipelines to support real-time and batch data processing. 3....Pipeline
- OverviewThe Infosys Engineering unit is dedicated to amplifying... ...focus on adopting a data-first approach to... ...management, enabling real-time visibility into the flow... ...with Git, CI/CD pipelines, and database deployment... ...automation.Experience with Kafka, streaming platforms,...PipelineFull timeTemporary workRelocation
$189.59k
...Data Engineer – AVP Barclays Services Corp. seeks Data Engineer –... ...maintain robust Java-based data pipelines ensuring reliable, complete,... ...leveraging Java, Spark, Kafka, and cloud-native technologies... ...performance degradation in real-time. Collaborate with cross-functional...PipelineHourly payBarclays
Whippany, NJ2 days ago$189.59k
...Barclays Services Corp. seeks Data Engineer – AVP (multiple positions)... ...maintain robust Java-based data pipelines ensuring reliable, complete,... ...leveraging Java, Spark, Kafka, and cloud-native technologies... ...performance degradation in real-time. Collaborate with cross-...PipelineHourly payBarclays
Whippany, NJ1 day ago- ...Reference Number: 23-00030Title: Etl Data EngineerLocation: Iselin, NJ,... ...: HAN Staffing Etl Data Engineer RoleMalvern, PA - HybridCore... .... Ensures that data pipelines are scalable, repeatable, and... ...systems and, develops tools for real-time and offline analytic processing...Pipeline
$76.73k - $127.88k
...collaborative environment? As an experienced Data Engineer, you will have the ability to share new... ..., performant, and cost-effective data pipelines and curated datasets to enable... ...build, and support scalable batch and near-real-time data pipelines on AWS.Design robust ingestion...PipelineLocal areaVisa sponsorship- Job Title: Data Engineering Manager, Commercial US Location: Morristown,... ...building and operating data pipelines and platforms in complex enterprise... ...technologies such as Spark, Kafka, Snowflake, Hadoop, or... ...Experience with batch, near real‑time, and streaming data architectures...Pipeline
$207k - $275k
...more at .What You'll Do:The Data Engineering Team builds and operates the... ...CoreWeave. We design resilient data pipelines, scalable lakehouse systems,... ..., Trino, Spark, Flink, or Kafka.Expert-level SQL and strong... ...US-based offerings for full-time employees; for roles in other...PipelinePermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$71.6k
...DescriptionWe are seeking an Associate Data Engineer to support the S&S Data... ...will build and maintain the pipelines that bring third-party data... ...technologies such as Kafka or KinesisExperience with infrastructure... ...matchingGenerous Paid Time OffExcellent benefits that go...PipelineRemote work- Job ID: 28709035Reference Number: 26-00594Title: Sr. Data Engineer/ Data ArchitectLocation: Iselin, NJ, 08830Posted Date: 2026-0... ...for custom ETL workflows Expertise in building batch and real-time data pipelines Experience with dbt for data transformation and modeling...Pipeline
- ...ETL Talend Developer (Data Engineer) Design and implement cloud-native architectures that will... .... Designing and building data pipeline (batch & streaming), extensive experience in Apache Spark, Spark Streaming Kafka. Hands-on with coding skills to do the POCs...Pipeline
Keylent Inc
Berkeley Heights, NJ2 days ago $182k - $242k
...Senior Data EngineerCoreWeave is The Essential Cloud... ...at You'll Do:The Data Engineering Team builds and... ...design resilient data pipelines, scalable lakehouse systems... ...driven architectures using Kafka, AutoMQ, Pulsar, or similar... ...offerings for full-time employees; for roles in...PipelinePermanent employmentFull timeCasual workWork at officeCoreWeave
Livingston, NJ21 hours ago$87k - $168k
...this role: Wells Fargo is seeking a Data Engineer in Cybersecurity as part of Identity Access... ...science, and is critical to enabling real-time, high-quality insights that support IAM... ...design, support and operation of data pipelines, data models, dashboards, and API...PipelineWork experience placementRelocation packageWells Fargo
Iselin, NJ1 day ago$88k - $105k
...Data EngineerJoin Mizuho as a Data Engineer! The IT Data team is responsible for design and development... ...have to be accurate, timely and highly scalable. In... ...and maintenance of data pipelines on the Databricks... ...frameworks (e.g., Spark, Kafka, etc.).Familiarity with cloud...PipelineInternshipWork at officeLocal areaRemote workWorldwideMizuho Bank Ltd
Iselin, NJ21 hours ago$115.2k - $174k
...a technically grounded Data Delivery Lead to drive... ...stakeholders and our technical engineering teams, leading the delivery of complex data pipelines and analytics solutions... ...data products deliver real functional value. You... ...is built correctly, on time, and meets the business...PipelineHourly payLocal areaRelocation$120.5k - $231k
...you'll be doing:As a Principal Engineer, you will be a key individual... ...within our organization's Data Engineering Services team. You... ...building, and maintaining the data pipelines, ingress/egress integrations,... ...API integrations to support real-time and scheduled data exchange...PipelineFull timeTemporary workPart timeWork experience placementWork at officeImmediate startWork from homeShift work3 days per week$110k - $186k
...consumers to one another millions of times a day - quickly, reliably,... ...Fiserv.Job TitlePrincipal, Data & AI Platform EngineerAbout... ...and implement secure data pipelines to migrate and unify data from... ...Develop ML pipelines for feature engineering, training, validation, and...PipelineFull time- ...Azure Data Engineer Warren, New Jersey, United States About the Job Role & Responsibilities... ...and maintain Azure/Microsoft Fabric data pipelines (batch, streaming, API) using Data Factory, Lakehouse, Warehouse, and Real-Time Analytics. Design scalable data models...Pipeline
Inizio Partners
Warren, NJ21 hours ago - ...Job Title: Senior Data Engineer – Azure Databricks Location: Warren, NJ (Onsite – Local Candidates) Job Type: Contract... ...development. ~ Experience designing scalable batch and real-time data pipelines. ~ Strong knowledge of data modeling, data quality, security...PipelineContract workLocal area
Kasstech
Warren, NJ2 days ago $100.79k - $160.26k
...see what we can achieve. Together.SummaryThe Data Engineer, Solutions & Data role designs, builds, and operates data pipelines and data integration processes that translate... ...in an efficient and responsive manner;Provide timely, accurate, and quality work product;...PipelineFull timeWork at officeRemote workRelocationVisa sponsorshipRelocation package- ...Data Engineer Location: Hybrid 3 times a week too Iselin, NJ May Need to come onsite for final or an Apex Local office for final IV feedback... ...Integration & Migration: Experience with Hadoop, Kafka, data lakes, and real-time streaming Data Modeling & Transformation:...Work at officeLocal area
RIT Solutions
Iselin, NJ4 days ago $127.28k - $190.92k
...Analytics Product Managers, Data Scientists, and further functions... ...-solving capabilities, engineering discipline and the ability to... ...develop and maintain scalable data pipelines, transformation logic,... ...preferred Travel Requirements of the time. LimitedAdditional...Pipeline$172.99k
...Day) Job Description Architect and engineer analytics data solutions to support enterprise-scale... ...Design and engineer large –scale data pipelines and analytical platforms. Implement... ...Requisition ID DE-507 Job Type Full Time Application Email ****@*****.***...PipelineFull timeShift workDay shiftNOVOZEN HEALTHCARE LLC
South Plainfield, NJ3 days ago- ...Title Senior Data Engineer Location Iselin, NJ (Need Onsite day 1, Hybrid 3 days from office)... ...developing, and maintaining robust data pipelines and systems to support our banking operations... ...highly preferred. Knowledge of Apache Kafka or other streaming technologies....PipelineContract workWork at office
Accord Technologies Inc
Woodbridge, NJ1 day ago - ...Position: data engineer Client: Charles schwab Location: Lone Tree, CO Onsite :4 days a week Interview process: 2 video interviews... ...GCP experience (BigQuery required) • Python for ETL/data pipelines and loading data into BigQuery (native Python packages) •...PipelineContract workTemporary workFor contractors
RIT Solutions, Inc.
Summit, NJ1 day ago $157k - $210k
...sources, builds, and delivers data center capacity for our... ...closely with Supply Chain, Product Engineering, Data Center Operations, and... ...design and build scalable data pipelines, models, and dashboards that... ...metrics such as spend, lead times, and on-time performance across...PipelinePermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Real-Time Data Engineer: Ab Initio & Kafka Pipelines. Be the first to apply!
Related searches
- data loss prevention analyst Berkeley Heights, NJ
- data labeling Berkeley Heights, NJ
- data collection Berkeley Heights, NJ
- data visualization Berkeley Heights, NJ
- test data management Berkeley Heights, NJ
- clinical data Berkeley Heights, NJ
- data tech Berkeley Heights, NJ
- data Berkeley Heights, NJ
- data modeling Berkeley Heights, NJ
- data collection researcher Berkeley Heights, NJ