Lead Data Engineer
J M Group Inc
We are hiring for a Lead Data Engineer. The role focuses on production support and management of data engineering pipelines, including data ingestion, processing, monitoring, and incident management.
A strong fit will have 8+ years of production data engineering experience with GCP, CDC pipelines, Java, and data processing technologies.
What you bring
- 8+ years of experience supporting and managing data engineering pipelines in production environments.
- Strong experience with Change Data Capture using Debezium and file-based ingestion using CSV.
- Hands-on experience with GCP Pub/Sub, Dataflow (Apache Beam), and Datastream.
- Experience working with Cloud SQL (PostgreSQL) environments.
- Experience managing staging and curated data layers for downstream consumption.
- Strong understanding of production monitoring, alerting, and incident management processes.
- Experience with API-based integrations within data pipelines.
- Strong Java programming experience for data processing and support activities.
What you'll do
- Provide end-to-end production support for data ingestion and processing pipelines.
- Monitor and manage CDC pipelines and batch ingestion processes for multiple source systems.
- Handle incidents, perform root cause analysis, and implement preventive fixes.
- Work with GCP Pub/Sub topics, subscriptions, DLQs, and alerting mechanisms.
- Support staging and transformed data processing layers.
- Perform production deployments and coordinate testing across lower environments.
- Troubleshoot and resolve data, performance, and pipeline failures within SLAs.
- Serve as technical lead for AMS support and coordinate day-to-day operations.
- Own incident communication, escalation, and stakeholder updates.
- Maintain operational runbooks and provide guidance to L2/L3 support teams.
- Identify recurring issues and drive continuous improvements for system stability and reliability.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Ontario, CA vacancy
- Lead Data Engineer Location: Toronto, ON - Hybrid Duration: Long Term contract Experience Level: 8+ years Responsibilities Develop and maintain backend systems using Python and PySpark ensuring high performance, scalability, and reliability. Participate in the design...SuggestedLong term contractWork experience placement
- Atlantis IT group is looking for a Lead Data Engineer with a long-term contract opportunity in Ontario, CA, working in a hybrid model. The ideal candidate should have over 8 years of experience in designing, developing, and maintaining complex systems using various technologies...SuggestedLong term contract
- ...Data Engineer Toronto, ON ( Remote) Job description Key Responsibilities Design and implement scalable data architectures using Snowflake Develop optimize and maintain ETLELT pipelines for data ingestion and transformation Model and design...SuggestedFull timeRemote work
VDart Inc
Ontario, CA1 day ago - ...We are seeking an experienced Data Engineer with strong hands-on expertise in Informatica Intelligent Cloud Services (IICS) and enterprise data integration . The ideal candidate will have strong ETL, SQL, data warehousing, and troubleshooting skills. Key...Suggested2 days per week
J M Group Inc
Ontario, CA1 day ago - ...Role: Senior AWS Data Engineer - 10+yrs ( Must - AWS CERTIFICATION) Location: Toronto, ON Work Model: Hybrid 3 Days/Week Onsite Duration: 12-Month Contract (Extension Possible) Job Summary We are seeking a Senior AWS Data Engineer with 1...SuggestedContract work3 days per week
Atlantis IT group
Ontario, CA1 day ago $114.28k - $140k
...Senior Data Engineer The Senior Data Engineer leads the design, modernization, and operational support of the enterprise data platform. This role is responsible for architecting, optimizing, and supporting enterprise data integration, warehousing, reporting, and automation...LERETA
Pomona, CA1 day ago- Join the Clean Energy RevolutionBecome a Data Science Manager at Southern California Edison... ...a better tomorrow. In this job, you’ll lead a team of data scientists in developing... ...technical leader, you will partner with engineers, strategy owners, IT, risk management, and...Remote workRelocation
- Flight Centre Travel Group is hiring a Junior Data Engineer to build and maintain data solutions that drive business analytics. Located in Ontario, California, this role involves working within a collaborative development team to contribute to impactful projects. Responsibilities...
$91.6k - $115.2k
...needs by providing end-to-end support of data, reporting, analytics, insights, and... ...datasets. Collaborate across AIML, data engineering, and analytics to deploy and monitor solutions... ...Who We Are: TD is one of the world's leading global financial institutions and is the...Work experience placementWork at officeWork from homeTD
Ontario, CAmore than 2 months ago$104.04k - $137.84k
...pivot from a “job” opportunity to an authentic experience!The Data Engineer II assists in the implementation of methods to improve data reliability... ..., document and execute unit test cases/scripts, peer and lead code reviews per code review checklist and document test and...Temporary workWork experience placementRemote workMonday to FridayFlexible hours- Your Role: The goal of the Dimensional Data Team (DDT) is to own and deliver dimensional data on concepts like Artists, Participants,... ...artist and music label decisions. We are looking for a Software Engineer to build and manage data sets, pipelines, transformations, APIs,...Local area
- The engineering team at Chainalysis seeks an Engineering Manager to lead a team of 6 engineers in building and maintaining data pipelines and cloud infrastructure. You will create conditions for success by removing blockers, promoting growth, and driving engineering excellence...
$75k - $82.25k
Junior Data Engineer Flight Centre Travel Group is one of the world’s largest travel retailers and corporate travel managers. The company, headquartered in Brisbane, Australia, operates in 23 countries spanning Australia, New Zealand, the Americas, Europe, the United Kingdom...Night shift- ...California Edison is seeking an Integration Capacity Analysis Engineer 3 in Pomona, CA, to lead system studies and enhance methodologies to power our... ...tools while collaborating with various teams to improve data quality. Ideal candidates will have a Bachelor's in Engineering...
- Southern California Edison seeks an Integration Capacity Analysis Engineer 3 to enhance complex system studies and undertake responsibilities including guiding junior engineers and engaging in technical leadership. This hybrid position emphasizes the role's impact on energy...
- ...Data Platform Engineer Position: Contract Location: Downtown Toronto Duration: 12+ months Job description: Strong Python backend development (FastAPI, microservices, REST APIs) Data development with SQL and Snowflake (Snowpark, Stored...Contract workTemporary work
Lorven technologies
Ontario, CA1 day ago - Southern California Edison (SCE) is seeking a Data Engineering Advisor to design, build, and govern large-scale data pipelines and data platforms in a hybrid-California setting. You will partner with IT, Engineering, and business teams to deliver data-driven solutions...
- A professional services company is seeking a Senior Data Engineering & Analytics Lead to drive data strategy and build scalable data infrastructure. This remote role includes leading the design of data solutions, applying advanced analytical methods, and developing dashboards...Remote job
- Join the Clean Energy Revolution Become a Data Engineering Advisor at Southern California Edison (SCE) and build a better tomorrow. In this job, you’ll be responsible for developing data integration pipelines (ETL) sourcing from various databases and systems. The advisor...Remote workRelocation
- ...remote role with periodic in-person team meetings in Pomona, CA . About the Role We are seeking an experienced Senior Data Engineering & Analytics Lead to drive data strategy, build scalable data infrastructure, and deliver actionable insights that support strategic...Work at officeRemote work
- SUMMARYThis role positions data as a strategic asset in support of the company's goals and objectives. The Data Integration Engineer is responsible for designing, developing, and implementing enterprise-level business intelligence solutions, data integration processes,...
$69.6k - $142.7k
Job Title: Data Scientist for Analytics (Engineer/Scientist Support)Job Category: Information TechnologyTime Type: Full timeMinimum Clearance Required... ...Convey analysis inputs to government analysts and government leads.Collaboration: Work effectively with multidisciplinary...Contract workFor contractorsWork experience placementFlexible hoursShift work- Wmg is looking for a Software Engineer in Ontario, California to lead the development of data sets and solutions for the music industry. In this role, you will build and manage pipelines and APIs, ensuring quality and scalability as part of a high-performing team. The ideal...
- A healthcare organization in Rancho Cucamonga seeks a Data Engineer II to enhance data reliability and quality. This role involves improving architectures for data extraction and transformation, with responsibilities that include implementing ETL procedures and managing...
- A healthcare organization in California is seeking an Engineer III to analyze DHCS/CMS requirements and manage submissions tracking. The ideal candidate will have at least 6 years of relevant experience and a Bachelor's degree. Responsibilities include working cross-functionally...
- A healthcare organization in Rancho Cucamonga is seeking a Data Engineer II to enhance data reliability and develop efficient architectures for data management. Ideal candidates will have four years of experience in data modeling with strong SQL skills, and will be involved...
$115k - $140k
...fantastic culture as well as competitive pay, 401K with match, and medical, dental, and vision benefits. What You’ll Do The Senior Data Engineer will drive the growth, productivity, and management of our organization by sourcing and delivering information critical for...- ...RESTful APIs aligned to those designs Develop cloud-native applications (AWS preferred) Implement workflow automation and data pipelines where needed Contribute across the full software development lifecycle, including CI/CD Ensure solutions are production...Full timeFor subcontractor
Goldenpick Technologies
Ontario, CA1 day ago - ...approach to where we work. About the Role: As a Machine Learning Engineer, you will have the opportunity to collaborate closely with... ...problems executing on a high throughput system with dynamic data. About the Job: Design, develop, and deploy machine learning...Permanent employmentFull timeWork at officeRemote workWork from homeFlexible hours
Instacart
Pomona, CA3 days ago $107.66k - $161.7k
...working on our Poe product. About the Team and Role: Our small engineering team works on challenging problems every day. We have a culture... ...end ownership of Machine Learning systems -- from prototyping, data pipelines and training, to realtime LLM application at scale...Remote jobFull timeWork experience placementInternshipQuora
Pomona, CA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
Related searches
- data collection researcher Ontario, CA
- sap master data Ontario, CA
- clinical data Ontario, CA
- master data coordinator Ontario, CA
- data coordinator Ontario, CA
- data visualization Ontario, CA
- data loss prevention engineer Ontario, CA
- clinical data coordinator remote Ontario, CA
- data recovery Ontario, CA
- ai data Ontario, CA