Lead Data Engineer
VDart Inc
Job Title: Lead Data Engineer
Location: Toronto , ON (Onsite)
Job Type: Contract
Responsibilities:
- Lead the design, development, and implementation of scalable data engineering solutions on Microsoft Azure.
- Architect and develop ETL/ELT pipelines using Azure Data Factory (ADF) and Azure Databricks.
- Build and optimize large-scale data processing frameworks using PySpark and Spark SQL.
- Design and maintain enterprise data lakes and Delta Lake architectures.
- Develop robust data models to support analytics, reporting, and business intelligence initiatives.
- Optimize data pipelines for performance, scalability, reliability, and cost efficiency.
- Implement data quality, governance, security, and compliance best practices.
- Design and support CI/CD pipelines for automated deployment of data engineering solutions.
- Collaborate with solution architects, business analysts, data scientists, and stakeholders to translate business requirements into technical solutions.
- Troubleshoot complex production issues and ensure high availability of enterprise data platforms.
- Mentor junior and mid-level data engineers while promoting engineering best practices.
- Participate in code reviews, architecture discussions, and technical design sessions.
Skills :
- Lead the design and delivery of scalable data platforms using Azure Data Factory, Databricks, PySpark, SQL, and Delta Lake. Architect ETL/ELT pipelines, data lakes, and analytics solutions
- Drive performance optimization, governance, CI/CD, and stakeholder engagement while mentoring teams and ensuring reliable enterprise data products
- Strong experience with Azure Databricks and Azure Data Factory (ADF).
- Expertise in PySpark, Apache Spark, and Spark SQL.
- Strong SQL programming and database optimization skills.
- Hands-on experience with Delta Lake, data lakes, and modern data architectures.
- Experience designing enterprise-scale ETL/ELT pipelines.
- Strong understanding of Azure cloud services and data engineering best practices.
- Experience implementing CI/CD pipelines using Azure DevOps or Git-based deployment tools.
- Knowledge of data governance, data security, and performance tuning.
- Experience working in Agile/Scrum environments.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Ontario, CA vacancy
- ...Role: Senior AWS Data Engineer - 10+yrs ( Must - AWS CERTIFICATION) Location: Toronto, ON Work Model: Hybrid 3 Days/Week Onsite Duration: 12-Month Contract (Extension Possible) Job Summary We are seeking a Senior AWS Data Engineer with 1...SuggestedContract work3 days per week
Atlantis IT group
Ontario, CA1 day ago - ...We are seeking an experienced Data Engineer with strong hands-on expertise in Informatica Intelligent Cloud Services (IICS) and enterprise data integration . The ideal candidate will have strong ETL, SQL, data warehousing, and troubleshooting skills. Key...Suggested2 days per week
J M Group Inc
Ontario, CA1 day ago - ...Data Engineer Snowflake Position: Contract Location: Downtown Toronto Duration: 12+ months Job description: Strong hands-on experience designing and operating Snowflake in production Deep experience with Snowflake features, like Snowpark...SuggestedContract workTemporary work
Lorven technologies
Ontario, CA1 day ago - ...Data Engineer Toronto, ON ( Remote) Job description Key Responsibilities Design and implement scalable data architectures using Snowflake Develop optimize and maintain ETLELT pipelines for data ingestion and transformation Model and design...SuggestedFull timeRemote work
VDart Inc
Ontario, CA1 day ago $114.28k - $140k
901 Corporate Center Dr, Pomona, CA 91768, USA Description The Senior Data Engineer leads the design, modernization, and operational support of the enterprise data platform. This role is responsible for architecting, optimizing, and supporting enterprise data integration...SuggestedLERETA
Pomona, CA1 day ago- ...Job Title: Data Science Developer - Senior Location: Toronto, ON Work Model... ...for the same candidate to cover both data engineering/data pipeline work and data science... ...practice. Work with minimal direction and lead and train others in technical components...
Innosystech Inc
Ontario, CA1 day ago $120k - $160k
...into one of North America’s most trusted platforms for financial data access, enrichment, and money movement. We work with innovators... ...where you come in. The Role We're hiring our Senior Data Engineer (Data / ML Platform) to stand up data engineering as a discipline...Full timeContract workTemporary workRemote workFlexible hoursFlinks
Ontario, CA1 day ago- ...Data Engineer Experience Required: 10 & Above Toronto, ON - Hybrid (3Days WFO) 6-12 months AWS Lake Formation and Quick Sight Infrastructure| Terraform| Identy center and Agent Core . Client is looking for engineers with the following skills:Amazon...
J M Group Inc
Ontario, CA1 day ago - Join the Clean Energy RevolutionBecome a Data Science Manager at Southern California Edison... ...a better tomorrow. In this job, you’ll lead a team of data scientists in developing... ...technical leader, you will partner with engineers, strategy owners, IT, risk management, and...Remote workRelocation
$91.6k - $115.2k
...needs by providing end-to-end support of data, reporting, analytics, insights, and... ...datasets. Collaborate across AIML, data engineering, and analytics to deploy and monitor solutions... ...Who We Are: TD is one of the world's leading global financial institutions and is the...Work experience placementWork at officeWork from homeTD
Ontario, CAmore than 2 months ago$120k - $160k
...into one of North America’s most trusted platforms for financial data access, enrichment, and money movement. We work with innovators... ...that keeps it accurate in production. This is a hands-on, engineering-heavy data-science role: you build and ship your own models....Full timeTemporary workRemote workFlexible hoursFlinks
Ontario, CA1 day ago- ...the Clean Energy RevolutionBecome a Senior Data Scientist Advisor at Southern California... ...in solving unconventional problems.Leads and provides direction to other analytic... ...discipline such as Computer Science, Electrical Engineering, Statistics, Mathematics, or Business...Local areaRemote workRelocation
$104.04k - $137.84k
...pivot from a “job” opportunity to an authentic experience!The Data Engineer II assists in the implementation of methods to improve data reliability... ..., document and execute unit test cases/scripts, peer and lead code reviews per code review checklist and document test and...Temporary workWork experience placementRemote workMonday to FridayFlexible hours- ...California Edison is seeking an Integration Capacity Analysis Engineer 3 in Pomona, CA, to lead system studies and enhance methodologies to power our... ...tools while collaborating with various teams to improve data quality. Ideal candidates will have a Bachelor's in Engineering...
- Southern California Edison seeks an Integration Capacity Analysis Engineer 3 to enhance complex system studies and undertake responsibilities including guiding junior engineers and engaging in technical leadership. This hybrid position emphasizes the role's impact on energy...
- ...Data Platform Engineer Position: Contract Location: Downtown Toronto Duration: 12+ months Job description: Strong Python backend development (FastAPI, microservices, REST APIs) Data development with SQL and Snowflake (Snowpark, Stored...Contract workTemporary work
Lorven technologies
Ontario, CA1 day ago - ...Role: AZURE Data Engineer - ADF, ADB, PySpark, SQL, and architecting ETL frameworks. Toronto Hybrid - 4 days Role Description: Looking for a Data Engineer with strong experience in ADF, ADB, PySpark, SQL, and architecting ETL frameworks. Essential...
Atlantis IT group
Ontario, CA1 day ago $118.6k - $157.14k
...Data Engineer III Find joy in serving others with IEHP! We welcome you to join us in "healing and inspiring the human spirit" and to pivot... ...of IEHP data solutions. The Data Engineer III will lead the design and development of data transformation. This position...Temporary workRemote workMonday to FridayFlexible hoursInland Empire Health Plan
Rancho Cucamonga, CA1 day ago- Join the Clean Energy Revolution Become a Data Engineering Advisor at Southern California Edison (SCE) and build a better tomorrow. In this job, you’ll be responsible for developing data integration pipelines (ETL) sourcing from various databases and systems. The advisor...Remote workRelocation
- Southern California Edison (SCE) is seeking a Data Engineering Advisor to design, build, and govern large-scale data pipelines and data platforms in a hybrid-California setting. You will partner with IT, Engineering, and business teams to deliver data-driven solutions...
- SUMMARYThis role positions data as a strategic asset in support of the company's goals and objectives. The Data Integration Engineer is responsible for designing, developing, and implementing enterprise-level business intelligence solutions, data integration processes,...
- A professional services company is seeking a Senior Data Engineering & Analytics Lead to drive data strategy and build scalable data infrastructure. This remote role includes leading the design of data solutions, applying advanced analytical methods, and developing dashboards...Remote job
$69.6k - $142.7k
Job Title: Data Scientist for Analytics (Engineer/Scientist Support)Job Category: Information TechnologyTime Type: Full timeMinimum Clearance Required... ...Convey analysis inputs to government analysts and government leads.Collaboration: Work effectively with multidisciplinary...Contract workFor contractorsWork experience placementFlexible hoursShift work- ...approach to where we work. About the Role: As a Machine Learning Engineer, you will have the opportunity to collaborate closely with... ...problems executing on a high throughput system with dynamic data. About the Job: Design, develop, and deploy machine learning...Permanent employmentFull timeWork at officeRemote workWork from homeFlexible hours
Instacart
Pomona, CA1 day ago $107.66k - $161.7k
...working on our Poe product. About the Team and Role: Our small engineering team works on challenging problems every day. We have a culture... ...end ownership of Machine Learning systems -- from prototyping, data pipelines and training, to realtime LLM application at scale...Remote jobFull timeWork experience placementInternshipQuora
Pomona, CA1 day ago- ...Job Description Job Description Data Scientist II On Site: Norco, CA Job Summary We are seeking a talented and driven... ...degree in Computer Science, Data Science, Mathematics, Statistics, Engineering, or related field Two to five years of experience as a Data...Temporary workFlexible hours
VSolvit
Norco, CAa month ago - ...Description Job Summary We are seeking a talented and driven Data Scientist to join our evolving and dynamic team. This position... ...data-quality or data-leakage issues. Quantitative Feature Engineering: Assist with analyzing historical pricing, inflation indices,...Temporary workInternshipFlexible hours
VSolvit
Norco, CA3 days ago - ...The engineering team at Chainalysis is inspired by solving the hardest technical challenges and... ...automates entity resolution, optimizes data labeling pipelines, and creates predictive... ...re looking for an Engineering Manager who leads through service, not authority. You'll...Flexible hours
chainalysis-careers
Ontario, CA2 days ago $197k - $247k
...customers we serve. Learn more about our Total Rewards philosophy . About the Role: We are looking for a Staff Engineer to build, and maintain the data infrastructure at Gusto Retirement. This is a cross-functional role, and as a part of the Retirement Data Platform...Work at officeLocal area2 days per week3 days per weekGusto
Ontario, CAmore than 2 months ago- ...Job Description Job Description POSITION IS 100% ONSITE IN NORCO, CA Job Summary The SQL Server Database Developer / Data Engineer II independently designs, develops, and maintains enterprise SQL Server database solutions supporting mission-critical applications...Temporary workFlexible hours
VSolvit
Norco, CA22 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
Related searches