Lead Data Engineer
VDart Inc
Job Title: Lead Data Engineer
Location: Toronto , ON (Onsite)
Job Type: Contract
Responsibilities:
- Lead the design, development, and implementation of scalable data engineering solutions on Microsoft Azure.
- Architect and develop ETL/ELT pipelines using Azure Data Factory (ADF) and Azure Databricks.
- Build and optimize large-scale data processing frameworks using PySpark and Spark SQL.
- Design and maintain enterprise data lakes and Delta Lake architectures.
- Develop robust data models to support analytics, reporting, and business intelligence initiatives.
- Optimize data pipelines for performance, scalability, reliability, and cost efficiency.
- Implement data quality, governance, security, and compliance best practices.
- Design and support CI/CD pipelines for automated deployment of data engineering solutions.
- Collaborate with solution architects, business analysts, data scientists, and stakeholders to translate business requirements into technical solutions.
- Troubleshoot complex production issues and ensure high availability of enterprise data platforms.
- Mentor junior and mid-level data engineers while promoting engineering best practices.
- Participate in code reviews, architecture discussions, and technical design sessions.
Skills :
- Lead the design and delivery of scalable data platforms using Azure Data Factory, Databricks, PySpark, SQL, and Delta Lake. Architect ETL/ELT pipelines, data lakes, and analytics solutions
- Drive performance optimization, governance, CI/CD, and stakeholder engagement while mentoring teams and ensuring reliable enterprise data products
- Strong experience with Azure Databricks and Azure Data Factory (ADF).
- Expertise in PySpark, Apache Spark, and Spark SQL.
- Strong SQL programming and database optimization skills.
- Hands-on experience with Delta Lake, data lakes, and modern data architectures.
- Experience designing enterprise-scale ETL/ELT pipelines.
- Strong understanding of Azure cloud services and data engineering best practices.
- Experience implementing CI/CD pipelines using Azure DevOps or Git-based deployment tools.
- Knowledge of data governance, data security, and performance tuning.
- Experience working in Agile/Scrum environments.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Ontario, CA vacancy
- ...We are hiring for a Lead Data Engineer. The role focuses on production support and management of data engineering pipelines, including data ingestion, processing, monitoring, and incident management. A strong fit will have 8+ years of production data engineering experience...Suggested
J M Group Inc
Ontario, CA1 day ago - Lead Data Engineer Location: Toronto, ON - Hybrid Duration: Long Term contract Experience Level: 8+ years Responsibilities Develop and maintain backend systems using Python and PySpark ensuring high performance, scalability, and reliability. Participate in the design...SuggestedLong term contractWork experience placement
- Atlantis IT group is looking for a Lead Data Engineer with a long-term contract opportunity in Ontario, CA, working in a hybrid model. The ideal candidate should have over 8 years of experience in designing, developing, and maintaining complex systems using various technologies...SuggestedLong term contract
- ...Role: Senior AWS Data Engineer - 10+yrs ( Must - AWS CERTIFICATION) Location: Toronto, ON Work Model: Hybrid 3 Days/Week Onsite Duration: 12-Month Contract (Extension Possible) Job Summary We are seeking a Senior AWS Data Engineer with 1...SuggestedContract work3 days per week
Atlantis IT group
Ontario, CA1 day ago - ...We're looking for a Data Engineer with strong Python and SQL Server expertise to build and maintain ETL pipelines and reporting solutions for a major Canadian bank in downtown Toronto. The ideal candidate is comfortable working across the full data lifecycle from extraction...Suggested
J M Group Inc
Ontario, CA1 day ago - ...Data Engineer Snowflake Position: Contract Location: Downtown Toronto Duration: 12+ months Job description: Strong hands-on experience designing and operating Snowflake in production Deep experience with Snowflake features, like Snowpark...Contract workTemporary work
Lorven technologies
Ontario, CA1 day ago - ...We are seeking an experienced Data Engineer with strong hands-on expertise in Informatica Intelligent Cloud Services (IICS) and enterprise data integration . The ideal candidate will have strong ETL, SQL, data warehousing, and troubleshooting skills. Key...2 days per week
J M Group Inc
Ontario, CA1 day ago - ...Data Engineer Toronto, ON ( Remote) Job description Key Responsibilities Design and implement scalable data architectures using Snowflake Develop optimize and maintain ETLELT pipelines for data ingestion and transformation Model and design...Full timeRemote work
VDart Inc
Ontario, CA1 day ago $114.28k - $140k
...Senior Data Engineer The Senior Data Engineer leads the design, modernization, and operational support of the enterprise data platform. This role is responsible for architecting, optimizing, and supporting enterprise data integration, warehousing, reporting, and automation...LERETA
Pomona, CA1 day ago- ...We are looking for a Senior Data Engineer with strong experience in AWS Big Data, Hadoop, Spark/PySpark, Kafka, SQL, Shell Scripting, and Scala/Java/Python to support an Enterprise Data Lake. Purpose Senior Data Engineer role to be part of our scrum...
J M Group Inc
Ontario, CA1 day ago - Join the Clean Energy RevolutionBecome a Data Science Manager at Southern California Edison... ...a better tomorrow. In this job, you’ll lead a team of data scientists in developing... ...technical leader, you will partner with engineers, strategy owners, IT, risk management, and...Remote workRelocation
- Flight Centre Travel Group is hiring a Junior Data Engineer to build and maintain data solutions that drive business analytics. Located in Ontario, California, this role involves working within a collaborative development team to contribute to impactful projects. Responsibilities...
$91.6k - $115.2k
...needs by providing end-to-end support of data, reporting, analytics, insights, and... ...datasets. Collaborate across AIML, data engineering, and analytics to deploy and monitor solutions... ...Who We Are: TD is one of the world's leading global financial institutions and is the...Work experience placementWork at officeWork from homeTD
Ontario, CAmore than 2 months ago$104.04k - $137.84k
...pivot from a “job” opportunity to an authentic experience!The Data Engineer II assists in the implementation of methods to improve data reliability... ..., document and execute unit test cases/scripts, peer and lead code reviews per code review checklist and document test and...Temporary workWork experience placementRemote workMonday to FridayFlexible hours- Your Role: The goal of the Dimensional Data Team (DDT) is to own and deliver dimensional data on concepts like Artists, Participants,... ...artist and music label decisions. We are looking for a Software Engineer to build and manage data sets, pipelines, transformations, APIs,...Local area
- The engineering team at Chainalysis seeks an Engineering Manager to lead a team of 6 engineers in building and maintaining data pipelines and cloud infrastructure. You will create conditions for success by removing blockers, promoting growth, and driving engineering excellence...
$75k - $82.25k
Junior Data Engineer Flight Centre Travel Group is one of the world’s largest travel retailers and corporate travel managers. The company, headquartered in Brisbane, Australia, operates in 23 countries spanning Australia, New Zealand, the Americas, Europe, the United Kingdom...Night shift- Southern California Edison seeks an Integration Capacity Analysis Engineer 3 to enhance complex system studies and undertake responsibilities including guiding junior engineers and engaging in technical leadership. This hybrid position emphasizes the role's impact on energy...
- ...California Edison is seeking an Integration Capacity Analysis Engineer 3 in Pomona, CA, to lead system studies and enhance methodologies to power our... ...tools while collaborating with various teams to improve data quality. Ideal candidates will have a Bachelor's in Engineering...
- ...Data Platform Engineer Position: Contract Location: Downtown Toronto Duration: 12+ months Job description: Strong Python backend development (FastAPI, microservices, REST APIs) Data development with SQL and Snowflake (Snowpark, Stored...Contract workTemporary work
Lorven technologies
Ontario, CA1 day ago - ...remote role with periodic in-person team meetings in Pomona, CA . About the Role We are seeking an experienced Senior Data Engineering & Analytics Lead to drive data strategy, build scalable data infrastructure, and deliver actionable insights that support strategic...Work at officeRemote work
- Southern California Edison (SCE) is seeking a Data Engineering Advisor to design, build, and govern large-scale data pipelines and data platforms in a hybrid-California setting. You will partner with IT, Engineering, and business teams to deliver data-driven solutions...
- SUMMARYThis role positions data as a strategic asset in support of the company's goals and objectives. The Data Integration Engineer is responsible for designing, developing, and implementing enterprise-level business intelligence solutions, data integration processes,...
- A professional services company is seeking a Senior Data Engineering & Analytics Lead to drive data strategy and build scalable data infrastructure. This remote role includes leading the design of data solutions, applying advanced analytical methods, and developing dashboards...Remote job
- Join the Clean Energy Revolution Become a Data Engineering Advisor at Southern California Edison (SCE) and build a better tomorrow. In this job, you’ll be responsible for developing data integration pipelines (ETL) sourcing from various databases and systems. The advisor...Remote workRelocation
$69.6k - $142.7k
Job Title: Data Scientist for Analytics (Engineer/Scientist Support)Job Category: Information TechnologyTime Type: Full timeMinimum Clearance Required... ...Convey analysis inputs to government analysts and government leads.Collaboration: Work effectively with multidisciplinary...Contract workFor contractorsWork experience placementFlexible hoursShift work- Wmg is looking for a Software Engineer in Ontario, California to lead the development of data sets and solutions for the music industry. In this role, you will build and manage pipelines and APIs, ensuring quality and scalability as part of a high-performing team. The ideal...
- A healthcare organization in Rancho Cucamonga seeks a Data Engineer II to enhance data reliability and quality. This role involves improving architectures for data extraction and transformation, with responsibilities that include implementing ETL procedures and managing...
- ...RESTful APIs aligned to those designs Develop cloud-native applications (AWS preferred) Implement workflow automation and data pipelines where needed Contribute across the full software development lifecycle, including CI/CD Ensure solutions are production...Full timeFor subcontractor
Goldenpick Technologies
Ontario, CA1 day ago - A healthcare organization in California is seeking an Engineer III to analyze DHCS/CMS requirements and manage submissions tracking. The ideal candidate will have at least 6 years of relevant experience and a Bachelor's degree. Responsibilities include working cross-functionally...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
Related searches
- data collection researcher Ontario, CA
- sap master data Ontario, CA
- clinical data Ontario, CA
- master data coordinator Ontario, CA
- data coordinator Ontario, CA
- data visualization Ontario, CA
- data loss prevention engineer Ontario, CA
- clinical data coordinator remote Ontario, CA
- data recovery Ontario, CA
- ai data Ontario, CA