Lead Data Engineer
VDart Inc
Job Title: Lead Data Engineer
Location: Toronto , ON (Onsite)
Job Type: Contract
Responsibilities:
- Lead the design, development, and implementation of scalable data engineering solutions on Microsoft Azure.
- Architect and develop ETL/ELT pipelines using Azure Data Factory (ADF) and Azure Databricks.
- Build and optimize large-scale data processing frameworks using PySpark and Spark SQL.
- Design and maintain enterprise data lakes and Delta Lake architectures.
- Develop robust data models to support analytics, reporting, and business intelligence initiatives.
- Optimize data pipelines for performance, scalability, reliability, and cost efficiency.
- Implement data quality, governance, security, and compliance best practices.
- Design and support CI/CD pipelines for automated deployment of data engineering solutions.
- Collaborate with solution architects, business analysts, data scientists, and stakeholders to translate business requirements into technical solutions.
- Troubleshoot complex production issues and ensure high availability of enterprise data platforms.
- Mentor junior and mid-level data engineers while promoting engineering best practices.
- Participate in code reviews, architecture discussions, and technical design sessions.
Skills :
- Lead the design and delivery of scalable data platforms using Azure Data Factory, Databricks, PySpark, SQL, and Delta Lake. Architect ETL/ELT pipelines, data lakes, and analytics solutions
- Drive performance optimization, governance, CI/CD, and stakeholder engagement while mentoring teams and ensuring reliable enterprise data products
- Strong experience with Azure Databricks and Azure Data Factory (ADF).
- Expertise in PySpark, Apache Spark, and Spark SQL.
- Strong SQL programming and database optimization skills.
- Hands-on experience with Delta Lake, data lakes, and modern data architectures.
- Experience designing enterprise-scale ETL/ELT pipelines.
- Strong understanding of Azure cloud services and data engineering best practices.
- Experience implementing CI/CD pipelines using Azure DevOps or Git-based deployment tools.
- Knowledge of data governance, data security, and performance tuning.
- Experience working in Agile/Scrum environments.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Ontario, CA vacancy
$114.28k - $140k
901 Corporate Center Dr, Pomona, CA 91768, USA Description The Senior Data Engineer leads the design, modernization, and operational support of the enterprise data platform. This role is responsible for architecting, optimizing, and supporting enterprise data integration...SuggestedLERETA
Pomona, CA1 hour ago- Join the Clean Energy RevolutionBecome a Data Science Manager at Southern California Edison... ...a better tomorrow. In this job, you’ll lead a team of data scientists in developing... ...technical leader, you will partner with engineers, strategy owners, IT, risk management, and...SuggestedRemote workRelocation
- ...We're looking for a Data Engineer with strong Python and SQL Server expertise to build and maintain ETL pipelines and reporting solutions for a major Canadian bank in downtown Toronto. The ideal candidate is comfortable working across the full data lifecycle from extraction...SuggestedContract workRemote work
- ...Role: Senior AWS Data Engineer - 10+yrs ( Must - AWS CERTIFICATION) Location: Toronto, ON Work Model: Hybrid 3 Days/Week Onsite Duration: 12-Month Contract (Extension Possible) Job Summary We are seeking a Senior AWS Data Engineer with 1...SuggestedContract work3 days per week
- ...the Clean Energy RevolutionBecome a Senior Data Scientist Advisor at Southern California... ...in solving unconventional problems.Leads and provides direction to other analytic... ...discipline such as Computer Science, Electrical Engineering, Statistics, Mathematics, or Business...SuggestedLocal areaRemote workRelocation
$91.6k - $115.2k
...needs by providing end-to-end support of data, reporting, analytics, insights, and... ...datasets. Collaborate across AIML, data engineering, and analytics to deploy and monitor solutions... ...Who We Are: TD is one of the world's leading global financial institutions and is the...Work experience placementWork at officeWork from home$104.04k - $137.84k
...pivot from a “job” opportunity to an authentic experience!The Data Engineer II assists in the implementation of methods to improve data reliability... ..., document and execute unit test cases/scripts, peer and lead code reviews per code review checklist and document test and...Temporary workWork experience placementRemote workMonday to FridayFlexible hours- SUMMARYThis role positions data as a strategic asset in support of the company's goals and objectives. The Data Integration Engineer is responsible for designing, developing, and implementing enterprise-level business intelligence solutions, data integration processes,...
$69.6k - $142.7k
Job Title: Data Scientist for Analytics (Engineer/Scientist Support)Job Category: Information TechnologyTime Type: Full timeMinimum Clearance Required... ...Convey analysis inputs to government analysts and government leads.Collaboration: Work effectively with multidisciplinary...Contract workFor contractorsWork experience placementFlexible hoursShift work- ...Role: AZURE Data Engineer - ADF, ADB, PySpark, SQL, and architecting ETL frameworks. Toronto Hybrid - 4 days Role Description: Looking for a Data Engineer with strong experience in ADF, ADB, PySpark, SQL, and architecting ETL frameworks. Essential...
- ...The engineering team at Chainalysis is inspired by solving the hardest technical challenges and... ...automates entity resolution, optimizes data labeling pipelines, and creates predictive... ...re looking for an Engineering Manager who leads through service, not authority. You'll...Flexible hours
chainalysis-careers
Ontario, CA1 day ago - **Position is ON SITE in Norco, CA** Job Summary: The Data Analyst Engineer I will provide critical support to Navy operations by developing, maintaining, and enhancing data visualization, reporting, and collaboration platforms. This entry-level role focuses...Temporary workFlexible hours
VSolvit
Norco, CA3 days ago - ...Job Description Job Description Data Scientist II On Site: Norco, CA Job Summary We are seeking a talented and driven... ...degree in Computer Science, Data Science, Mathematics, Statistics, Engineering, or related field Two to five years of experience as a Data...Temporary workFlexible hours
- ...Norco, CA* Job Summary We are seeking a talented and driven Data Scientist to join our evolving and dynamic team. This position... ...when code or data inputs change. Quantitative Feature Engineering: Analyze historical pricing, inflation indices, economic indicators...Temporary workFlexible hours
- ...distribute content through some of the world’s leading and most valued brands, including: FOX... ...FOX is seeking a Principal Data Scientist with deep AdTech experience to... ...with senior leaders across Product and Engineering to influence roadmap decisions, size opportunities...
$197k - $247k
...customers we serve. Learn more about our Total Rewards philosophy . About the Role: We are looking for a Staff Engineer to build, and maintain the data infrastructure at Gusto Retirement. This is a cross-functional role, and as a part of the Retirement Data Platform...Work at officeLocal area2 days per week3 days per week- Join IEHP as a Quality Assurance Engineer II and contribute to improving software quality while working independently across IT. Your role involves coordinating analysis, implementing testing plans, and identifying security issues. With a strong focus on healthcare standards...
- ...Job Description Job Description POSITION IS 100% ONSITE IN NORCO, CA Job Summary The SQL Server Database Developer / Data Engineer II independently designs, develops, and maintains enterprise SQL Server database solutions supporting mission-critical applications...Temporary workFlexible hours
- ...Description POSITION IS 100% ONSITE DAILY IN NORCO, CA Job Summary The Senior SQL Server Database Developer / Data Engineer serves as the technical lead for enterprise database architecture, SQL Server development, data warehousing, and data engineering initiatives...Contract workTemporary workFlexible hours
- ...Description Job Description POSITION IS 100% ONSITE DAILY IN NORCO, CA Job Summary The SQL Server Database Developer / Data Engineer I supports the design, development, implementation, and maintenance of Microsoft SQL Server databases and data integration...Temporary workFlexible hours
$90.9k - $136.4k
...Vehicle Motion Control AI/ML Platform Design Engineer, you will design and implement advanced control, state estimation, and data-driven algorithms for vehicle motion systems,... ...Congestion and we embrace the responsibility to lead the change that will make our world better,...Full time- ...Role: Senior Software Engineer(Python) Location: Toronto Downtown , ON Type: Fulltime Responsibilities and Duties Design and deliver high quality features and enhancements. Own the end-to-end delivery of large features within your...Full time
$125k - $140k
...Position Title Full Stack Analytics Engineer Business Unit Operations, Supply Chain... ...Canyon Canyon is one of the world’s leading direct-to-consumer bicycle brands. We engineer... ..., forecast, and serve customers runs on data we own end to end. Canyon Bicycles USA...Full timeWork experience placementWork at officeLocal areaRemote workWork from homeHome officeShift work- ...REST APIs, and cloud platforms . Work with LLMs, prompt engineering, embeddings, vector databases, and AI orchestration frameworks... ...AI application performance. Collaborate with business, data science, product, and engineering teams to translate requirements...Permanent employmentFull time
- ...Senior AI Engineer / Generative AI Location: Toronto, ON Work Model: Hybrid... ...Cloud-based AI platforms ~ Experience leading technical architecture, mentoring engineering... ...frontend technologies. Collaborate with Data Engineering, Platform Engineering, and...Full time
$100.46k - $145.67k
...for our Team Members. Machine Learning Engineer II As a Machine Learning Engineer II,... ...end to end. Drawing on industrial sensor data and machine PLC , you will develop cutting... ...the following key drivers of success: Lead Like an Owner Manages a safe working...Full timeTemporary workPart timeWork experience placementInternshipSeasonal workWork at officeLocal areaFlexible hoursNiagara Bottling
Diamond Bar, CA1 day ago- ...using Python. Knowledge of OpenAI, LangChain, Hugging Face , or similar AI/GenAI frameworks. Experience with prompt engineering, AI orchestration, and intelligent automation. Exposure to LLM integration and Retrieval-Augmented Generation (RAG) solutions...Full time
$69.6k - $142.7k
...sophisticated software applications. The ideal candidate will possess extensive development experience, a profound understanding of software engineering principles, and a proven track record of delivering scalable, high-quality solutions. In this mid-level role, you will work...Contract workWork experience placementFlexible hours- ...sales software designed for your success. Position Summary We are seeking a talented and experienced Machine Learning/AI Engineer with a specialized focus on OpenAI technologies. As a key member of our team, you will be responsible for setting up and...Full time
Sales Hub Careers
Chino Hills, CA1 day ago - ...Senior Software Engineer - Python Fitch Group is currently seeking a Senior Software Engineer... ...FastAPI/ asyncIO, and architect scalable data pipelines for ingestion, transformation,... ...TDD and clean architecture principles Lead Proof of Concept (POC) initiatives to...Temporary workWork at office2 days per week3 days per week
Fitch Group
Eastvale, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
Related searches