AZURE Data Engineer - ADF, ADB, PySpark, SQL, and architecting ETL frameworks.

Atlantis IT group

Role: AZURE Data Engineer - ADF, ADB, PySpark, SQL, and architecting ETL frameworks.

Toronto

Hybrid - 4 days

Role Description:
Looking for a Data Engineer with strong experience in ADF, ADB, PySpark, SQL, and architecting ETL frameworks.

Essential Skills:
Azure Data Factory (ADF)
Azure Databricks (ADB)
PySpark
SQL
Architecting ETL Frameworks

Required Skills:
Strong communication skills with the ability to liaise and coordinate with SMEs and technical partners Strong ability to break down technical requirements into actionable tasks Proficient with relational databases such as MS SQL and SQL scripting Proficient in building and maintaining Azure Data Factory pipelines for data ingestion orchestration Good OOP understanding with experience in Python or Java Proficiency with Git (Bitbucket or GitHub) Good understanding of CI/CD concepts for building and deploying artifacts Understanding of synchronous and asynchronous data encryption/decryption

Nice to Have Skills:
Azure Databricks Notebooks or Apache Spark for data transformations Datadog dashboard and monitoring experience Azure Data Lake Gen2 Understanding of Parquet and Delta Lake concepts Experience with XLR for CI/CD Experience with Flyway for data migrations

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the AZURE Data Engineer - ADF, ADB, PySpark, SQL, and architecting ETL frameworks. in Ontario, CA vacancy

Lead Data Engineer
...Job Title: Lead Data Engineer Location: Toronto... ...solutions on Microsoft Azure. Architect and develop ETL/ELT pipelines using Azure Data Factory (ADF) and Azure Databricks.... ...scale data processing frameworks using PySpark and Spark SQL. Design and maintain...
SQL
Contract work
VDart Inc
Ontario, CA
1 day ago
Senior Data Engineer
$114.28k - $140k
...Senior Data Engineer The Senior Data Engineer... ...is responsible for architecting, optimizing, and supporting... ...solutions across Azure, Snowflake,... ...Azure Data Factory (ADF), Azure Data Lake... ...ADLS Gen2), Azure SQL, Snowflake,... ...OpenFlow and modern ELT frameworks Designs scalable...
SQL
LERETA
Pomona, CA
4 days ago
Data Engineer II
$104.04k - $137.84k
...authentic experience!The Data Engineer II assists in the... ...implementation of ETL procedures,... ...solutions using Microsoft SQL Server Integration Services (SSIS), Azure Data Factory,... ..., Az Data Bricks, PySpark ETL. Develop and... ...team, Data Warehouse Architect, and Data Systems...
SQL
Temporary work
Work experience placement
Remote work
Monday to Friday
Flexible hours
Inland Empire Health Plan
Rancho Cucamonga, CA
21 hours ago
Senior AWS Data Engineer - 10+yrs ( Must - AWS CERTIFICATION)
...Role: Senior AWS Data Engineer - 10+yrs ( Must - AWS CERTIFICATION)... ...expertise in AWS data engineering, ETL development, and real-time data... ...ELT workflows using AWS Glue (PySpark/Python) . Develop serverless... ...Airflow . Write complex SQL queries and optimize database...
SQL
Contract work
3 days per week
Atlantis IT group
Ontario, CA
1 day ago
Data Engineer - Snowflake - Downtown Toronto
...Data Engineer Snowflake Position: Contract Location... ...functions. Hands-on ETL/ELT development experience with dbt, SQL, and one or more ingestion... ...native services (AWS, Azure or GCP) as they relate to... ...apps using Snowpark or lightweight web frameworks....
SQL
Contract work
Temporary work
Lorven technologies
Ontario, CA
1 day ago
Azure Database Architect || Toronto, ON - Hybrid || Fulltime FTE
...Azure Database Architect Location: Toronto, ON Work Model: Hybrid... ...Modernization, and Enterprise Data Platform Design ~ Extensive... ...~ Strong expertise in Azure SQL Database, Azure SQL Managed... ...mentor development and database engineering teams. Collaborate with...
SQL
Full time
Acestack
Ontario, CA
1 day ago
Senior Data Platform Engineer: Azure, Snowflake & Power BI
LERETA, LLC is seeking a Senior Data Engineer to lead the design,... ...enterprise data platform. You will architect and optimize data integration... ...reporting, and automation across Azure, Snowflake, and Power... ...in data engineering, strong SQL, and expertise in Azure Data...
SQL
LERETA, LLC
Pomona, CA
11 hours ago
Data Engineer ( IICS )
...We are seeking an experienced Data Engineer with strong hands-on expertise in Informatica Intelligent Cloud Services (IICS) and... ...enterprise data integration . The ideal candidate will have strong ETL, SQL, data warehousing, and troubleshooting skills. Key...
SQL
2 days per week
J M Group Inc
Ontario, CA
1 day ago
SENIOR SQL SERVER DATABASE DEVELOPER / DATA ENGINEER
...CA Job Summary The Senior SQL Server Database Developer / Data Engineer serves as the technical lead for enterprise... ...enterprise applications Architect ETL/ELT pipelines integrating data... ...Experience with Microsoft Fabric, Azure Data Factory, or cloud-based data...
SQL
Contract work
Temporary work
Flexible hours
VSolvit
Norco, CA
22 days ago
Data Science Developer - Senior
...Job Title: Data Science Developer - Senior... ...technology stacks: Azure Storage, Azure Data... ...Power BI, Python, SQL, Azure Databricks,... ...to cover both data engineering/data pipeline work... ...requirements, and architect, design, code, and... ...including ingestion, ETL, and production for...
SQL
Innosystech Inc
Ontario, CA
1 day ago
Senior Data Engineer
$120k - $160k
...platforms for financial data access, enrichment, and... ...hiring our Senior Data Engineer (Data / ML Platform) to... ...Our stack Python, SQL, Bash Google Cloud Platform... ...and Protocol Buffers Azure DevOps Grafana and... ...Strong experience with ETL/ELT development, data modeling...
SQL
Full time
Contract work
Temporary work
Remote work
Flexible hours
Flinks
Ontario, CA
1 day ago
Data Integration Engineer
SUMMARYThis role positions data as a strategic asset in... .... The Data Integration Engineer is responsible for... ...using SSIS, PowerShell, and SQL scripts. Manages job scheduling... ...SSRS, data warehouse, ETL and BI technologies, and... ...Fabric and Microsoft Azure Power Platform (Power Bi...
SQL
Citizens Business Bank
Rancho Cucamonga, CA
3 days ago
Retirement Data Platform Staff Engineer
$197k - $247k
...Role: We are looking for a Staff Engineer to build, and maintain the data infrastructure at Gusto Retirement.... ...Identify, adopt and improve frameworks, policies and tools to streamline the... ...skills in Python and proficiency in SQL for data extraction and manipulation...
SQL
Work at office
Local area
2 days per week
3 days per week
Gusto
Ontario, CA
more than 2 months ago
SQL SERVER DATABASE DEVELOPER/ DATA ENGINEER II
...POSITION IS 100% ONSITE IN NORCO, CA Job Summary The SQL Server Database Developer / Data Engineer II independently designs, develops, and maintains... ...reporting platforms. This role is responsible for developing ETL/ELT processes, optimizing database performance,...
SQL
Temporary work
Flexible hours
VSolvit
Norco, CA
22 days ago
Data Engineering, Advisor
...Clean Energy Revolution Become a Data Engineering Advisor at Southern... ...data integration pipelines (ETL) sourcing from various databases... ...coding languages (i.e. Python, SQL) and/or low-code environments... ...Python, SQL, Apache Airflow, Azure Data Factory, or similar platforms...
SQL
Remote work
Relocation
Socket.dev
Pomona, CA
1 day ago
Solution Architect - Integration (Azure & AliCloud) || Toronto, ON - Hybrid || Fulltime FTE
...Solution Architect Integration (Azure & AliCloud) Location: Toronto, ON Work... ...solution guidance, and mentoring to engineering teams. Drive architecture best... ...Event-Driven Architecture ETL & Data Integration Cloud-Native Architecture...
Full time
Acestack
Ontario, CA
1 day ago
Cloud Solution Architect - Azure Security || Toronto, ON - Onsite || Fulltime FTE
...Cloud Solution Architect - Azure Security Location: Toronto, ON... ...preferred) and modern frontend frameworks ~ Proven experience leading... ...JWT . Collaborate with Engineering, Security, DevOps, and Business... ...Security: Tokenization, Data Protection, Encryption, Secure...
Full time
Acestack
Ontario, CA
1 day ago
Solution Architect - GFT Azure & COTS Products
...Job Title: Solution Architect GFT Azure & COTS Products Location: Toronto, ON Work Mode: Hybrid FTE... ...standards, and solution roadmaps Work with Azure services, APIs, SaaS/COTS platforms, data integrations, and enterprise architecture frameworks...
Full time
Acestack
Ontario, CA
1 day ago
Sr. Cloud Architect
$147.9k - $184.9k
...impact. The Sr. Cloud Architect will be responsible to... ..., QA, DevOps, and Engineering teams for migrating, building... ...& sub-systems, how data flows, where failures are... ..., preferably Azure or AWS Expert knowledge... ...relational databases (Microsoft SQL) and non-relational...
SQL
Full time
Work experience placement
Local area
Flexible hours
Origence
Ontario, CA
27 days ago
SQL SERVER DATABASE DEVELOPER / DATA ENGINEER
...IS 100% ONSITE DAILY IN NORCO, CA Job Summary The SQL Server Database Developer / Data Engineer I supports the design, development, implementation, and... ..., this role develops database objects, assists with ETL/ELT processes, performs data validation, and contributes...
SQL
Temporary work
Flexible hours
VSolvit
Norco, CA
22 days ago
Senior Software Engineer / Architect - Search Engine Internals (Full-Text & Hybrid Retrieval)
$135.2k - $306.4k
...Description Senior / Principal Software Engineer or Architect Database Engine, Search & Document... ...role. The AI angle here is about the data layer: document processing, hybrid lexical... ...one or more of the following areas. SQL/JSON and Document Engine Internals...
SQL
Full time
Temporary work
Flexible hours
Oracle
Pomona, CA
21 hours ago
Application Solution Architect - Java || Toronto, ON - Hybrid || Fulltime FTE
...Application Solution Architect Java Location: Toronto, ON Work Model: Hybrid Employment... ...Java applications on Microsoft Azure ~ Proven experience with Microservices... ...Azure API Management Azure SQL Azure Service Bus Docker Kubernetes...
SQL
Full time
Acestack
Ontario, CA
1 day ago
Data Platform Engineer - Downtown Toronto
...Data Platform Engineer Position: Contract Location: Downtown Toronto Duration: 12+ months Job description: Strong... ..., microservices, REST APIs) Data development with SQL and Snowflake (Snowpark, Stored Procedures, Tasks, Streams,...
SQL
Contract work
Temporary work
Lorven technologies
Ontario, CA
1 day ago
Senior Data & BI Reporting Engineer
$61.8k - $165.33k
The Senior Data & BI Reporting Engineer is responsible for acquiring, cleansing, and analyzing large data... ...technologies such as Databricks, Snowflake, SQL, Python, and Tableau. The role... ...extractions and complex transformations using ETL tools, with experience in AWS,...
SQL
Temporary work
Fairygodboss
San Dimas, CA
12 hours ago
Full Stack Analytics Engineer
$125k - $140k
...Title Full Stack Analytics Engineer Business Unit Operations... ..., and serve customers runs on data we own end to end. Canyon Bicycles... .... systems portfolio. You will architect and build the systems that... ...Build and maintain Python and SQL extraction processes pulling...
SQL
Full time
Work experience placement
Work at office
Local area
Remote work
Work from home
Home office
Shift work
CANYON BICYCLES USA INC
Rancho Cucamonga, CA
5 days ago
Full Stack Developer (Python AI, React, Node.js)
...environments. Collaborate with business stakeholders, architects, QA, and DevOps teams to deliver high-quality... ..., LangChain, Hugging Face , or similar AI/GenAI frameworks. Experience with prompt engineering, AI orchestration, and intelligent automation....
Full time
Acestack
Ontario, CA
1 day ago
Senior AI Engineer / Generative AI || Toronto, ON - Hybrid || Fulltime FTE
...Senior AI Engineer / Generative AI... ...Responsibilities Design, architect, and deploy... ...LLMs, orchestration frameworks, and AI tools.... ...Collaborate with Data Engineering, Platform... ...Java R SQL JavaScript... ...Experience with Azure OpenAI , AWS Bedrock...
SQL
Full time
Acestack
Ontario, CA
1 day ago
SQL Developer
...Job: SQL Developer Location: Rancho cucamonga, CA Employment Type... ...SQL Server databases and ETL solutions using SSIS (SQL Server... ...possess solid work experience in data integration, performance... ...C#, .Net Standard & .Net Core frameworks, Rest API development, Message...
SQL
Full time
Work experience placement
Work from home
Flexible hours
TECHOAUTH SOLUTIONS LLC
Rancho Cucamonga, CA
4 days ago
Staff Platform Engineer, Universal Directory
...an experienced Staff Software Engineer to join Okta's Universal Directory... .... Develop and implement frameworks and toolings for our Universal... ...the practical application of SQL databases. ~ Experience working... ...Active Directory or Microsoft Azure. P17918_3419596 #LI-BB1...
SQL
Local area
Worldwide
Okta
Ontario, CA
18 days ago
Data Scientist II
$91.6k - $115.2k
...needs by providing end-to-end support of data, reporting, analytics, insights, and... .... Use programming languages (Python, Pyspark, SQL) to extract and prepare data, apply statistics... .... Collaborate across AIML, data engineering, and analytics to deploy and monitor solutions...
SQL
Work experience placement
Work at office
Work from home
TD
Ontario, CA
more than 2 months ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AZURE Data Engineer - ADF, ADB, PySpark, SQL, and architecting ETL frameworks.. Be the first to apply!