azure Data engineer
3B Staffing LLC
Job Title: Azure Data Engineer
Location: Chicago, IL - must do one day week onsite
Length: 6 months
ADF
Databricks
Python
SQL
Retail experience would be helpful, but not required Job Title: Azure Data Engineer
Job Summary: We are seeking a highly skilled Azure Data Engineer to design, build, and optimize our next-generation cloud data platform. You will build scalable data pipelines, manage enterprise data warehouses, and transform massive datasets using Azure Cloud, ADF, Databricks, Spark, and PySpark. Key Responsibilities
• Pipeline Orchestration: Design and implement scalable ETL/ELT pipelines using Azure Data Factory (ADF).
• Big Data Processing: Build high-performance, distributed data transformation workloads via Azure Databricks and Apache Spark/PySpark.
• Data Warehousing: Architect, model, and maintain cloud-native Data Warehouses and Data Lakes (ADLS Gen2).
• Architecture Implementation: Apply modern architectural patterns like the Medallion Architecture (Bronze, Silver, Gold layers) and Delta Lake formats.
• Performance Tuning: Optimize Spark jobs, cluster configurations, and SQL queries to minimize latency and cloud compute costs.
• Governance & Security: Implement security frameworks, data lineage, and user access policies using Unity Catalog.
• CI/CD Automation: Deploy, monitor, and automate workflows using Azure DevOps and automated alert configurations. Required Technical Skills:
• Cloud Platform: Microsoft Azure Ecosystem (ADLS Gen2, Azure SQL, Synapse Analytics, Key Vault, Storages, Azure Functions, Logic Apps).
• Data Orchestration: Advanced proficiency in Azure Data Factory (ADF).
• Compute & Analytics: Deep hands-on experience with Azure Databricks.
• Big Data Frameworks: Strong mastery of Apache Spark and PySpark (including Spark SQL).
• Languages: Expert level in Python and SQL.
• Data Warehousing: Solid understanding of Data Modeling (Star/Snowflake schema) and warehousing concepts
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the azure Data engineer in Chicago, IL vacancy
- ...zure Data Engineer NYC, NY (Midtown) - hybrid WFH Summary s a crucial member of our Data and AI team, this role is pivotal in... ...flat files, SQL databases, SharePoint libraries and lists, and Azure storage. Optimize data ingestion method for each source...SuggestedWork from home
1872 Consulting
Chicago, IL3 days ago - Accenture Flex is hiring a Data Engineer to design, develop, and maintain data solutions for data generation, collection, and processing. You will build data pipelines, ensure data quality, and implement ETL processes to migrate and deploy data across systems, acting as...SuggestedFlexible hours
- ...Data Center Engineer | Trading Infrastructure Location: Chicago, IL About the opportunity I'm partnered with a technology-driven trading firm that operates some of the most sophisticated low-latency and high-performance computing infrastructure in the industry...SuggestedPermanent employmentFull timeFor contractors
Autonomai Recruitment
Chicago, IL2 days ago - ...Location: Chicago, IL (On-site) Employment Type: Internship Role Description This Financial Data Engineering Intern role at Solar Digital Agro LLC is an on-site position based in Chicago, IL. The intern will support the development and maintenance of financial...SuggestedInternship
Solar Digital Agro LLC
Chicago, IL14 hours ago $150k - $250k
...Data Engineer - $150k - $250k Base ($200k - $400k TC) – NYC/ Chicago/ London (Hybrid) – Prop Trading Overview We are currently partnered with a leading global proprietary trading firm seeking an experienced Data Engineer to join their growing technology function...SuggestedIntec Select
Chicago, IL4 days ago- ...Connect Search is working with a large manufacturer who is seeking multiple AWS Data Engineers with strong Python, Pandas, SQL, and ETL pipeline development experience. The ideal candidate will have a proven background building scalable data pipelines, performing complex...Full time2 days per week
Connect Search, LLC
Chicago, IL3 days ago - ...Business Intelligence Data Modeler Engineer II What You’ll Do Are you passionate about turning complex data into meaningful insights... ...Hard Requirements: MS Tech Stack SQL Server MS Azure Synapse Required • Data Modeling Expertise: Strong...Full time
Request Technology, LLC
Chicago, IL4 days ago - ...Role: Data Engineer Engagement: Fixed-term contract Location: Chicago, IL (hybrid) About the Role The role will design and... ...project deliveries. Required Skills Strong hands-on Azure or AWS experience (Databricks, ADF, Synapse, Glue, EMR)....Fixed term contract
TechNET
Chicago, IL1 day ago - ...Job Title: Senior Data Engineer (Databricks) Primary Location: Chicago, IL (Hybrid – 3 days onsite / 2 days remote) Position Type:... ...driven. You'll be one of the core builders of a brand-new Azure Databricks platform, designing and delivering the pipelines, transformations...Full timeRemote work3 days per week
BinaryBees Business Solutions LLC
Chicago, IL3 days ago - ...Position: Data Engineer – Gen AI & AWS Location: Chicago, IL (Onsite) Duration: 12 Months Contract Candidate you are willing to work on W2 expect Student Visa are advised to apply for this role Job Description ~7-8 + years in Data Engineering, ML Engineering...Full timeContract work
Delta System & Software, Inc.
Chicago, IL1 day ago $140k - $165k
...global professional services organization is expanding its Data & AI engineering team and hiring a Data Engineer to support a large-scale cloud... ...Chicago and focuses on building modern data pipelines using Azure Databricks, Python, SQL, and Spark in a production...Full timeImmediate startMotion Recruitment
Chicago, IL2 days ago- ...We are seeking a highly specialized strictly hands-on Senior Data Engineer to design develop and maintain the complex data pipelines... ...sources into our data storage systems using Informatica IDMC Azure Data Factory and dbt. Data Integration & Transformation...Full time
$130k - $180k
...SUMMARY Jenner & Block is seeking an experienced Enterprise Data Engineer to join our Information Technology team. In this role, you... ...Dataflows Gen2, Notebooks, OneLake, Real-Time Intelligence); Azure (Data Factory, Blob Storage, Data Lake Storage, Key Vault); Microsoft...Full timeWork at officeVisa sponsorshipWork visaJenner & Block
Chicago, IL4 days ago- ...Role:-Analytics Engineer Location:-Chicago, IL (preferred 1st) or Dallas (2nd preference), may also consider Edna, MN or Centennial, CO... ...calculations, prompts, and interaction patterns. Partner with Data Engineers to resolve data-model, quality, performance, and access...Full time
Amtex Systems Inc
Chicago, IL1 day ago $110k - $156k
...About the Company The Senior Developer, Data Engineering will lead the design, development, and delivery of Evention's enterprise data... ...scale data transformation and integration. Build .NET-based Azure Function Apps and serverless, event-driven workflows for...Full timeEvention
Chicago, IL1 day ago$126.58k - $164.55k
...Inland is seeking a highly skilled Senior Data Engineer to serve as a technical and analytical leader within our Enterprise Analytics team... ...strategy while working with cutting-edge Microsoft and Azure technologies. If you are passionate about data architecture...Full timeTemporary workThe Inland Real Estate Group of Companies, Inc.
Oak Brook, IL4 days ago- ...SAS processes within the Anaconda environment. Translate SAS data transformation, analytical, reporting, and automation logic... ...reporting, analytics, business intelligence, data management, or data engineering environments. Advanced-level Python development experience...Contract workLocal areaRemote workVisa sponsorshipWork visa
Calculated Hire
Chicago, IL4 days ago $130k - $160k
...60,000.00 USD Annually Description: We're looking for a Data Engineer III who doesn't just build pipelines - they engineer the bloodstream... ...precision and speed. Automate complex workflows using Azure & Fabric , Spark , and Python . Lead engineering...Remote workFlexible hours- ...enable research and product development. Our data and reporting infrastructure – using... ...confidence, and at scale. As a Data Visualization Engineer on the Tempus Next team, you will work on... ...Amazon Web Services (AWS), or Microsoft Azure Experience with Infrastructure as Code (...
Tempus
Chicago, IL2 days ago - ...Overview DecisionPoint seeks a Journeyman Data/ETL Engineer to develop and maintain extract, transform, and load workflows supporting the USMEPCOM ENLIST program. This position will sustain SQL Server Integration Services (SSIS), build approved integrations, and...Contract workFor contractorsLocal areaRemote work
$175k - $225k
We are seeking a dedicated and experienced Data Engineer to join our Chicago team. The ideal candidate is energized by working in a cutting-edge environment that enables IMC to continue to be at the forefront of the evolving global financial markets. Your Core Responsibilities...Permanent employmentFull time$99.83k - $135k
...as internal equity and alignment with market data Job Summary: The Senior Research Facility Data Management Engineer is a senior-level individual contributor responsible... ...cloud and enterprise platforms such as AWS, Azure, Google Cloud, Microsoft 365, or comparable...Work at office- ...Overview DecisionPoint seeks a Senior Data/ETL Engineer to sustain SQL Server Integration Services (SSIS), develop approved integrations, and maintain reliable data pipelines supporting the USMEPCOM ENLIST program. This position will implement raw, standardized...Contract workFor contractorsLocal areaRemote work
- ...Data Engineer Location: Chicago, IL Remote Duration: 12+ months Rate: DOE U.S. Citizens and those authorized to work in the U... ...good knowledge in SQL (7+ out of 10), PySpark, Databricks on Azure (7+ out of 10), SparkSQL (7+ out of 10), Azure/ADLS (7+ out of...Remote work
Georgia IT Inc
Chicago, IL3 days ago - ...Senior Data Engineer At Epsilon, we do more than collect and store data. We help some of the world's biggest brands discover real opportunities inside the data types, delimiters and decimals. We are looking for a Senior Data Engineer to help build the next generation...Local areaFlexible hours
Prodigious Worldwide
Chicago, IL1 day ago $145.87k - $182k
...Senior, Data Engineer Epsilon powers connected marketing by unlocking the full potential of data and identity. This position requires work from the company office in Chicago, IL, certain days per week, with telecommuting allowed for the balance of the week. Responsibilities...Work at officeRemote workFlexible hoursPublicis Health
Chicago, IL4 days ago$200k - $250k
...Data Engineer Jump Trading Group is committed to world class research. We empower exceptional talents in Mathematics, Physics, and Computer Science to seek scientific boundaries, push through them, and apply cutting edge research to global financial markets. Our culture...Work at officeJump Trading
Chicago, IL1 day ago- ...Technology Services shapes how clients manage their money by delivering innovative, reliable technology products and services. As a Data Engineer supporting Sales & Service, you will develop enterprise data solutions that strengthen critical business processes and advance...Work at office
Charles Schwab
Chicago, IL14 hours ago $145.87k - $182k
...Senior, Data Engineer Epsilon powers connected marketing by unlocking the full potential of data and identity. This position requires working from the company office in Chicago, IL, certain days per week, with telecommuting allowed for the balance of the week. Responsibilities...Work at officeRemote workFlexible hoursDigitas
Chicago, IL3 days ago- ...Senior Data Engineer We are seeking a Senior Data Engineer to lead the design, development, and maintenance of scalable, high-performance data solutions focused on Data Centralization, Governance, and Integrity. This is a highly technical role requiring expertise in...Full timeRemote workMonday to Friday
Software Technology Inc
Chicago, IL1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to azure Data engineer. Be the first to apply!
Related searches
- azure developer Chicago, IL
- microsoft azure architect Chicago, IL
- azure specialist Chicago, IL
- cloud engineer azure Chicago, IL
- azure infrastructure engineer Chicago, IL
- junior big data engineer Chicago, IL
- principal data engineer Chicago, IL
- data visualization developer Chicago, IL
- senior data center engineer Chicago, IL
- senior data engineer Chicago, IL