Data Engineer

Full-time

SFE

Chicago, IL

Position: Data Engineer (Healthcare Exp Is Must)

Location: St. Louis MO Richardson TX Chicago IL (Onsite)

Duration: Contract

Job Description

We are looking for an experienced Data Engineer with strong expertise in Databricks, Azure, Scala, Python, and Apache Spark to design, develop, and maintain scalable data engineering solutions. The ideal candidate will have hands-on experience building data pipelines, processing large datasets, and working with cloud-based data platforms.

Key Responsibilities

Design and develop scalable data pipelines and ETL/ELT workflows using Databricks and Apache Spark.
Develop data engineering solutions using Python and Scala.
Work with Azure cloud services for data ingestion, storage, processing, and integration.
Build and optimize Spark-based data processing applications for large-scale datasets.
Develop data transformation, cleansing, and validation processes.
Collaborate with data architects, analysts, and application teams to deliver reliable data solutions.
Troubleshoot performance, data quality, and pipeline issues.
Follow best practices for data security, scalability, monitoring, and deployment.

Required Skills

Strong hands-on experience with Databricks
Strong knowledge of Microsoft Azure
Expertise in Apache Spark
Strong programming skills in Python and Scala
Experience with ETL/ELT and data pipeline development
Experience working with large-scale data processing and distributed computing
Good understanding of cloud-based data engineering concepts
Strong communication and problem-solving skills

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the Data Engineer in Chicago, IL vacancy

Data Engineer
We are looking for a Data Engineer to help build and maintain scalable data solutions that support critical business operations within the brokerage industry. This role is based in Chicago, Illinois, and focuses on designing reliable data pipelines, improving data accessibility...
Suggested
Robert Half
Chicago, IL
12 hours ago
Data Engineer
$89.21k - $144.96k
...happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.As a Data Engineer on the Platform Data Engineering team, you will be responsible for developing Python data pipelines that build business data...
Suggested
Full time
Part time
Flexible hours
Caterpillar
Chicago, IL
4 days ago
Data Engineer
$101.7k - $119.6k
Are you ready to make an impact?West Monroe is seeking a talented Data Engineer to join our Data Engineering & Analytics team. In this role, you will collaborate with our clients to address their most complex needs, working alongside a team of highly skilled engineers and...
Suggested
Local area
Immediate start
Flexible hours
2 days per week
West Monroe Partners
Chicago, IL
12 hours ago
Senior Lead Data Engineer
$128.47k - $208.77k
...With over 1.5 million connected assets worldwide, our teams use data, technology, advanced analytics, telematics, and AI capabilities... ...solutions, and aftermarket leads & insights. As a Senior Lead Data Engineer on the Data Engineering team, you will be responsible for...
Suggested
Full time
Part time
Worldwide
Visa sponsorship
Relocation package
Flexible hours
Caterpillar
Chicago, IL
2 days ago
Data Engineer
$125k - $140k
....Mesirow is looking for a partner to support and modernize our data architecture with the vision of establishing a modern data estate... ...a cloud-native platform built on Azure, Databricks and modern engineering practices, while helping shape the target future state...
Suggested
Full time
Immediate start
Mesirow Financial Holdings
Chicago, IL
2 days ago
Data Engineer
...Responsibilities: Design and develop scalable data pipelines for data extraction, transformation, integration, and loading.... ...techniques. Collaborate with data architects, data scientists, AI engineers, and analysts to support data-driven solutions. Support data...
Contract work
PB consulting
Chicago, IL
19 days ago
Lead Data Engineer
$70 - $83 per hour
job summary: Are you a Data Engineer with over 10 years of experience and expertise working with Databricks on AWS? Overview: · We are investing in the next evolution of our data, analytics, and artificial intelligence ecosystem. We are looking for a Lead Data Engineer...
Hourly pay
Contract work
Temporary work
Work experience placement
Local area
Chicago, IL
10 days ago
Lead Data Engineer
...Description Job Description Description: Hybrid At least 2 days per week in office in Chicago, IL Our client seeks a Lead Data Engineer to design, build, and optimize large-scale data processing for attribution, measurement, forecasting, and privacy-preserving...
Hourly pay
Work at office
Local area
2 days per week
Eliassen Group
Chicago, IL
a month ago
Lead Data Engineer
$180k - $200k
...our firm with talented, intellectually diverse people with excellent work ethics. Role Description We are seeking a Lead Data Engineer to drive the design, architecture, and delivery of scalable data platforms, AI‑powered data products, and enterprise‑grade data...
Work at office
HARBOR CAPITAL ADVISORS
Chicago, IL
4 days ago
Lead Data Engineer
$133k - $175k
...JPMorganChase is hiring a Lead Data Engineer within its Corporate Technology team in Chicago, IL on an onsite basis. In this role, you will design, implement, and maintain data pipelines that support scalable data ingestion and processing, with a strong focus on timeliness...
DataJobs.com
Chicago, IL
1 day ago
Lead Data Engineer
$92k - $138k
Role description Lead Data Engineer Lead II - Data Engineering Who We Are: Born digital, UST transforms lives through the power of technology. We walk alongside our clients and partners, embedding innovation and agility into everything they do. We help them create transformative...
Full time
Temporary work
Part time
Work at office
Local area
Remote work
Flexible hours
UST Inc
Chicago, IL
4 days ago
Lead Data Engineer
$179.4k - $204.7k
## Lead Data EngineerApplylocations: Chicago, ILtime type: Full timeposted on: Posted Todayjob requisition id: R246221Lead Data EngineerDo... ...problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging...
Full time
Part time
Internship
H1b
Local area
Capital One
Chicago, IL
2 days ago
Lead Data Engineer
...Lead Data EngineerRoel: Lead Data Engineer Location: Chicago IL, Locals only. Duration: Longterm Contract Interview Type: Video and Final interview is in-person interview.Snowflake/Snowpipe, SQL, Python/PySparkData Modeling, Data Engineering with Modeling Techniques -...
Contract work
Local area
E-Solutions
Chicago, IL
4 days ago
Senior Data Engineer
$91.7k - $163.7k
...medications, and services they need to feel their best. Join us to start Caring. Connecting. Growing together.Position SummaryAs a Senior Data Engineer on the Optum Rx Data Engineering Ops team, you will be responsible for ensuring the reliability, operational excellence, and...
Minimum wage
Full time
Work experience placement
Local area
Remote work
UnitedHealth Group
Chicago, IL
12 hours ago
Lead Data Engineer
...Lead Data EngineerProven strong experience on building re-usable framework, libraries, and data platform capabilities Azure and Databricks experience Strong experience of python, building re-usable python based frameworks Experience with data lake environment must Work...
Syntricate Technologies
Chicago, IL
4 days ago
Pricing Data Engineer
$110k - $169k
...real work: We offer generous compensation packages that recognize hard work and excellence. Job Description The Pricing Data Engineer builds and maintains the data infrastructure and tools that enable consistent, data-driven pricing across the firm while modernizing...
Full time
Work at office
McDermott Will & Schulte
Chicago, IL
3 days ago
Data Engineer
Data Engineer
Full time
SFE
Chicago, IL
2 days ago
Data Engineer - GenAI
$90k - $110k
...solutions to implementing and managing them seamlessly, Concept Reply helps customers unlock the potential of IoT. We are seeking a Data Engineer to join our team and contribute to the development of data-driven and generative AI solutions, working directly with clients as...
Full time
Reply
Chicago, IL
12 days ago
Data Engineer
$125k - $200k
...value through deep sector expertise and forward-thinking strategies. Under direction of the Head of Data Analytics & Architecture, Global, the successful Data Engineer candidate will be responsible for designing, building, and maintaining the data infrastructure and...
Local area
Flexible hours
Afternoon shift
Harrison Street
Chicago, IL
a month ago
Data Engineer
...Data EngineerCandidates should have extensive experience using Informatica IDMC, Snowflake, and Microsoft technologies (SQL Server,... ...business objectives, and enhance the firm's competitive edge.The Data Engineer is responsible for designing, developing, and maintaining the...
Hourly pay
Contract work
Temporary work
Remote work
Flexible hours
Software Technology Inc
Chicago, IL
3 days ago
Data Engineer II
...Data Engineer IIEmployer: Amazon.com Services LLCLocation: Chicago, ILDesign, develop, implement, test, document, and operate large-scale, high-volume, high-performance data structures for business intelligence analytics. Implement data structures using best practices...
Amazon
Chicago, IL
3 days ago
Data Engineer
...We are looking for a Financial Data Engineer to help build and maintain the data infrastructure supporting our trading, quantitative research, risk management, and operational reporting. This position focuses on financial data engineering rather than general business analytics...
Contract work
Solar Digital Agro LLC
Chicago, IL
17 hours ago
Data Engineer III
...transformational journey to unlock the full potential of enterprise data, build a dynamic, diverse, and inclusive culture and develop a... ...'s degree in quantitative field (statistics, software engineering, business analytics, information systems, aviation management or...
Temporary work
Flexible hours
Kaav Inc.
Chicago, IL
4 days ago
Data Engineer II
$130k - $160k
...W2 Only, No Sponsorship Available Full - Time $135,000 - $160,000/year Position Summary We're looking for a skilled Data Engineer to join our team. This role is responsible for the design and maintenance of various data pipelines and integration platforms, with...
Full time
Freelance
Remote work
Medix Technology
Chicago, IL
5 days ago
Data Engineer
$89k - $148k
...Data EngineerGuidehouse seeks a Data Engineer with some AI experience to support in building, optimizing, and maintaining data pipelines, AI solutions, and analytics platforms. The ideal candidate will have hands-on experience with modern data engineering tools, AI solutions...
Flexible hours
Guidehouse
Chicago, IL
1 day ago
Data Engineer
...Data EngineerLocation: Chicago, IL (On-site / Hybrid as required) Term: Direct HireKey Technical Requirements & Preferences:Core Skills... ...for a quick ramp-up.Role Dynamics & Focus:Split: 70% Engineering / 30% ArchitectureAutonomy: Must be able to design solutions and...
InterSources
Chicago, IL
2 days ago
Data engineer
...Data EngineerLocation: Chicago, IL Must have skills: ETL, SQL and Auto Insurance or P&C background and some testing expJob Description:Minimum 10+ years of hands-on experience in Data Analysis – Development and TestingStrong expertise in Database Concepts, ETL/ELT, Star...
United IT
Chicago, IL
4 days ago
Data Engineer
$97.9k - $133.5k
...Data Engineer 2The Data Engineer 2 designs, builds, and maintains data processing architectures and solutions enabling the efficient conversion of structured and unstructured data to insights at enterprise scale. The Data Engineer 2 work assignments are varied and frequently...
Full time
For contractors
Apprenticeship
Remote work
Work from home
Home office
Humana
Chicago, IL
4 days ago
Data Engineer
$100k - $115k
...Senior Associate, Data EngineerThe Senior Associate, Data Engineer, reporting to the Managing Director, Software Engineering, builds and maintains the data pipelines and infrastructure that power business operations, analytics, and decision-making across Hightower. A...
Permanent employment
Work at office
Local area
Work from home
Monday to Thursday
HighTower Advisors
Chicago, IL
2 days ago
Data Engineer 2
...Data EngineerThe main function of a data engineer is to ensure that the data sets of an organization are supported by an architecture that supports the organization in achieving its strategic goal. A typical data engineer is responsible for setting enterprise standards...
Samprasoft
Chicago, IL
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!