Data Engineer

Full-time

SFE

Chicago, IL

Position: Data Engineer (Healthcare Exp Is Must)

Location: St. Louis MO Richardson TX Chicago IL (Onsite)

Duration: Contract

Job Description

We are looking for an experienced Data Engineer with strong expertise in Databricks, Azure, Scala, Python, and Apache Spark to design, develop, and maintain scalable data engineering solutions. The ideal candidate will have hands-on experience building data pipelines, processing large datasets, and working with cloud-based data platforms.

Key Responsibilities

Design and develop scalable data pipelines and ETL/ELT workflows using Databricks and Apache Spark.
Develop data engineering solutions using Python and Scala.
Work with Azure cloud services for data ingestion, storage, processing, and integration.
Build and optimize Spark-based data processing applications for large-scale datasets.
Develop data transformation, cleansing, and validation processes.
Collaborate with data architects, analysts, and application teams to deliver reliable data solutions.
Troubleshoot performance, data quality, and pipeline issues.
Follow best practices for data security, scalability, monitoring, and deployment.

Required Skills

Strong hands-on experience with Databricks
Strong knowledge of Microsoft Azure
Expertise in Apache Spark
Strong programming skills in Python and Scala
Experience with ETL/ELT and data pipeline development
Experience working with large-scale data processing and distributed computing
Good understanding of cloud-based data engineering concepts
Strong communication and problem-solving skills

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the Data Engineer in Chicago, IL vacancy

Lead Data Engineer
...Description Job Description Description: Hybrid At least 2 days per week in office in Chicago, IL Our client seeks a Lead Data Engineer to design, build, and optimize large-scale data processing for attribution, measurement, forecasting, and privacy-preserving...
Suggested
Hourly pay
Work at office
Local area
2 days per week
Eliassen Group
Chicago, IL
a month ago
Lead Data Engineer
$70 - $83 per hour
job summary: Are you a Data Engineer with over 10 years of experience and expertise working with Databricks on AWS? Overview: · We are investing in the next evolution of our data, analytics, and artificial intelligence ecosystem. We are looking for a Lead Data Engineer...
Suggested
Hourly pay
Contract work
Temporary work
Work experience placement
Local area
Chicago, IL
8 days ago
Lead Data Engineer
$179.4k - $204.7k
...Overview Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group...
Suggested
Full time
Part time
Internship
H1b
Local area
Capital One
Chicago, IL
more than 2 months ago
Lead Data Engineer
$92k - $138k
Role description Lead Data Engineer Lead II - Data Engineering Who We Are: Born digital, UST transforms lives through the power of technology. We walk alongside our clients and partners, embedding innovation and agility into everything they do. We help them create transformative...
Suggested
Full time
Temporary work
Part time
Work at office
Local area
Remote work
Flexible hours
UST Inc
Chicago, IL
2 days ago
Lead Data Engineer
...Lead Data EngineerAre you a Data Engineer with over 10 years of experience and expertise working with Databricks on AWS? We are investing in the next evolution of our data, analytics, and artificial intelligence ecosystem. We are looking for a Lead Data Engineer who's...
Suggested
Randstad
Chicago, IL
3 days ago
Data Engineer
...maintain highly scalable, available, secure, and elastic cloud-ready data solutions using cutting-edge technologies to support our... ...information science or a related field preferred.3+ years in data engineering building production data pipelines (batch and/or streaming)...
Relocation package
HAVI Logistics
Chicago, IL
a month ago
Data Engineers
...we Advance Human Ability, together.Job Description SummaryJob DescriptionData Engineers for Chicago, IL location.Develop secure, stable, scalable long-term plans for the flow of hospital data.Assist in the development of scalable data infrastructure and platforms to collect...
Full time
Remote work
Shirley Ryan AbilityLab
Chicago, IL
a month ago
Data Engineer - Cumberland/FICCO
$150k - $200k
...Ethan HudsonEmail: ****@*****.***: (***) ***-****Data Engineer - Quantitative Trading SystemsLocation: Chicago, IL (Preferred)... ...New York, NYAbout the Opportunity We are seeking a high-caliber Data Engineer to join a premier global proprietary trading firm. This...
Flexible hours
Objective Paradigm
Chicago, IL
a month ago
Data Engineer, Cumberland/FICCO
$150k - $200k
...expectations, integrity, innovation and a willingness to challenge consensus.About the TeamThe DRW Cumberland & FICC Options Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work...
Temporary work
Flexible hours
DRW
Chicago, IL
a month ago
Data Engineer /Chicago, Illinois / C2C
...Job Title: Data Engineer Location: Chicago, Illinois (Chicagoland area) Duration : 6 month Experienced Data Engineer to design and deliver core capabilities of our Leasing data platform. You will own the architecture and hands-on delivery of data models...
Contract work
For contractors
Stellent IT LLC
Chicago, IL
3 days ago
Data Engineer 4
$179.4k - $204.7k
...Overview Data Engineer 4 Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive and iterative delivery environment? At Capital One, you'll be part of a big group of makers...
Full time
Part time
Internship
H1b
Local area
Capital One
Chicago, IL
7 days ago
Data Engineer - GenAI
$90k - $110k
...solutions to implementing and managing them seamlessly, Concept Reply helps customers unlock the potential of IoT. We are seeking a Data Engineer to join our team and contribute to the development of data-driven and generative AI solutions, working directly with clients as...
Full time
Reply
Chicago, IL
10 days ago
Data Engineer
Data Engineer
Full time
SFE
Chicago, IL
3 days ago
Data Engineer
$100k - $115k
...Chicago with advisors across the U.S., we operate as a registered investment advisor (RIA).Your Future Team The Senior Associate, Data Engineer, reporting to the Managing Director, Software Engineering, builds and maintains the data pipelines and infrastructure that power...
Permanent employment
Work at office
Local area
Work from home
Monday to Thursday
Hightower Advisors
Chicago, IL
15 days ago
Data Engineer
...Responsibilities: Design and develop scalable data pipelines for data extraction, transformation, integration, and loading.... ...techniques. Collaborate with data architects, data scientists, AI engineers, and analysts to support data-driven solutions. Support data...
Temporary work
PB consulting
Chicago, IL
18 days ago
Data Engineer
...Data EngineerVisa status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. Tax Terms: W2, 1099 Corp... ...strong technical Experience with AWS cloud services and DevOps engineering: S3, IAM, EC2, EMR, RDS, Redshift, Cloudwatch with Docker, Kubernetes...
Keylent Inc
Chicago, IL
2 days ago
Data Migration Engineer
$70 - $75 per hour
...Base Pay Range $70.00/hr - $75.00/hr Apex Systems is currently hiring for a Data Migration Engineer with a large financial client in Charlotte, NC / Denver, CO / Chicago, IL. Location Charlotte, NC / Chicago, IL / Denver, CO Pay range: $70-75/hour on W2...
Contract work
Currently hiring
Apex Systems
Chicago, IL
58 minutes ago
Data Engineer
$125k - $200k
...value through deep sector expertise and forward-thinking strategies. Under direction of the Head of Data Analytics & Architecture, Global, the successful Data Engineer candidate will be responsible for designing, building, and maintaining the data infrastructure and...
Local area
Flexible hours
Afternoon shift
Harrison Street
Chicago, IL
a month ago
Data Engineer II
$130k - $160k
...W2 Only, No Sponsorship Available Full - Time $135,000 - $160,000/year Position Summary We're looking for a skilled Data Engineer to join our team. This role is responsible for the design and maintenance of various data pipelines and integration platforms, with...
Full time
Freelance
Remote work
Medix Technology
Chicago, IL
3 days ago
Pricing Data Engineer
$110k - $169k
...real work: We offer generous compensation packages that recognize hard work and excellence. Job Description The Pricing Data Engineer builds and maintains the data infrastructure and tools that enable consistent, data-driven pricing across the firm while modernizing...
Full time
Work at office
McDermott Will & Schulte
Chicago, IL
2 days ago
Data Engineer
$96.93k
...preparation, creation, and delivery of operational and analytical data solutions for our business users/partners. Interpret various... ...the business.This position requires a Bachelor's degree in Data Engineering, Computer Science, or related discipline and 2 years of...
Hub Group
Oak Brook, IL
3 days ago
Data Engineer
...Data EngineerLocation: Chicago, IL (On-site / Hybrid as required) Term: Direct HireKey Technical Requirements & Preferences:Core Skills... ...for a quick ramp-up.Role Dynamics & Focus:Split: 70% Engineering / 30% ArchitectureAutonomy: Must be able to design solutions and...
InterSources
Chicago, IL
5 days ago
Data Engineer
$95k - $110k
...critical thinking, and a willingness to embrace change as part of how we work. Position Overview As part of the Data Integration & Delivery Team, the Data Engineer position will be responsible for the analysis, development, implementation, testing, and ongoing support of...
Temporary work
Work at office
Local area
Flexible hours
Ascot Group
Chicago, IL
1 day ago
Data engineer
...Launch Your Data Career with Proof, Not Promises—At SynergisticITIf you're serious about starting a high-impact, high-paying career in Data Science, Analytics, or Engineering, it's time to stop guessing and start choosing results. At SynergisticIT, we don't just offer...
SynergisticIT
Chicago, IL
2 days ago
Data Engineer
$89k - $148k
...Data EngineerGuidehouse seeks a Data Engineer with some AI experience to support in building, optimizing, and maintaining data pipelines, AI solutions, and analytics platforms. The ideal candidate will have hands-on experience with modern data engineering tools, AI solutions...
Flexible hours
Guidehouse
Chicago, IL
4 days ago
Data Engineer
...Data Engineer – Data Catalog (Alation)We are seeking an experienced Data Engineer with expertise in Alation for a 6-12 month contract. This is a fully remote position, offering an excellent opportunity to work with cutting-edge data governance technologies.Location: Chicago...
Hourly pay
Contract work
Remote work
Georgia IT Inc
Chicago, IL
5 days ago
Data Engineer
...Data EngineerCandidates should have extensive experience using Informatica IDMC, Snowflake, and Microsoft technologies (SQL Server,... ...business objectives, and enhance the firm's competitive edge.The Data Engineer is responsible for designing, developing, and maintaining the...
Hourly pay
Contract work
Temporary work
Remote work
Flexible hours
Software Technology Inc
Chicago, IL
1 day ago
Data Engineer II
...Data Engineer IIEmployer: Amazon.com Services LLCLocation: Chicago, ILDesign, develop, implement, test, document, and operate large-scale, high-volume, high-performance data structures for business intelligence analytics. Implement data structures using best practices...
Amazon
Chicago, IL
1 day ago
Data Engineer III
...transformational journey to unlock the full potential of enterprise data, build a dynamic, diverse, and inclusive culture and develop a... ...'s degree in quantitative field (statistics, software engineering, business analytics, information systems, aviation management or...
Temporary work
Flexible hours
Kaav Inc.
Chicago, IL
2 days ago
Data Engineer
$134k
...Data EngineerChicago, ILProlaio believes that continuous learning and collaboration can make a significant difference in how heart care... ...reach.The OverviewWe are seeking a skilled and motivated Data Engineer to join our Data Engineering team. In this role, you will enhance...
Temporary work
Work at office
Flexible hours
Prolaio
Chicago, IL
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!