Senior Data Engineer
Omni Inclusive
Senior Data Engineer
The Senior Data Engineer will design, build, and optimize scalable data pipelines and solutions leveraging Databricks, Python, ETL, DevOps. This role requires strong experience in cloud-based data platforms and advanced data engineering practices to support analytics and business intelligence initiatives.
Key Responsibilities
- Architect and implement data pipelines using Databricks and Delta Lake for batch and streaming data.
- Develop and maintain ETL/ELT workflows integrating diverse data sources into cloud data lakes and warehouses.
- Implement data governance, security, and compliance standards.
- Automate workflows using Python scripting and CI/CD pipelines.
- Troubleshoot and resolve issues in data ingestion, transformation, and storage.
Required Skills & Experience
- 8+ years in data engineering or related roles.
- Expert-level Python programming for data processing and automation.
- Hands-on experience with Databricks and Delta Lake.
- Strong knowledge of Azure Data Factory, Data Lake, and Synapse (or equivalent cloud platforms).
- Proficiency in SQL and performance tuning.
- Familiarity with DevOps practices, CI/CD, and infrastructure-as-code tools.
- Experience with data migration and cloud-native architectures.
- Excellent problem-solving and communication skills
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Chicago, IL vacancy
- THE GLOBAL LEADER IN DATA & ANALYTICS RECRUITMENTHarnham Search and Selection Company Number: 05723485Harnham Search and Selection is a registered company in England and Wales. Reg no. 05723485Harnham Europe Limited Company Number: 09956940Harnham GmbH HRB: 196954Harnham...SeniorWork at office
Harnham
Chicago, IL1 day ago $140k - $170k
Chicago, VAHybridFull Time$140k - $170k Join a growing, data-driven organization that is investing heavily in its modern... ...data platform and analytics capabilities. We are seeking a Senior Databricks Data Engineer to design, build, and optimize enterprise-scale data solutions...SeniorFull timeMotion Recruitment
Chicago, IL1 day ago$140k - $165k
Chicago, IllinoisHybridDirect Hire$140k - $165k A well-established, global professional services organization is expanding its Data & AI engineering team and hiring a Data Engineer to support a large-scale cloud data platform initiative. This role is based in Chicago and...SeniorFull timeImmediate startMotion Recruitment
Chicago, IL2 days ago- ...Senior Data Engineer, Automation Location : Chicago, downtown * Please note this position requires 3 days onsite; local candidates only Overview: This position owns the movement, shaping, and quality checking of data that arrives through file-based integrations...SeniorFull timeWork at officeLocal area
Forbes Technical Consulting
Chicago, IL11 hours ago $130k - $160k
...and an unwavering commitment to delivering high-quality consumer healthcare experiences at scale. Job Description The Senior Data Engineer designs, builds, and operates data pipelines and platform infrastructure across multi-brand data platforms that power...SeniorFull timeThe Aspen Group
Chicago, IL3 days ago- ...substantially over the last several years and is now investing in the data foundation that will carry the next stage of that growth —... ...instead of inheriting them. What You'll Do As a Senior Data Engineer on the Data & Analytics team, you will stay a step ahead of...SeniorFull time
Madison-Davis, LLC
Chicago, IL2 days ago - ...Rate: $60-$65 Hybrid in Downtown Chicago We cannot work C2C or 1099 No Sponsorship or Visa Transfer available Senior Healthcare Data Engineer We are seeking an experienced Senior Healthcare Data Engineer to design, develop, and support scalable data...SeniorContract work
Solving IT
Chicago, IL2 days ago - ...Position: Senior Data Engineer Location: Chicago, IL (3 days Hybrid onsite) Duration: 6+ Months Job Description: we’re working to Advance Care through data-driven decisions and automation. This mission serves as the foundation for every decision as we create...Senior
Alpha Business Solutions
Chicago, IL4 days ago - ...About PremiumIQ PremiumIQ specialize in data analytics for the insurance industry. We help our clients leverage data and advanced... ...~5+ years of professional work experience in data engineering with at least 2+ years working on the Snowflake or Databricks platform...SeniorFull timeWork experience placementRemote workVisa sponsorship
PremiumIQ
Chicago, IL1 day ago $91.7k - $163.7k
...medications, and services they need to feel their best. Join us to start Caring. Connecting. Growing together.Position SummaryAs a Senior Data Engineer on the Optum Rx Data Engineering Ops team, you will be responsible for ensuring the reliability, operational excellence, and...SeniorMinimum wageFull timeWork experience placementLocal areaRemote workUnitedHealth Group
Chicago, IL4 days ago- ...on innovation and automation, IBKR provides clients with access to over 150 markets across 200+ countries and territories. We are a data-driven organization that leverages cutting-edge technology to deliver best-in-class trading solutions, and our teams thrive in a fast...SeniorWork at officeRemote work
Interactive Brokers
Chicago, IL1 day ago - Reporting to the Director of Business Intelligence, you will influence and grow our Business Intelligence practice by developing data engineering pipelines and analytic solutions that support our Advanced Analytics and Data Science teams. You will partner with...SeniorFull timeWork at officeLocal areaFlexible hours
Conagra Brands
Chicago, IL3 days ago - ...technical owner, designing and leading the implementation of scalable data architectures for cutting-edge AI and agentic systems. You will... .... You will also spearhead the design of complex feature engineering workstreams, ensuring our data assets are not only robust but also...SeniorApprenticeshipWork at officeLocal areaEasy work
McKinsey & Company
Chicago, IL4 days ago $128.01k - $152.18k
...businesses to manage risks with confidence.Job DescriptionAI-First Data Strategy for P&C Insurance Carrier | Lead Innovation in Property & Casualty Insurance Data SolutionsWe are seeking a Senior Data Engineer to spearhead our transition to a modern, first, AI-first data...SeniorFull timeWork at officeLocal areaArgo Group
Chicago, IL17 hours ago$140k - $180k
...our team as we help shape a brighter way forward. About JLL and Data EngineeringJLL is a leading professional services firm that... ...tomorrow for our clients, our people, and our communities.The Data Engineering team at JLL sits at the intersection of technology and business...SeniorFull timeLocal areaShift workJones Lang LaSalle
Chicago, IL4 days ago$125k - $180k
...time.We are building the Patient Evaluation Engine: a high-scale, multi-modal healthcare... ...autonomous AI agents reason over clinical data to drive real-time clinical evaluation across... ...of hospitals. We are looking for a Senior Data Engineer to build and own the data platform...SeniorFull timeTempus
Chicago, IL1 day ago$136k - $153k
...to both sides of this exciting, evolving marketplace. We’ve been quite busy, take a peek at some of our recent announcements.Senior Data Engineer at SpotHero:SpotHero is seeking a Senior Data Engineer to join the Data Engineering squad. This squad interacts with data...SeniorCasual workWork at officeImmediate startFlexible hoursSpotHero
Chicago, IL1 day ago- ...partner helping organizations modernize data ecosystems, build real-time analytics capabilities... ...and Gemini Enterprise.You AreA hands-on Engineer with foundational experience in Data... ...directly with clients, supporting senior architects, and contributing to end-to-end...SeniorFull timeWork experience placementLive inWork at officeLocal area
Accenture
Chicago, IL4 days ago $137.4k - $161.7k
Are you ready to make an impact?West Monroe is seeking a Senior Data Engineer to join our Data & AI practice. In this role, you will design, build, and optimize modern cloud data platforms that enable advanced analytics, AI, and business intelligence. Working with technologies...SeniorLocal areaImmediate startFlexible hoursWest Monroe Partners
Chicago, IL2 days ago- ...all the way to the score. Location Chicago or remote (US) Type Full-time Team Engineering What you'll do Own the pipelines that ingest macroeconomic, policy and news data across 54 African markets. Carry provenance end to end, so every input arrives at...SeniorFull timeRemote work
Kilwa Technologies
Chicago, IL4 days ago - ...Senior Data Engineer Chicago, IL ONSITE FROM DAY 1 We need a STRONG database candidate who has good experience in Databricks + Python programming + Azure DevOps pipeline (CI/CD) Senior-level software engineer or data engineer with experience developing and...Senior
Zortech Solutions
Chicago, IL1 day ago - ...Title : Senior Data Engineer Location: Chicago, IL (Hybrid 2-3Days) Exp Required: 10+Years Mandatory Skills : GCP Data Architecture, MDM Conceptual, Data Architecture, Data Lakehouse Architecture, Dimensional Data Modelling & Salesforce Client Overview...Senior
VBeyond
Chicago, IL1 day ago $110k - $156k
...About the Company The Senior Developer, Data Engineering will lead the design, development, and delivery of Evention's enterprise data platform, built primarily on Microsoft Fabric. You will set technical direction for the data platform team, architect scalable data...SeniorFull timeEvention
Chicago, IL1 day ago- ...Senior Analytics Developer – Residential Lending Analytics Remote or Hybrid - Greater... ...the Anaconda environment. Translate SAS data transformation, analytical, reporting,... ...business intelligence, data management, or data engineering environments. Advanced-level Python...SeniorContract workLocal areaRemote workVisa sponsorshipWork visa
Calculated Hire
Chicago, IL4 days ago - ...Our client, a leading organization in the industry sector, is seeking a Senior Data Engineer to join their team. As a Senior Data Engineer, you will be part of the Data & Analytics department supporting cross-functional teams. Job Title: Senior Data Engineer Location...SeniorRelocation
ManpowerGroup Global, Inc.
Chicago, IL3 days ago - ...recognized quantitative trading firm investing heavily in the next generation of its data platform. As data volumes continue to grow across research and trading, they're expanding the engineering team responsible for building the infrastructure that powers real-time...Senior
Fintal Partners
Chicago, IL2 days ago $190k - $230k
...Job Title: Senior Data Engineer/Full Stack Location: Hybrid Chicago, IL Firm Overview: Newmark Group, Inc. (Nasdaq: NMRK), together with its subsidiaries (“Newmark”), is a world leading commercial real estate advisor and service provider to large institutional...SeniorTemporary workNewmark
Chicago, IL4 days ago$77k - $214k
...ApplicableSpecialismSoftware EngineeringManagement LevelSenior AssociateJob Description & SummaryThe OpportunityAs a Forward Deployed Data Engineering - Senior Associate, you will be at the forefront of developing innovative software solutions that drive digital transformation and...SeniorFull timeH1bPwC
Chicago, IL1 day ago$140k - $180k
...Capgemini Sogeti is seeking a Senior Data Engineer with strong experience in Palantir Foundry to architect, develop, and optimize scalable data solutions. This onsite role focuses on data architecture, ontology-aware pipelines and applications, and maintaining a data...SeniorLocal areaDataJobs.com
Chicago, IL2 days ago- ...Senior Data EngineerWe are seeking a Senior Data Engineer to lead the design, development, and maintenance of scalable, high-performance data solutions focused on Data Centralization, Governance, and Integrity. This is a highly technical role requiring expertise in Google...SeniorFull timeRemote workMonday to Friday
Software Technology Inc
Chicago, IL2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- data engineer machine learning Chicago, IL
- aws data engineer Chicago, IL
- big data developer Chicago, IL
- sr data engineer Chicago, IL
- big data cloud engineer Chicago, IL
- finance data engineer Chicago, IL
- junior big data engineer Chicago, IL
- entry level data engineer Chicago, IL
- sr information security engineer Chicago, IL
- data center engineer Chicago, IL