Data Engineer
Compunnel
Job Summary
We are seeking a hands-on Data Engineer to support AI and data initiatives focused on Azure and Databricks. The ideal candidate will have strong experience building scalable data pipelines, processing large datasets, and supporting AI/LLM integrations. This role requires an independent contributor who can work directly with business stakeholders and deliver high-quality data solutions with minimal ramp-up time.
Key Responsibilities
• Design, develop, and maintain scalable data pipelines using Azure and Databricks.
• Build and optimize data ingestion, transformation, and data modeling processes for large datasets.
• Support AI and data engineering initiatives, including integration with LLM-based solutions.
• Collaborate with business stakeholders to understand requirements and deliver data-driven solutions.
• Develop and optimize data workflows for performance, scalability, and reliability.
• Ensure data quality, governance, and security across enterprise data platforms.
• Troubleshoot and resolve data pipeline and platform issues.
• Document technical solutions, data models, and engineering processes.
• Work independently while collaborating with cross-functional business and technical teams.
Required Qualifications
• Strong hands-on experience with Azure and Azure Databricks.
• Experience with data engineering, data ingestion, ETL/ELT, and data modeling.
• Experience working with large-scale datasets and distributed data processing.
• Exposure to AI, Large Language Models (LLMs), or AI integration initiatives.
• Strong SQL and data transformation skills.
• Excellent analytical, problem-solving, and troubleshooting abilities.
• Strong communication skills with the ability to work directly with business stakeholders, including executive leadership.
• Ability to work independently with minimal supervision.
Preferred Qualifications
• Experience in the healthcare industry.
• Knowledge of 340B pharmacy programs or pharmacy data.
• Experience with full-stack development.
• Experience supporting AI-driven data platforms and analytics solutions.
• Strong consulting mindset with the ability to quickly adapt to new environments.
We are seeking a hands-on Data Engineer to support AI and data initiatives focused on Azure and Databricks. The ideal candidate will have strong experience building scalable data pipelines, processing large datasets, and supporting AI/LLM integrations. This role requires an independent contributor who can work directly with business stakeholders and deliver high-quality data solutions with minimal ramp-up time.
Key Responsibilities
• Design, develop, and maintain scalable data pipelines using Azure and Databricks.
• Build and optimize data ingestion, transformation, and data modeling processes for large datasets.
• Support AI and data engineering initiatives, including integration with LLM-based solutions.
• Collaborate with business stakeholders to understand requirements and deliver data-driven solutions.
• Develop and optimize data workflows for performance, scalability, and reliability.
• Ensure data quality, governance, and security across enterprise data platforms.
• Troubleshoot and resolve data pipeline and platform issues.
• Document technical solutions, data models, and engineering processes.
• Work independently while collaborating with cross-functional business and technical teams.
Required Qualifications
• Strong hands-on experience with Azure and Azure Databricks.
• Experience with data engineering, data ingestion, ETL/ELT, and data modeling.
• Experience working with large-scale datasets and distributed data processing.
• Exposure to AI, Large Language Models (LLMs), or AI integration initiatives.
• Strong SQL and data transformation skills.
• Excellent analytical, problem-solving, and troubleshooting abilities.
• Strong communication skills with the ability to work directly with business stakeholders, including executive leadership.
• Ability to work independently with minimal supervision.
Preferred Qualifications
• Experience in the healthcare industry.
• Knowledge of 340B pharmacy programs or pharmacy data.
• Experience with full-stack development.
• Experience supporting AI-driven data platforms and analytics solutions.
• Strong consulting mindset with the ability to quickly adapt to new environments.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Chicago, IL vacancy
$106.5k - $182.6k
...build-up and operationalization of an enterprise-class modern data environment, which may include various components within the Azure... ...existing data pipelines on-prem, cloud and business engineering extractProvide technical support to meet application service level...SuggestedFull timeTemporary workPart time$180k - $200k
...harborcapital.com/careers, search for this position and click on "Apply" to start your application!Role DescriptionWe are seeking a Lead Data Engineer to drive the design, architecture, and delivery of scalable data platforms, AI-powered data products, and enterprise-grade data...SuggestedFull timeWork at office$150k - $200k
...expectations, integrity, innovation and a willingness to challenge consensus.About the TeamThe DRW Cumberland & FICC Options Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work...SuggestedTemporary workFlexible hours$140k - $150k
...Based in Chicago with advisors across the U.S., we operate as a registered investment advisor (RIA).Your Future Team The Associate, Data Engineer, reporting to the Managing Director, Software Engineering, builds and maintains the data pipelines and infrastructure that power...SuggestedPermanent employmentWork at officeLocal areaWork from homeMonday to Thursday$150k - $200k
...Ethan HudsonEmail: ****@*****.***: (***) ***-****Data Engineer - Quantitative Trading SystemsLocation: Chicago, IL (Preferred)... ...New York, NYAbout the Opportunity We are seeking a high-caliber Data Engineer to join a premier global proprietary trading firm. This...SuggestedFlexible hours$100.79k - $160.26k
...DLA Piper is a place you can engage in meaningful work and grow your career. Let’s see what we can achieve. Together.SummaryThe Data Engineer, Solutions & Data role designs, builds, and operates data pipelines and data integration processes that translate raw data into...Full timeWork at officeRemote workRelocationVisa sponsorshipRelocation package$100.96k - $151.44k
Data Engineer - GE08AEWe’re determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals - and to help others accomplish theirs, too. Join our team...Full timeTemporary workWork at office3 days per week- ...we Advance Human Ability, together.Job Description SummaryJob DescriptionData Engineers for Chicago, IL location.Develop secure, stable, scalable long-term plans for the flow of hospital data.Assist in the development of scalable data infrastructure and platforms to collect...Full timeRemote work
$114.5k - $194.7k
...Key skills required for the role:Proven Ability to lead multiple Data Program execution.Expertise in designing data driven solution... ...and design, ontology and taxonomy design.Bachelor’s degree in Engineering, Economics, Business or Finance or equivalent experience.Intellectual...Full timeH1bWorldwideFlexible hours- ...maintain highly scalable, available, secure, and elastic cloud-ready data solutions using cutting-edge technologies to support our... ...information science or a related field preferred.3+ years in data engineering building production data pipelines (batch and/or streaming)...Relocation package
$90k - $200k
..., and government agencies, a list that spans across the country.Job DescriptionCapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients, with a specific focus on building and deploying scalable machine learning...Work at officeRemote workVisa sponsorshipWork visaFlexible hours- Job ID: 25659978Reference Number: 25-00597Title: Data Analyst EngineerPosted Date: 2025-06-06Company: HAN Staffing Position : Data Analyst Engineer Location : Jersey City, Wilmington, Chicago, Plano, Seattle, Palo Alto. Contract : w2 Job Description: Experience : 7+ Experience...Contract work
- ...on innovation and automation, IBKR provides clients with access to over 150 markets across 200+ countries and territories. We are a data-driven organization that leverages cutting-edge technology to deliver best-in-class trading solutions, and our teams thrive in a fast...Work at officeRemote work
$150k - $200k
...up. Our trading models and software systems are continually re-engineered, optimized, and maintained to stay on top of the industry. This... ...continued success. Belvedere Trading is looking for a proven Senior Data Engineer to work directly with our trading desks to improve...Full time- THE GLOBAL LEADER IN DATA & ANALYTICS RECRUITMENTHarnham Search and Selection Company Number: 05723485Harnham Search and Selection is a registered company in England and Wales. Reg no. 05723485Harnham Europe Limited Company Number: 09956940Harnham GmbH HRB: 196954Harnham...Work at office
- Reporting to the Director of Business Intelligence, you will influence and grow our Business Intelligence practice by developing data engineering pipelines and analytic solutions that support our Advanced Analytics and Data Science teams. You will partner with...Full timeWork at officeLocal areaFlexible hours
$120k - $160k
...opportunities to learn from peers in person, while also providing the flexibility needed for a meaningful work-life balance.Being a Senior Data Engineer at iManage Means…You get excited about data, and you believe in the democratization of data to support data-driven decision...Work at officeLocal areaWorldwideFlexible hours2 days per week$137.4k - $161.7k
Are you ready to make an impact?West Monroe is seeking a Senior Data Engineer to join our Data & AI practice. In this role, you will design, build, and optimize modern cloud data platforms that enable advanced analytics, AI, and business intelligence. Working with technologies...Local areaImmediate startFlexible hours$140k - $180k
...our team as we help shape a brighter way forward. About JLL and Data EngineeringJLL is a leading professional services firm that... ...tomorrow for our clients, our people, and our communities.The Data Engineering team at JLL sits at the intersection of technology and business...Full timeLocal areaShift work$100k - $150k
...retail-focused trading platform in the world. What you'll do:Your data-driven mindset and ability to work with large-scale data systems... ...opportunities, and improve processes. As an accomplished data engineer joining the Data & Analytics team, this is a terrific opportunity...Work at officeRemote workWorldwideMonday to FridayFlexible hours- We are seeking a hands-on Senior Data Engineer to support Phase 0 data discovery, profiling, mapping, and engineering handoff activities for a large-scale customer data and marketing transformation initiative. This role will work closely with Data Strategists, Solution...Hourly payFreelance
$120k - $130k
...leadership team at a time. Additional information on the firm can be found at .The RoleWe are seeking a highly skilled, hands‑on Senior Data Engineer with 4-5 years of experience to help shape and scale our data foundation in support of Heidrick & Struggles’ mission to...Full timeWork experience placement$95k - $150k
...you an experienced, passionate pioneer in technology who wants to work in a collaborative environment? As an experienced Senior Data Engineer you will have the ability to share new ideas and collaborate on projects as a consultant without the extensive demands of travel...Permanent employment$112.71k - $183.14k
...with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.As a Senior Data Engineer on the Helios Data Engineering team, you will be responsible for developing Python data pipelines that build business data...Full timePart timeFlexible hours$200k - $250k
...United StatesIndustry: Trading FirmPosted: 2026-07-28Contact: Ethan HudsonEmail: ****@*****.***: (***) ***-****Senior Data Engineer - Core Data PlatformLocation: Chicago, IL or New York, NY (Hybrid)About the OpportunityAre you ready to architect high-...Temporary workFlexible hours- ...and Business consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: Sr. Data Engineer Location(s): Chicago, IL (Hybrid) Key Skills: AWS (EMR, DynamoDB, S3, Lambda), Python, PySpark, Databricks, SQL Overview: We...Local areaRemote work
$98k - $182k
...audience activation business. We are a small, high-impact team of engineers operating at massive scale—trillions of user events flow... ...Connected TV publishers (LG, Samsung), your work directly connects our data ecosystem to the biggest platforms in the world. Who does...Temporary workFreelanceLocal areaFlexible hoursPublicis Groupe
Chicago, IL3 days ago$179.4k - $204.7k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers...Full timePart timeInternshipH1bLocal areaCapital One Financial Corp
Chicago, IL5 days ago- ...Job Title Must have skill: Snowflake SQL, Data warehouse, Python, AWS-Lambda, ETL/ELT Job Description: Required Skills: 6-8 years+ experience on: Snowflake SQL – advanced SQL expertise Data warehouse experiences – hands on knowledge with the methods to identify...
Omni Inclusive
Chicago, IL2 days ago - ...Lead Data Engineer Firm Overview Hinshaw & Culbertson LLP is a national law firm with more than 500 attorneys and professionals across the United States. Founded in 1934 and headquartered in Chicago, the firm provides sophisticated legal counsel to clients in highly...Casual workRemote work
Hinshaw & Culbertson
Chicago, IL4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- data platform engineer Chicago, IL
- aws data engineer Chicago, IL
- azure data engineer Chicago, IL
- data engineer graduate Chicago, IL
- big data devops engineer Chicago, IL
- big data developer Chicago, IL
- software data engineer Chicago, IL
- data center engineer Chicago, IL
- big data cloud engineer Chicago, IL
- director data engineering Chicago, IL