Data Engineer
Javen Technologies
Job Title: Data Engineer - (Databricks/ Spark/ Delta Lake)
Location: Chicago, IL (onsite - Only Locals Required)
Duration: 6 Months contract+ Job Description:
Key Responsibilities:
Data Engineering & Pipeline Development
Required Qualifications:
Preferred Qualifications:
Technical Skills:
Location: Chicago, IL (onsite - Only Locals Required)
Duration: 6 Months contract+ Job Description:
Key Responsibilities:
Data Engineering & Pipeline Development
- Design, develop, and maintain end-to-end data pipelines in Databricks using Spark and Delta Lake
- Build and optimize ELT/ETL processes for structured and unstructured data ingestion into the Data Lakehouse
- Implement scalable ingestion patterns (batch and event-driven) from internal systems, third-party APIs, and cloud sources
- Develop data models (bronze, silver, gold layers) to support enterprise reporting, analytics, and downstream consumption
- Integrate the Data Lakehouse with enterprise tools such as Tableau, Alteryx, and machine learning platforms
- Design and implement data access controls, identity management, and secure data sharing mechanisms
- Support API-based integrations and downstream data consumption patterns
- Implement data quality checks, reconciliation processes, and monitoring within Databricks pipelines
- Ensure adherence to enterprise data governance standards, including lineage, metadata, and audit requirements
- Support regulatory and compliance requirements (e.g., data integrity, privacy, and security controls)
- Develop and manage workflows using orchestration tools (e.g., Airflow, Control-M)
- Automate data pipelines, deployments, and operational processes through CI/CD pipelines
- Leverage cloud-native services (AWS/Azure) for data processing, storage, and event-driven architectures
- Operations & Support Monitor, troubleshoot, and optimize data pipelines and Spark workloads for performance and reliability
- Support production data platforms, including incident resolution and root cause analysis
- Ensure high availability, data integrity, and SLA adherence across enterprise data systems
- Partner with data architects, data scientists, BI teams, and business stakeholders to deliver data solutions
- Participate in Agile ceremonies and contribute to iterative delivery of data products
- Translate business requirements into scalable technical data solutions
Required Qualifications:
- 3+ years of experience in data engineering, data platforms, or related roles
- Hands-on experience with Databricks, Apache Spark (PySpark), and Delta Lake
- Strong SQL and data modeling skills (relational and dimensional)
- Experience building and supporting data pipelines in a cloud environment ( AWS or Azure )
- Experience with ELT/ETL tools (e.g., Fivetran, custom ingestion frameworks)
- Familiarity with data orchestration tools (Airflow, Control-M)
- Experience working in Agile development environments
Preferred Qualifications:
- Experience in financial services or regulated environments (e.g., banking, risk, regulatory reporting)
- Knowledge of data governance frameworks and tools (e.g., Collibra)
- Experience with real-time or streaming data pipelines
- Exposure to machine learning pipelines and feature engineering in Databricks
- Cloud certifications (AWS, Azure, or Databricks)
Technical Skills:
- Databricks (Lakehouse architecture, notebooks, jobs, Unity Catalog)
- Spark / PySpark
- SQL (advanced querying and optimization)
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Chicago, IL vacancy
$106.5k - $182.6k
...build-up and operationalization of an enterprise-class modern data environment, which may include various components within the Azure... ...existing data pipelines on-prem, cloud and business engineering extractProvide technical support to meet application service level...SuggestedFull timeTemporary workPart time$117.2k - $175.8k
Sr Data Engineer - GE07BEWe’re determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals - and to help others accomplish theirs, too. Join our...SuggestedFull timeTemporary workWork at office3 days per week- ...TechnologyExperience Level: Experience ProfessionalsContact: Paul KrugJob ID: REQ8505Role OverviewWe are seeking a hands-on Senior / Lead Data Engineer to provide technical leadership for the platforms, pipelines, and data products that power analytics, applications, and...Suggested
$180k - $200k
...harborcapital.com/careers, search for this position and click on "Apply" to start your application!Role DescriptionWe are seeking a Lead Data Engineer to drive the design, architecture, and delivery of scalable data platforms, AI-powered data products, and enterprise-grade data...SuggestedFull timeWork at office$150k - $200k
...expectations, integrity, innovation and a willingness to challenge consensus.About the TeamThe DRW Cumberland & FICC Options Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work...SuggestedTemporary workFlexible hours$89k - $148k
Job Family:Data Science & AnalysisTravel Required:Up to 10%Clearance Required:Ability to Obtain Public TrustWhat You Will Do:Guidehouse seeks a Data Engineer with some AI experience to support in building, optimizing, and maintaining data pipelines, AI solutions, and analytics...Full timeFlexible hours$125k - $140k
...Chicago with advisors across the U.S., we operate as a registered investment advisor (RIA).Your Future Team The Senior Associate, Data Engineer, reporting to the Managing Director, Software Engineering, builds and maintains the data pipelines and infrastructure that power...Permanent employmentWork at officeLocal areaWork from homeMonday to Thursday- ...maintain highly scalable, available, secure, and elastic cloud-ready data solutions using cutting-edge technologies to support our... ...information science or a related field preferred.3+ years in data engineering building production data pipelines (batch and/or streaming)...Relocation package
$114.5k - $194.7k
...Key skills required for the role:Proven Ability to lead multiple Data Program execution.Expertise in designing data driven solution... ...and design, ontology and taxonomy design.Bachelor’s degree in Engineering, Economics, Business or Finance or equivalent experience.Intellectual...Full timeH1bWorldwideFlexible hours- ...we Advance Human Ability, together.Job Description SummaryJob DescriptionData Engineers for Chicago, IL location.Develop secure, stable, scalable long-term plans for the flow of hospital data.Assist in the development of scalable data infrastructure and platforms to collect...Full timeRemote work
$150k - $200k
...Ethan HudsonEmail: ****@*****.***: (***) ***-****Data Engineer - Quantitative Trading SystemsLocation: Chicago, IL (Preferred)... ...New York, NYAbout the Opportunity We are seeking a high-caliber Data Engineer to join a premier global proprietary trading firm. This...Flexible hours$100.79k - $160.26k
...DLA Piper is a place you can engage in meaningful work and grow your career. Let’s see what we can achieve. Together.SummaryThe Data Engineer, Solutions & Data role designs, builds, and operates data pipelines and data integration processes that translate raw data into...Full timeWork at officeRemote workRelocationVisa sponsorshipRelocation package- Work Flexibility: RemoteAs a Senior Lead, Data Engineering, you will serve as a technical leader who helps shape the future of enterprise data solutions. In this role, you will drive complex data initiatives, influence technical strategy, and partner with teams across...Full timeFor contractorsRemote work
$90k - $200k
..., and government agencies, a list that spans across the country.Job DescriptionCapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients, with a specific focus on building and deploying scalable machine learning...Work at officeRemote workVisa sponsorshipWork visaFlexible hours- Job ID: 25659978Reference Number: 25-00597Title: Data Analyst EngineerPosted Date: 2025-06-06Company: HAN Staffing Position : Data Analyst Engineer Location : Jersey City, Wilmington, Chicago, Plano, Seattle, Palo Alto. Contract : w2 Job Description: Experience : 7+ Experience...Contract work
$98k - $182k
...audience activation business. We are a small, high-impact team of engineers operating at massive scale—trillions of user events flow... ...Connected TV publishers (LG, Samsung), your work directly connects our data ecosystem to the biggest platforms in the world.Who Does This...Temporary workFreelanceLocal areaFlexible hoursStarcom Mediavest Group Germany Gmbh
Chicago, IL16 hours ago- ...Job #: 406 Pay Rate: Not Specified Job type: contractor Location: Chicago, IL Must have skill: Snowflake SQL, Data warehouse, Python, AWS-Lambda, ETL/ELT Job Description: Responsibilities: Lead data warehouse development activities for a team, leading more than one project...For contractors
TechDigital Group
Chicago, IL4 days ago - ...Lead Data EngineerHybrid At least 2 days per week in office in Chicago, ILOur client seeks a Lead Data Engineer to design, build, and optimize large-scale data processing for attribution, measurement, forecasting, and privacy-preserving analytics. The role requires leadership...Work at office2 days per week
Eliassen Group
Chicago, IL2 days ago - ...Lead Data Engineer Roel: Lead Data Engineer Location: Chicago IL, Locals only. Duration: Longterm Contract Interview Type: Video and Final interview is in-person interview. Snowflake/Snowpipe, SQL, Python/PySpark Data Modeling, Data Engineering with Modeling...Contract workLocal area
E-Solutions
Chicago, IL5 days ago $98k - $182k
...The Epsilon Activation Delivery Platform team seeks a senior engineer to build and maintain high-scale data pipelines and integrations with major advertising and CTV platforms. The role reports to the Engineering Director and collaborates with data engineers, product...Full timeFlexible hoursEpsilon
Chicago, IL1 day ago$150k - $187k
Chicago, ILDevelopment - Engineering /Full-time /HybridWho We AreArrive Logistics is a leading transportation and technology company in North... ..., casual, and collaborative environment.Who We WantAs a Senior Data Engineer at Arrive Logistics, you will build and own the data...Full timeWork experience placementCasual workWork at officeLocal areaRelocationRelocation package- THE GLOBAL LEADER IN DATA & ANALYTICS RECRUITMENTHarnham Search and Selection Company Number: 05723485Harnham Search and Selection is a registered company in England and Wales. Reg no. 05723485Harnham Europe Limited Company Number: 09956940Harnham GmbH HRB: 196954Harnham...Work at office
$150k - $200k
...up. Our trading models and software systems are continually re-engineered, optimized, and maintained to stay on top of the industry. This... ...continued success. Belvedere Trading is looking for a proven Senior Data Engineer to work directly with our trading desks to improve...Full time$179.4k - $204.7k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers...Full timePart timeInternshipH1bLocal areaCapital One
Chicago, IL2 days ago- ...Lead Data EngineerRoel: Lead Data Engineer Location: Chicago IL, Locals only. Duration: Longterm Contract Interview Type: Video and Final interview is in-person interview.Snowflake/Snowpipe, SQL, Python/PySparkData Modeling, Data Engineering with Modeling Techniques -...Contract workLocal area
E-Solutions
Chicago, IL16 hours ago $179.4k - $204.7k
...Lead Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a... ...real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies...Full timePart timeInternshipLocal areaCapital One
Chicago, IL4 days ago$111.8k - $160k
...Lead Data EngineerBuild the Future of Data at GATXRemote (Chicago-area preferred)Founded in 1898 and headquartered in Chicago, IL, GATX... ...intelligence ecosystem. We are looking for a Lead Data Engineer who's ready to do more than just build pipelines on Databricks and...Temporary workWork at officeRemote workGATX
Chicago, IL5 days ago$137.4k - $161.7k
Are you ready to make an impact?West Monroe is seeking a Senior Data Engineer to join our Data & AI practice. In this role, you will design, build, and optimize modern cloud data platforms that enable advanced analytics, AI, and business intelligence. Working with technologies...Local areaImmediate startFlexible hours$140k - $180k
...our team as we help shape a brighter way forward. About JLL and Data EngineeringJLL is a leading professional services firm that... ...tomorrow for our clients, our people, and our communities.The Data Engineering team at JLL sits at the intersection of technology and business...Full timeLocal areaShift work$100k - $150k
...retail-focused trading platform in the world. What you'll do:Your data-driven mindset and ability to work with large-scale data systems... ...opportunities, and improve processes. As an accomplished data engineer joining the Data & Analytics team, this is a terrific opportunity...Work at officeRemote workWorldwideMonday to FridayFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- data center engineer Chicago, IL
- senior cloud data engineer Chicago, IL
- data infrastructure engineer Chicago, IL
- sr information security engineer Chicago, IL
- hadoop big data developer Chicago, IL
- data visualization developer Chicago, IL
- remote data engineer Chicago, IL
- etl data engineer Chicago, IL
- data engineer analytics Chicago, IL
- sr data engineer Chicago, IL