Data Engineer

Javen Technologies

Job Title: Data Engineer - (Databricks/ Spark/ Delta Lake)
Location: Chicago, IL (onsite - Only Locals Required)
Duration: 6 Months contract+

Job Description:
Key Responsibilities:
Data Engineering & Pipeline Development

Design, develop, and maintain end-to-end data pipelines in Databricks using Spark and Delta Lake
Build and optimize ELT/ETL processes for structured and unstructured data ingestion into the Data Lakehouse
Implement scalable ingestion patterns (batch and event-driven) from internal systems, third-party APIs, and cloud sources
Develop data models (bronze, silver, gold layers) to support enterprise reporting, analytics, and downstream consumption

Data Platform & Integration

Integrate the Data Lakehouse with enterprise tools such as Tableau, Alteryx, and machine learning platforms
Design and implement data access controls, identity management, and secure data sharing mechanisms
Support API-based integrations and downstream data consumption patterns

Data Quality, Governance & Controls

Implement data quality checks, reconciliation processes, and monitoring within Databricks pipelines

Ensure adherence to enterprise data governance standards, including lineage, metadata, and audit requirements
Support regulatory and compliance requirements (e.g., data integrity, privacy, and security controls)

Cloud & Automation

Develop and manage workflows using orchestration tools (e.g., Airflow, Control-M)
Automate data pipelines, deployments, and operational processes through CI/CD pipelines
Leverage cloud-native services (AWS/Azure) for data processing, storage, and event-driven architectures
Operations & Support Monitor, troubleshoot, and optimize data pipelines and Spark workloads for performance and reliability
Support production data platforms, including incident resolution and root cause analysis
Ensure high availability, data integrity, and SLA adherence across enterprise data systems

Collaboration

Partner with data architects, data scientists, BI teams, and business stakeholders to deliver data solutions

Participate in Agile ceremonies and contribute to iterative delivery of data products
Translate business requirements into scalable technical data solutions

Required Qualifications:

3+ years of experience in data engineering, data platforms, or related roles
Hands-on experience with Databricks, Apache Spark (PySpark), and Delta Lake
Strong SQL and data modeling skills (relational and dimensional)
Experience building and supporting data pipelines in a cloud environment ( AWS or Azure )
Experience with ELT/ETL tools (e.g., Fivetran, custom ingestion frameworks)
Familiarity with data orchestration tools (Airflow, Control-M)
Experience working in Agile development environments

Preferred Qualifications:

Experience in financial services or regulated environments (e.g., banking, risk, regulatory reporting)
Knowledge of data governance frameworks and tools (e.g., Collibra)
Experience with real-time or streaming data pipelines
Exposure to machine learning pipelines and feature engineering in Databricks
Cloud certifications (AWS, Azure, or Databricks)

Technical Skills:

Databricks (Lakehouse architecture, notebooks, jobs, Unity Catalog)
Spark / PySpark
SQL (advanced querying and optimization)

Apply

Vacancy posted 4 days ago

Similar jobs that could be interesting for youBased on the Data Engineer in Chicago, IL vacancy

Data Engineer
$114.75k - $135k
Job Title Data Engineer Job Description Summary Key Objectives: Supports the development, optimization, and maintenance of Cushman & Wakefield’s commercial real estate (CRE) forecasting infrastructure across the Americas. This role is focused on engineering...
Suggested
Minimum wage
Full time
Flexible hours
Cushman & Wakefield
Chicago, IL
3 days ago
Data Engineer
$105k - $126k
...substantially, in part due to our industry leading success in mergers and acquisitions. Position Summary We are looking for a Data Engineer - Enterprise Data & Analytics to join our DnA Infrastructure team. In this role, you will build data pipelines and infrastructure...
Suggested
Full time
Local area
Shift work
HUB International
Chicago, IL
14 hours ago
Senior Data Engineer
$10k
...innovation. To learn more about fairlife and its complete line of products, please visit fairlife.com. job purpose: The Sr. Data Engineer will play a key role in delivering fairlife's ambition of building a best-in-class Decision Intelligence (DI) ecosystem. This role...
Suggested
Full time
Temporary work
Local area
fairlife
Chicago, IL
3 days ago
Manager, Data Engineering
$55.18k - $156.7k
...shaping the future of entertainment, your next big move starts here - Key Responsibilities • Lead, coach, and develop a team of data engineers, establishing clear expectations for delivery, technical quality, documentation, and production support.• Own the planning and...
Suggested
Full time
Worldwide
IGT, a Nevada Corporation
Chicago, IL
1 day ago
Lead Data Engineer
Geneva Trading in Chicago, IL is seeking a Data Engineering Manager to own market data platforms and analytical data systems. You will manage a small team, write production code, review designs, debug systems, and stay close to technical details. The role emphasizes reliable...
Suggested
Geneva Trading
Chicago, IL
4 hours ago
Lead Data Engineer
...Lead Data Engineer This role is responsible for providing technical leadership and execution expertise to design and deliver end-to-end data engineering solutions to support new product development and advanced analytics capabilities and drive innovation and decision...
1872 Consulting
Oak Brook, IL
2 days ago
Lead Data Engineer
$98k - $182k
...audience activation business. We are a small, high-impact team of engineers operating at massive scale-trillions of user events flow... ...Connected TV publishers (LG, Samsung), your work directly connects our data ecosystem to the biggest platforms in the world. Who does...
Temporary work
Freelance
Local area
Flexible hours
Publicis Groupe Holdings B.V
Chicago, IL
4 days ago
Lead Data Engineer
$145k - $165k
Avison Young - USA is seeking a Lead of Analytics Engineering based in Chicago, Illinois. In this role, you will lead strategies and execution for proprietary data products that aid commercial real estate decision-makers. The ideal candidate is experienced in commercial...
Avison Young
Chicago, IL
4 hours ago
Lead Data Engineer
$200k
...Optiver Chicago is seeking a seasoned Data Engineer to support and advance the data capabilities of our local research team and contribute to our broader Lakehouse architecture vision. In this role, you'll work with cutting-edge tools like Databricks, Apache Spark, and...
Work at office
Local area
Immediate start
Optiver
Chicago, IL
3 hours ago
Lead Data Engineer
$106.5k - $182.6k
...Lead Data Engineer Provides continuous build-up and operationalization of an enterprise-class modern data environment, which may include various components within the Azure, Hadoop, SQL server, and Informatic stack. Works with technologies encompassed within the cloud...
Full time
Temporary work
Part time
Work from home
3 days per week
Alliant
Chicago, IL
2 days ago
Lead Data Engineer
...About the Role At IT Labs, we are looking for an experienced Lead Data Engineer to support one of the most innovative companies in the digital health space. Our client is transforming healthcare through a technology-driven platform that connects employers and...
Full time
Contract work
Remote work
IT Labs
Chicago, IL
4 days ago
Lead Data Engineer
UNAVAILABLE is seeking an experienced engineer to build and maintain data pipelines using Spark and SQL. This role focuses on high-volume data environments and offers the opportunity to work with state-of-the-art technologies like AWS and Databricks. Ideal candidates will...
Unavailable
Chicago, IL
4 hours ago
Lead Data Engineer
...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE (Preferred Location; Hybrid Role; Needs to work 3 days from Office in a week) Job Type: Long Term Contract Responsibilities: Lead the design...
Long term contract
Work at office
InterSources
Chicago, IL
4 days ago
Lead Data Engineer
...will design and ship agentic pipelines, remember and reason over data, and integrate tools across multi-step tasks. You will build... ...stores, and scale deployments in production. Collaboration with AI engineers, ML scientists, and product managers is essential. #J-18808-...
Lenovo
Chicago, IL
4 hours ago
Pricing Data Engineer
$110k - $169k
...rewards for real work: We offer generous compensation packages that recognize hard work and excellence. Job Description The Pricing Data Engineer builds and maintains the data infrastructure and tools that enable consistent, data-driven pricing across the firm while...
Work at office
McDermott Will & Schulte
Chicago, IL
1 day ago
Data Engineer
$111k - $209k
...Job Summary We are seeking an experienced Data Engineer with a strong focus on Microsoft Fabric to design, implement, and maintain enterprise data solutions. The ideal candidate will have a minimum of 2 years hands‑on experience implementing Microsoft Fabric, including...
Temporary work
Work experience placement
Local area
Remote work
Relocation
Flexible hours
K&L Gates LLP
Chicago, IL
4 days ago
Snowflake Data Engineer
...Role: Snowflake Data Engineer Location: Chicago, IL (Local Prefers) Contract Experience Level 8+ years in Data Engineering, with a proven track record of leading large-scale data modernization or consolidation projects. Deep experience...
Contract work
Local area
AceStack LLC
Chicago, IL
4 days ago
Data Engineer
...maintain highly scalable, available, secure, and elastic cloud-ready data solutions using cutting-edge technologies to support our... ...information science or a related field preferred. 3+ years in data engineering building production data pipelines (batch and/or streaming)...
Relocation package
HAVI Logistics Business Services GmbH
Chicago, IL
3 days ago
Data Engineer
$120k - $150k
...Entertainment, Manufacturing and Retail & CPG, modernize their data and put AI to work, not in a deck, but in production. We move fast... ...the full data and AI lifecycle: Data Strategy & Advisory, Data Engineering, Analytics & Visualization, Generative AI & ML, and Cloud...
Local area
Remote work
Lovelytics
Chicago, IL
4 hours ago
Data Engineer
$104k
...your talent to a team shaping the future of entertainment, your next big move starts here - . About the Role We are seeking a Data Engineer II to join our Global Data Platform & Engineering team. In this role, you will help build and maintain scalable, cloud‑native data...
Worldwide
International Game Technology
Chicago, IL
4 hours ago
Data Engineer
...We are seeking a talented Data Engineer with strong communication skills, passion for solving business problems with data and has domain knowledge in Finance, Human Resources, and Customer Success. You have empathy, curiosity and desire to improve and constantly learn....
Local area
Cornerstone OnDemand
Chicago, IL
1 day ago
Data Engineer
...Data Engineer – Databricks Integration Onshore Location: Chicago, IL Type: Hybrid About the Role We are seeking a highly skilled Data Engineer to design, develop, and maintain data pipelines that extract data from Oracle Symphony via APIs, process and store...
JConnect Infotech
Chicago, IL
4 days ago
Data Engineer II
...transformational journey to unlock the full potential of enterprise data, build a dynamic, diverse, and inclusive culture and develop a... ...Bachelor's degree in quantitative field (statistics, software engineering, business analytics, information systems, aviation management...
Temporary work
Flexible hours
Samprasoft
Chicago, IL
3 hours ago
Data Engineer
Mayer Brown in Chicago is seeking an Engineer: Financial Services to support and develop the Finance and Accounting data analytics, dashboards, and reporting needs. The incumbent will move and transform data so it can be easily analyzed, visualized and used by business...
Unavailable
Chicago, IL
5 hours ago
Data Engineer
...team always seeking like-minded talent to join us in our fight to disrupt consumer finance. Job Summary We are looking for a Data Engineer to join a team of analytics and machine learning experts. The hire will be responsible for building tooling to support analytics...
Work at office
Immediate start
Remote work
Flexible hours
NinjaHoldings
Chicago, IL
4 hours ago
Data Engineers
...achieve better, faster outcomes - as we Advance Human Ability, together. Job Description Summary Job Description Data Engineers for Chicago, IL location. Develop secure, stable, scalable long-term plans for the flow of hospital data. Assist in the...
Remote work
Shirley Ryan AbilityLab
Chicago, IL
1 day ago
Data Engineer III
$138.21k - $172.76k
...McDonald's is creating smarter, more responsive digital and data systems that transform operations and elevate guest experiences.... ...integration of business and technology. McDonald's is hiring a Data Engineer III focused on Data Clean Room data ingestion, curation, and...
Local area
Flexible hours
McDonald's Corporation
Chicago, IL
3 hours ago
Data Engineer 3
...accelerate issue detection and correction. Transformation of data to enable machine learning and/or monitoring of anomalies.... ...serverless design in AWS Four years or more of experience in data engineering and/or software development. Three years or more of...
Samprasoft
Chicago, IL
3 hours ago
Data Engineer
...and Business consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: Sr. Data Engineer Location(s): Chicago, IL ( Hybrid) Key Skills: AWS (EMR, DynamoDB, S3, Lambda), Python, PySpark, Databricks, SQL Overview...
Local area
Remote work
Ampcus
Chicago, IL
4 hours ago
Data Engineer
...No visa restrictions Job Title: Data Engineer Location : Chicago, IL Primary Skills: Business Intelligence, Azure, C#, Data Warehouse, Python, SQL, Java Location: 100% Remote Overview: Companyy (IT) vision and strategy...
Temporary work
Remote work
Flexible hours
3B Staffing LLC
Chicago, IL
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!