Senior Data Engineer: Azure Data Pipelines & PySpark Expert
$100k - $120kTata Consultancy Services
Tata Consultancy Services is seeking a skilled developer in Chicago, Illinois to design and build end-to-end data pipelines. Candidates should have a Bachelor's degree in Computer Science and expertise in SQL, PySpark, and Azure Data Factory. The role involves optimizing SQL and Python code, working in Azure environments, and ensuring production- grade quality. This full-time position offers a competitive salary ranging from $100,000 to $120,000 per year, along with comprehensive medical coverage and various employee benefits. #J-18808-Ljbffr Tata Consultancy Services
- Digitive LLC is seeking a Sr. Data Engineer specializing in Microsoft Fabric and Azure to work on advanced data solutions. This role involves designing data platforms and implementing CI/CD pipelines, with a focus on performance optimization. The ideal candidate will have...PipelineSeniorWork at office2 days per week
$70k - $105k
UST is seeking a Senior Data Engineer to design and optimize scalable data pipelines and platforms. This role requires strong expertise in Python, PySpark, and AWS, with responsibilities that include developing ETL/ELT pipelines and ensuring data quality. The compensation...Pipeline$120k - $170k
...work‑life balance. Being a Senior NLP Data Engineer at iManage You’re passionate... ...processing, building the pipelines and datasets that fuel generative... ...pipelines in Microsoft Azure to ingest and transform... ...Strong proficiency in Python, PySpark, and data manipulation for...PipelineSeniorWork at officeLocal areaFlexible hours- 84.51 in Chicago is seeking a Senior Data Engineer to build solutions for big data that will be utilized by data scientists and various products. You will work with tools like PySpark, Databricks, and Hadoop to deliver vital data capabilities. Key responsibilities include...PipelineSenior
- Conagra Brands in Chicago is seeking a Data Engineer responsible for developing data engineering pipelines and analytic solutions. You will work closely with stakeholders... ...Degree and have extensive experience with SQL, PySpark, and Snowflake. Comprehensive health plans,...PipelineSeniorFlexible hours
$100k - $120k
...Technical/Functional Skills • ETL/ELT concepts (pipelines, incremental loads, validation) • Advanced SQL... ...tuning) • Python (modular code, testing, CI/CD) • PySpark (distributed processing, optimization) • Azure Data Factory (pipelines, triggers, monitoring) •...PipelineSenior- Senior Data Engineer Chicago, IL (Hybrid - 3 days onsite) I'm working on a really strong opportunity... ...the buildout and optimization of data pipelines and models that directly influence... ...experience, ideally with Informatica Python or PySpark for data processing Background...PipelineSenior
$99k - $164.8k
A leading insurance provider is seeking a Senior Data Engineer to guide the design and delivery of enterprise data platforms. This role involves... ...and mentoring, along with designing scalable data pipelines using Snowflake, AWS, and modern data engineering frameworks...PipelineSenior- ...skilled and detail‑oriented Data Engineer to join our growing... ...scalable data pipelines and infrastructure to... ...stakeholders, and/or domain experts to translate business... ...languages such as Python, PySpark, SQL, etc. Experience... ..., Snowflake, Airflow, Azure Data Factory, Glue,...PipelineSeniorContract work
- ...Job Title: Sr. Data Engineer — MS Fabric, Azure Location: Hybrid (Chicago Office 2 days a week) Experience Required: 15 Years Contract... ...Gen2 Develop and optimize Spark workloads using PySpark and SparkSQL Develop MLOps pipelines for Advanced Analytics & AI Build scalable ETL/...PipelineSeniorContract workFor subcontractorWork at office2 days per week
- Motion Recruitment Partners LLC is looking for a Data Engineer to join their fast-growing Data & AI engineering team in Chicago. The role focuses on building data pipelines using Azure Databricks, Python, SQL, and Spark, offering an opportunity for hands-on engineering...PipelineSenior
$82k - $120k
...Business Intelligence practice by developing data engineering pipelines and analytic solutions that support... ...pipelines using Databricks(SQL and pyspark) and Snowflake ~3+ years of... ...Experience with components of Microsoft Azure like ADLS, Azure Key Vault and Azure Dev...PipelineSeniorWork at officeLocal areaFlexible hours$70k - $105k
...Senior Data Engineer (Lead I - Data Engineering) UST is searching for a highly skilled Senior Data Engineer with strong expertise in Python, PySpark, and AWS to design, build, and optimize scalable data pipelines and modern data platforms. The candidate will be responsible...PipelineSeniorFull timeTemporary workPart timeLocal areaFlexible hours$160k - $220k
...to help us create it. Who you are As a Senior Data Engineer at Metropolis, you will play a key... ...functional teams to develop end‑to‑end data pipelines and foundational data sets Design and... ...Experience with Spark and PySpark Master’s degree in Computer Science, Computer...PipelineSeniorTemporary workWork at officeLocal areaAfternoon shift$120k - $170k
...meaningful work‑life balance. As a Senior Data Engineer on the Applied Data team,... ...the data platform and pipelines that support AI/ML solutions... ...pipelines on Databricks & Microsoft Azure to ingest and transform... ...proficiency in Python, PySpark, and Spark SQL for large‑scale...PipelineSeniorWork at officeLocal areaFlexible hours- CCC Information Services seeks a Senior Data Engineer to develop large-scale data pipeline applications. The role is remote but requires local presence in Chicago... ...content quality using advanced tools like Python, PySpark, and Hadoop. Applicants must hold a Master's degree...PipelineSeniorRemote jobLocal area
$135.04k - $202.56k
...Sr Staff Data Engineer - GE07DE We're determined... ...future. As a Senior Staff Data Engineer... ...Underwriting data pipelines and opportunities... ...solutions Provide expert documentation and... ...Technologies (AWS/AZURE), Python/Spark,... ...familiar with ETL using Pyspark/Python/snowflake...PipelineSeniorTemporary workWork at office3 days per week- Position Summary Senior Trainer - Data Engineering - Capable of delivering advanced training... ...with Airflow and CI/CD pipelines for data workflows. Teach... ..., Apache Spark, and PySpark. Deep understanding of data... ...one major provider (AWS, Azure, or GCP) and its data services...PipelineSenior
$132k - $182k
...let's talk. The Global Data & Insights Team Okta's... ...by building reliable pipelines, scalable data platforms... ...movement, and the engineering foundations that make... ...trustworthy at scale. Senior Analytics Engineer, Enterprise... ...frameworks (e.g., PySpark) is a plus Experience...PipelineSeniorImmediate startWorldwideFlexible hours$175.5k - $180k
...and optimize modern data platforms that power... ...architect scalable pipelines, manage secure and compliant... ..., Machine Learning Engineers, Designers, and domain experts to deliver high‑... ...skills in SQL and PySpark Hands‑on experience... ...such as (AWS, GCP, Azure, Oracle) and modern...PipelineSeniorHourly payApprenticeshipWork at officeEasy work- ...Dagster-orchestrated ingestion pipelines for genomics vendors (Caris,... ...-Gold transformations: real-data test coverage, store-failures... ...transformation rules from legacy R and PySpark code and reconcile against... ...Collaborate with the lead engineer on design decisions and...PipelineSeniorFor contractorsWork at officeRemote work
$130k - $175k
...Design and implement large-scale data warehouses and data marts... ...maintain data transformation pipelines using SQL frameworks like dbt... ...within the data flow Partner with engineering, data science, and business... ...product-focused insights Expert at SQL, window functions, and...PipelineSeniorWork at officeLocal area$90k - $99k
...RAPP Chicago is looking for a Senior Data Engineer to join our award‑winning Technology team. WHO WE ARE: We are RAPP – world leaders in activating... ...deep expertise in building scalable, cloud‑native data pipelines and platforms. The ideal candidate is highly skilled in...PipelineSeniorWork from homeFlexible hours2 days per week- ...Overview Senior data engineers at Thoughtworks are engineers who build, maintain and test the software architecture and infrastructure for... ...data solutions. You will develop intricate data processing pipelines, addressing clients’ most challenging problems. You will collaborate...PipelineSenior
$155k - $235k
...expertise. About the Team The Data Platform team sits within... ...and ensuring data works for engineers, analysts, and business users... ...the Role We're looking for a Senior AI Data Engineer to lead the... ...interfaces they need to ship pipelines faster without deep expertise...PipelineSeniorHome officeFlexible hours- ...Senior Data Engineer Location - Chicago, IL (3 days onsite mandatory) Rate... ...and optimize scalable data pipelines and solutions leveraging Databricks... ...or related roles. ~ Expert-level Python programming for... ...Lake. ~ Strong knowledge of Azure Data Factory, Data Lake, and...PipelineSenior
$160k - $220k
A leading technology firm in Chicago seeks a Senior Data Engineer to develop and manage extensive data products aligned with their innovative vision. Responsibilities encompass designing data pipelines, ensuring data security and compliance, and collaborating with cross...PipelineSenior- Glocomms is seeking a Senior Data Engineer to join a high-impact marketing data team in Chicago, IL. This hands-on role involves building and optimizing data pipelines that drive marketing investment decisions and consumer insights. You will collaborate closely with analytics...PipelineSenior
- ...Senior Data Engineer – AI Systems Employment Type: Full-time Company: Permute ( Overview Permute is seeking a Senior Data Engineer to design... ...new data problems, prototype quickly, and build robust pipelines and infrastructure in a fast-moving startup environment. Responsibilities...PipelineSeniorFull time
$99k - $164.8k
...Summary: We are seeking a highly skilled Senior Data Engineer to guide the design, development, and... ...oversee the delivery of scalable data pipelines, ingestion frameworks, and... ...CI/CD (GitHub Actions, GitLab CI, Azure DevOps) Infrastructure-as-Code(Terraform...PipelineSeniorTemporary workFor contractorsCasual workWork at officeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer: Azure Data Pipelines & PySpark Expert. Be the first to apply!
- remote data engineer Chicago, IL
- data engineer intern Chicago, IL
- entry level big data engineer Chicago, IL
- big data devops engineer Chicago, IL
- entry level data engineer Chicago, IL
- data engineer Chicago, IL
- data engineer contract Chicago, IL
- software data engineer Chicago, IL
- big data cloud engineer Chicago, IL
- junior big data engineer Chicago, IL

