Data Engineer: Python Pipelines & GenAI on AWS
ROLE
Caterpillar Inc. is seeking a Data Engineer in Chicago, IL. The role involves developing Python data pipelines and managing projects across functional lines. Candidates should have software development experience, particularly in Python, and familiarity with CI/CD processes. Benefits include medical coverage, paid time off, a 401(k) savings plan, and employee discounts. This position requires attendance in Chicago or Peoria, IL. #J-18808-Ljbffr ROLE
- Caterpillar Brazil is seeking a Software Engineer to work in locations such as Chicago,... ...responsibilities will include developing Python data pipelines and overseeing CI/CD processes. The... ...OOP principles, Git version control, and AWS components. Attractive benefits including...Amazon Web ServicePipeline
- ...Blue Cross Blue Shield Association is looking for a Data Engineer to design and optimize data pipelines for machine learning and AI workloads. This role involves... ...in data engineering and expertise in tools like AWS and PySpark. The role offers a competitive salary and...Amazon Web ServicePipeline
- ...Shield in Chicago is seeking a Data Engineer with expertise in building and optimizing scalable data pipelines focused on Machine Learning and... ...data engineering, proficiency in Python and SQL, and familiarity with cloud-based tools like AWS and Databricks. The position...Amazon Web ServicePipeline
- Uturn Data Solutions is seeking a passionate individual for data engineering and AI/ML roles in Chicago. You will collaborate with teams to implement data pipelines and deliver enterprise-level ML solutions, while... ...maintaining awareness of AWS technologies. The ideal...Amazon Web ServicePipelineFlexible hours
- ...Shield Association is hiring a Data Engineer in Chicago, Illinois. The role... ...and maintaining data pipelines for healthcare data, utilizing tools such as PySpark, AWS Glue, and Snowflake. The ideal... ...engineering and proficiency in Python and SQL. This position offers...Amazon Web ServicePipeline
- UTurn Data Solutions is a leading technology services firm in Chicago. We are looking for experienced professionals... ...challenges. In this role, you'll design data pipelines, collaborate on AWS solutions, and mentor junior engineers. Qualified candidates should have extensive...Amazon Web ServicePipelineFlexible hours
$165k - $175k
...Data Engineer Boston, Massachusetts, United States Job Openings... ...ingestion and processing pipelines to support AI and GenAI applications Develop and maintain high-quality Python-based data workflows, including... ...multi-cloud environments (AWS primarily; exposure to...Amazon Web ServicePipeline- ...reliable, high-performance data pipelines for large-scale... ...based tools (Databricks, AWS Glue, EMR, Snowflake)... ...business needs into scalable engineering solutions. Collaborate... ...). Familiarity with GenAI skills and adjacent... .... Proficiency in Python, SQL, and distributed...Amazon Web ServicePipeline
- ...Azure openAI service and AWS cloud to support... ...infrastructure for CI/CD pipeline efficiency. - Diagnose... ...strategic guidance on GenAI solution architecture... ...- Proficiency in data platforms for scalable... ...on experience with Data Engineering, analytics, and AWS Cloud...Amazon Web ServicePipeline
- ...UTurn Data Solutions is a technology services firm helping... ...in leveraging the power of AWS to accelerate innovation, increase... ..., customers, and senior engineers to implement data pipelines, platforms, lakes,... ...Deliver enterprise-level ML and GenAI solutions via IaC and CI/CD...Amazon Web ServicePipelineHome officeFlexible hours
$81.4k - $151.8k
...Our team combines engineering excellence with cutting... ...model, powered by data and AI‑driven... ...ingestion and integration pipelines for structured,... ...services using Python and REST APIs to... ...to support ML and GenAI use cases, including... ...services ( AWS S3, Azure Blob), API...Amazon Web ServicePipelinePart timeWork at officeLocal area2 days per week$97.53k - $158.48k
...Technology, Digital and Data Job Description: Your... ...You Will Do As a Data Engineer, you will be responsible for developing Python data pipelines that build business data... ...Devops etc. Experience with AWS components such as... ...Hands-on experience with GenAI developer tools...Amazon Web ServicePipelinePart timeRelocation packageFlexible hours$175.5k - $180k
...and optimize modern data platforms that... ...architect scalable pipelines, manage secure and... ..., Machine Learning Engineers, Designers, and domain... ...roles Proficiency in Python, Scala, or Java for... ...platforms such as (AWS, GCP, Azure, Oracle... ...practices, and GenAI toolkits (LangChain...Amazon Web ServicePipelineHourly payApprenticeshipWork at officeEasy work$130k - $160k
...Principal Data Engineer | Chicago (Hybrid) $130,000 – $160,000 base + 1... ...modern cloud data platform (AWS, Snowflake) Design, build, and... ...scalable, production‑grade data pipelines Lead data modeling strategy... ...SQL and strong proficiency in Python Hands‑on experience with...Amazon Web ServicePipeline$95k - $115k
...You'll sit within the Data & Analytics organization... ...design and maintain the pipelines, infrastructure, and... ...possible so that analysts, engineers, and business... ...datasets Experience with Python for scripting, automation... ...Understanding of cloud computing (AWS) and data security best...Amazon Web ServicePipelineWork at office- ...focused investment firm is hiring a Data Engineer to join a forward deployed engineering... ...experience Strong SQL and Python skills Experience designing and maintaining ETL/ELT pipelines Hands on work with cloud platforms (AWS, Azure, or GCP) Experience building...Amazon Web ServicePipeline
- ...Data Engineer We are looking for a skilled Data Engineer to design and build scalable data solutions using PySpark and AWS services. The ideal candidate will have hands-on experience in building... .... Build and manage data pipelines using AWS services such as AWS Glue...Amazon Web ServicePipeline
- ...Must Have Snowflake Snowpark Python Advanced SQL Snowflake Tasks... ...Migrate existing Azure Data Factory pipelines into native Snowflake solutions... ...requirements and task assignments from engineering leadership Ensure secure,... ...Copilot experience AWS experience Snowflake Private...Amazon Web ServicePipelineH1bRemote work
- ...Data Engineer We are seeking a highly skilled MLOps Engineer / Python Developer with strong experience in building and maintaining... ...scalable data and machine learning pipelines. The ideal candidate will have... ...hands-on expertise in Python, AWS, Kubernetes, and ML workflow...Amazon Web ServicePipeline
$180k - $250k
...Lead Data Engineer | 5+ Years Experience | Scalable Batch & Streaming Pipelines | Cloud Architecture (AWS, Databricks, Kubernetes) Job Details Job Details: Salary: $180,000 - $250,... ...software applications. Java/Scala mandatory; Python experience is significant. Must possess...Amazon Web ServicePipeline$88.9k - $165.1k
...real opportunities in data. We build the next generation... ..., cloud‑native pipelines and analytics systems across... ...We seek a Senior Data Engineer who thrives on... ...Databricks, Spark, SQL, and Python for large‑scale ingestion... ...cloud data platform with AWS services, improving...Amazon Web ServicePipelineLocal area- ...Overview: Job Title: Senior Data Engineer (Databricks) Location: Chicago, IL / Remote... ...Apache Spark, SQL, and cloud-based ETL pipelines . The ideal candidate should possess strong... ...Skills Experience with Azure, AWS, or GCP data platforms Exposure to...Amazon Web ServicePipelineFull timeRemote work
- ...Must have skill: Snowflake SQL, Data warehouse, Python, AWS-Lambda, ETL/ELT Job Description: Required Skills: 6-8 years+ experience... ...needs. • Build, test and implement highly efficient data pipelines using a variety of technologies. • Develop best practice...Amazon Web ServicePipeline
- ...Position-Data engineer Duration-Contract Location- Chicago... ...system functionality Digital : Python, Digital : Kafka, Digital :... ...Snowflake, Python, Airflow, AWS, Kafka Experience building/... ...domain Experience building Data pipelines, database modeling for OLAP,...Amazon Web ServicePipelineContract workImmediate start
$120k - $140k
...Senior Data Engineer Location: Chicago, IL (Hybrid) Pay: $120k... ..., and maintain scalable data pipelines and infrastructure using Snowflake... ...and optimize SQL- and Python-based workflows for data ingestion... ...environments, preferably AWS ~ Strong communication skills...Amazon Web ServicePipeline$98k - $182k
...leading advertising technology company is seeking an experienced data engineer to build and maintain robust big data pipelines. The role involves working with modern data technology like Spark, Scala, and AWS, and requires 5+ years of experience in data engineering. The...Amazon Web ServicePipeline$114.1k - $193.98k
...seeking a highly experienced Snowflake Engineer with deep expertise in Snowflake system optimization, enterprise data architecture, and scalable pipeline development. This role will be... ...techniques Experience with cloud platforms (AWS, Azure, or GCP) Experience building...Amazon Web ServicePipelineTemporary workFlexible hours- A technology firm is seeking a Data Engineer to design and maintain data pipelines within the healthcare sector in Chicago... ...using modern tools such as Python and Snowflake SQL. This full-time... ...data processes and requires strong AWS proficiency and effective communication...Amazon Web ServicePipelineRemote jobFull time
$88k - $103k
...maintain scalable ETL and ELT pipelines based on business... ...-native technologies (AWS, Databricks, Amazon Redshift... ...maintain relational data models to support... ...and train junior data engineers through code reviews, technical... .... Proficiency in Python for data processing, automation...Amazon Web ServicePipelineFlexible hours- ...Data Engineer – Databricks Integration Onshore Location: Chicago, IL... ..., develop, and maintain data pipelines that extract data from Oracle... ...integration. ~ Proficiency in SQL, Python, and Spark for data... ...with cloud platforms (Azure, AWS, or GCP) for hosting Databricks...Amazon Web ServicePipeline
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer: Python Pipelines & GenAI on AWS. Be the first to apply!
- senior cloud data engineer Chicago, IL
- principal data engineer Chicago, IL
- finance data engineer Chicago, IL
- aws data engineer Chicago, IL
- data engineer Chicago, IL
- sr data engineer Chicago, IL
- software data engineer Chicago, IL
- junior data engineer remote Chicago, IL
- remote data engineer Chicago, IL
- data engineer intern Chicago, IL

