Senior Lead Data Engineer Python Pipelines & GenAI
Caterpillar Brazil
Caterpillar Inc. is seeking a Senior Lead Data Engineer to develop Python data pipelines that support digital and data capabilities for Caterpillar’s global operations. The role focuses on building scalable data flows, CI/CD automation, and leveraging AWS services and GenAI tooling within a Chicago-based team. You will work closely with Cat Digital to deliver data-driven solutions across applications, analytics, and AI initiatives, contributing to a sustainable, connected product ecosystem. #J-18808-Ljbffr Caterpillar Brazil
- Caterpillar Inc. in Chicago, IL is seeking a Senior Lead Data Engineer to architect and deliver Python data pipelines that power enterprise applications and analytics. You will join Cat Digital's Data Engineering team and collaborate with yellow-iron partners and dealers...PipelineSenior
$179.4k - $204.7k
...Lead Data Engineer (Python, AWS, SQL, GenAI)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems... ...quality, governance and permissible use and building data pipelines with emerging technologies. As a Capital One Lead Data...PipelineFull timePart timeInternshipLocal area- ...Hi, Senior GenAI/Python Engineer Chicago, IL Remote Full Time... ...workflows, and agentic extraction pipelines for complex user questions.... ..., entitlement-aware data access, and reporting-engine... ..., Navneet Jha Team Lead ****@*****.***...PipelineSeniorFull timeRemote work
- Caterpillar Inc. is seeking a Senior Lead Data Engineer to join the Data Engineering team in Chicago. You will develop Python data pipelines to support applications and leverage modern data platforms and automation features. You will build, test, and deploy CI/CD pipelines...PipelineSenior
$128.47k - $208.77k
...Technology, Digital and Data Job Description:... ...technologies to build industry leading digital solutions... ...& insights. As a Senior Lead Data Engineer on the Data... ...responsible for developing Python data pipelines that build business... ...‑on experience with GenAI developer tools...PipelineSeniorWorldwideRelocation package$128.47k - $208.77k
...Technology, Digital and Data Job Description:... ...technologies to build industry leading digital solutions... ...& insights. As a Senior Lead Data Engineer on the Data... ...responsible for developing Python data pipelines that build business... ...-on experience with GenAI developer tools...PipelineSeniorPart timeWorldwideVisa sponsorshipRelocation packageFlexible hours- McKinsey & Company in Chicago is seeking a data engineer to design and build graph-centric data pipelines and a semantic data layer that powers GenAI applications. You will develop a... ...engineering, experience with AWS, Docker, Python, and knowledge graphs. You will write production...PipelineSenior
- Work Flexibility: RemoteAs a Senior Lead, Data Engineering, you will serve as a technical leader who helps... ...Data Factory, Azure DevOps, CI/CD pipelines, and infrastructure automation.Integrate... ....Strong proficiency in SQL and Python, with experience using Spark or similar...PipelineSeniorFull timeFor contractorsRemote work
- Lovelytics is seeking a Generative AI Engineer (Senior Consultant) to design and deliver client-facing GenAI solutions on the Databricks platform. You will build AI Agents, RAG systems, and end-to-end pipelines, working with language models, vector stores, and orchestration...PipelineSenior
$155k - $224k
Build and iterate on GenAI proof-of-concepts... ...into software.Lead delivery of complex... ...-performance eval pipelines and observability... ...maturity, including data readiness gaps, system... ..., Electrical Engineering, Mathematics or related... ...(e.g., Java, Python, Go or C++) and building...PipelineSeniorImmediate start$171.5k
...partnerships, and leading technology, we... ...powered by data and machine learning... .... The Senior Software Developer... ...is part of the GenAI Platform team.... ...product and domain engineering teams, you will... ...build, and operate Python/FastAPI backend... ...reviews, CI/CD pipelines, automated...PipelineSeniorFull time- ...Hi, One of our clients is looking for Senior Databricks Architect / Lead Data Engineer in Westchester, IL (Onsite Position) Title:... ...Development Develop and optimize complex data pipelines using PySpark and Databricks. Build and maintain...PipelineSenior
- Senior Java Developer (AWS Serverless / GenAI / GitHub Copilot) Direct message the job poster from Drillo.AI We are seeking an experienced Senior Java... ...best practices in CI/CD, automated testing, and DevOps pipelines. Troubleshoot, optimize, and refactor existing...PipelineSeniorContract work
- ...You will be expected to lead, implement, and define the Data Science and GenAI capabilities. The role... ...in AI/ML modeling, ML engineering, data science, and data... ...processing-based AI ML pipelines including data ingestion... ...hands-on experience with Python, SQL, Natural Language...PipelineSeniorTemporary workLocal area1 day per week
$77k - $202k
...Analytics & AIManagement LevelSenior AssociateJob Description & SummaryThe OpportunityAs a GenAI Python Systems Engineer - Senior Associate, you will play a pivotal role in transforming raw data into actionable insights, enabling informed decision-making and driving business...SeniorFull timeH1b$63k - $140k
...Description & SummaryThe OpportunityAs a GenAI Python Systems Engineer - Experienced Associate, you will... ...techniques to design and develop robust data solutions for clients, transforming... ...as Scikit-Learn- Developing data pipelines and models to transform raw data into...PipelineFull timeH1b- ...systems, high-throughput data applications, and an... ...near-real-time decision engines Help design and grow... ...Event-driven and streaming pipelines Mixed relational/... ...and data pipelines in Python, and user-facing features... ..., and architecture Lead and participate in...PipelineSenior
- A technology consulting firm is seeking a Senior Java Developer with 8+ years of experience in Java and strong expertise in AWS serverless... ...with cross-functional teams. Strong skills in CI/CD pipelines and AI-assisted development tools, including GitHub Copilot, are...PipelineSeniorContract work
- ...implement, optimize, and maintain large-scale data pipelines and surveillance models that process... ...data. The team consists of software engineers, data engineers, compliance specialists... ...software engineering experience in Python, C++ or Java3+ years of professional experience...PipelineSeniorWork at officeRemote work
$125k - $150k
Senior Software Engineer, Python ProgrammerFitch Ratings is currently seeking a Senior Software Engineer specializing... ...practical solutions.Set up CI/CD pipelines for projects and integrate them with... ...orchestration).Knowledge of data science and machine learning concepts...PipelineSeniorImmediate start- ...Senior Python DeveloperLocation: Chicago, ILRole DescriptionWe seek a seasoned... ..., develop, and optimize data-intensive applications. You’ll architect robust ETL pipelines, enhance data models, and... ...data scientists, analysts, and engineers to translate business requirements...PipelineSenior
$130k - $170k
...advanced technology and data analytics to deliver... .... Job OverviewThe Senior Software Engineer (Platform Team) joins... ...(Responsibilities)• Lead the development of scalable... ...Build real-time data pipelines to enable efficient... ...applications using Python (preferred).Education...PipelineSeniorFull timeWork at officeLocal areaFlexible hours3 days per week- ...organizations modernize data ecosystems, build... ...AreA hands-on Engineer with foundational... ..., supporting senior architects, and contributing... ..., build data pipelines and models,... ...to project leads and client stakeholders... ...experience with Python or AI or GenAI tools (Vertex AI...PipelineSeniorFull timeWork experience placementLive inWork at officeLocal area
$99k - $232k
...OpportunityAs an AI & GenAI Data Scientist - Manager, you... .... You are expected to lead with integrity and... ...algorithms, and software engineering to build and deploy... ...programming languages such as Python and Java to enhance AI... ...maintenance of data pipelines and infrastructure-...PipelineFull timeH1b- ...Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs... ...frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in software engineering, logical reasoning, STEM, multilinguality...PipelineSeniorRemote jobFor contractorsFlexible hours
$112.8k - $153.7k
...ideas. This is a senior engineering role. You will architect... ...improve cloud data and analytics... ...analytics assets (pipelines, jobs, semantic models... ...across the others.Lead onboarding and enablement... ...scripting in Python or PowerShell.... ...plus.Hands-on AI/ML/GenAI enablement experience...PipelineSeniorFull timeContract workLocal areaFlexible hours- ...8505Role OverviewWe are seeking a hands-on Senior / Lead Data Engineer to provide technical leadership for the platforms, pipelines, and data products that power analytics, applications... ..., data models, and platform services using Python, SQL, Snowflake, and AWS.• Architect...Pipeline
- ...Senior Full Stack Developer (Angular + Python) Location: Chicago, IL Type: Contract Compensation: Open Work Model: Onsite – onsite/Remote Hours: 4... ...architecture, Lambda functions, SNS/SQS messaging, data pipelines with AWS Glue ETL, S3, and IAM security. Participate...PipelineSeniorContract workLocal areaRemote work
$180k - $200k
...application!Role DescriptionWe are seeking a Lead Data Engineer to drive the design, architecture, and... ...-to-end data ecosystems—including data pipelines, storage, APIs, and AI-enabled services... ...in data engineering fundamentals (Python, SQL) with production experience Proven...PipelineFull timeWork at office$106.5k - $182.6k
...operationalization of an enterprise-class modern data environment, which may include various... ..., build, deploy and maintain data pipelines using modern data tools on batch and... ...data pipelines on-prem, cloud and business engineering extractProvide technical support to meet...PipelineFull timeTemporary workPart time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Lead Data Engineer Python Pipelines & GenAI. Be the first to apply!
- python developer data analytics Chicago, IL
- python programmer Chicago, IL
- full stack / python developer (remote) Chicago, IL
- python developer remote Chicago, IL
- python developer Chicago, IL
- senior python developer Chicago, IL
- python engineer Chicago, IL
- senior network engineer remote Chicago, IL
- senior benefits manager Chicago, IL
- senior app developer Chicago, IL



