Senior Lead Data Engineer
$128.47k - $208.77kCaterpillar Inc.
Career Area: Technology, Digital and Data
Job Description:
Your Work Shapes the World at Caterpillar Inc.
When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.
Cat Digital is the digital and technology arm of Caterpillar Inc., leveraging the latest technologies to build industry leading digital solutions for our customers and dealers. With over 1.5 million connected assets worldwide, our teams use data, technology, advanced analytics, telematics, and AI capabilities to help our customers build a better, more sustainable world.
Job Summary:
Our global team is responsible for bringing digital capabilities to Caterpillar’s world-famous yellow iron. Working with your yellow partners and Cat Dealers, we execute key components of digital and marketing portfolios, including global marketing & brand, enterprise data, analytics and AI, equipment management, eCommerce, digital marketing, rental & used digital solutions, and aftermarket leads & insights.
As a Senior Lead Data Engineer on the Data Engineering team, you will be responsible for developing Python data pipelines that build business data objects used to support applications
What You Will Do:
- Responsibilities of the incumbents are across functional lines with individuals assigned in new program development.
- Competent to perform all programming, project management, and development assignments without close supervision; normally assigned the more complex aspects of systems work.
- Works directly on complex application/technical problem identification and resolution.
- Interpreting design requirements for engineering implementation
- Building and deploying CICD pipelines
- Implementing source to target mapping as pipeline code
- Responsibility for Unit and Integration testing
- Maintains high standards of software quality within the team by establishing good practices and habits
- Identifies and encourage areas for growth and improvement within the team
- Employee is also responsible for performing other job duties as assigned by Caterpillar management from time to time.
What You Will Have:
- Software Development Strong expertise in software development tools and activities; ability to produce software products or systems in line with product requirements.
- Software Development Life Cycle: Strong expertise in software development life cycle; ability to use a structured methodology for delivering and managing new or enhanced software products to the marketplace.
- Software Product Design/Architecture: Strong expertise in software product design; ability to convert market requirements into the software product design.
- Software Product Technical Knowledge : Strong expertise in technical aspects of a software products; ability to design, configure and integrate technical aspects of software products.
- Software Product Testing : Strong expertise in software product testing; ability to design, plan, and execute testing strategies and tactics to ensure software product quality and adherence to stated requirements.
Considerations For Top Candidates:
- Software development experience and solid knowledge of OOP principles
- Experience in designing and developing software applications in Python
- Experience working with Git version control on medium to large teams
- Deploying software using CI/CD tools such as Jenkins, Github Actions, Azure Devops etc.
- Experience with AWS components such as Lambda, Kinesis, Event Bridge, CloudWatch, CloudFormation, Dynamo, Fargate, S3, Sage Maker, IAM and RDS
- Experience working with Snowflake
- Hands‑on experience with GenAI developer tools
- Experience with tools such as GitHub Copilot or Claude Code, or similar AI coding assistants to improve developer productivity, code quality, and delivery speed
Additional Details:
- This position requires the candidate to be in Chicago, IL
- Domestic relocation assistance is NOT available for this position
- Visa sponsorship is available with this position
Summary Pay Range:
$128,470.00 - $208,770.00Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar.
Benefits:
Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.
Medical, dental, and vision benefits*
Paid time off plan (Vacation, Holidays, Volunteer, etc.)*
401(k) savings plans*
Health Savings Account (HSA)*
Flexible Spending Accounts (FSAs)*
Health Lifestyle Programs*
Employee Assistance Program*
Voluntary Benefits and Employee Discounts*
Career Development*
Incentive bonus*
Disability benefits
Life Insurance
Parental leave
Adoption benefits
Tuition Reimbursement
* These benefits also apply to part-time employees
Visa sponsorship is available for eligible applicants.Posting Dates:
Any offer of employment is conditioned upon the successful completion of a drug screen.
Caterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities. Qualified applicants of any age are encouraged to apply.
Not ready to apply? Join our Talent Community.
$118k - $196.7k
As a Senior Lead, Data Engineering, you will serve as a technical leader who helps shape the future of enterprise data solutions. In this role, you will drive complex data initiatives, influence technical strategy, and partner with teams across the organization to build...SeniorRemote jobTemporary workFlexible hours$70 - $83 per hour
job summary: Are you a Data Engineer with over 10 years of experience and expertise working with Databricks on AWS? Overview: · We... ..., and artificial intelligence ecosystem. We are looking for a Lead Data Engineer who's ready to do more than just build pipelines...SuggestedHourly payContract workTemporary workWork experience placementLocal area- ...days per week in office in Chicago, IL Our client seeks a Lead Data Engineer to design, build, and optimize large-scale data processing... ...design, architecture, and best practices in partnership with senior engineering leadership. Mentor engineers, lead design and...SuggestedHourly payWork at officeLocal area2 days per week
$180k - $200k
...growing our firm with talented, intellectually diverse people with excellent work ethics. Role Description We are seeking a Lead Data Engineer to drive the design, architecture, and delivery of scalable data platforms, AI‑powered data products, and enterprise‑grade...SuggestedWork at office- ...Lead Data EngineerRoel: Lead Data Engineer Location: Chicago IL, Locals only. Duration: Longterm Contract Interview Type: Video and Final interview is in-person interview.Snowflake/Snowpipe, SQL, Python/PySparkData Modeling, Data Engineering with Modeling Techniques -...SuggestedContract workLocal area
$179.4k - $204.7k
## Lead Data EngineerApplylocations: Chicago, ILtime type: Full timeposted on: Posted Todayjob requisition id: R246221Lead Data EngineerDo... ...problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging...Full timePart timeInternshipH1bLocal area$133k - $175k
...JPMorganChase is hiring a Lead Data Engineer within its Corporate Technology team in Chicago, IL on an onsite basis. In this role, you will design, implement, and maintain data pipelines that support scalable data ingestion and processing, with a strong focus on timeliness...$92k - $138k
Role description Lead Data Engineer Lead II - Data Engineering Who We Are: Born digital, UST transforms lives through the power of technology. We walk alongside our clients and partners, embedding innovation and agility into everything they do. We help them create transformative...Full timeTemporary workPart timeWork at officeLocal areaRemote workFlexible hours- ...Lead Data EngineerProven strong experience on building re-usable framework, libraries, and data platform capabilities Azure and Databricks experience Strong experience of python, building re-usable python based frameworks Experience with data lake environment must Work...
- ....com. Position Summary: The Enterprise Data Architect is a hands-on technical leader... ...artificial intelligence initiatives. The role leads modernization through Microsoft Fabric,... ..., timeliness, and uniqueness. Engineering Standards and Automation Implement source...
- Publicis Sapient in Chicago is seeking a Senior Data Engineer/Lead Engineer to design, build, and maintain scalable Big Data solutions across batch and streaming pipelines on cloud platforms. You will translate client requirements into robust architectures, drive data platform...
- Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE (Preferred Location; Hybrid Role; Needs to work 3 days from Office in a week) Job Type: Long Term Contract Responsibilities: Lead the design, development,...Long term contractWork at office
- Lead Data Engineer / Technical Architect Location: Chicago Reporting to: CIO Open to SOW to Hire, SOW, or FTE About the Role We are looking... ...centralize and modernize the data estate, and we require a senior engineer to evaluate the current state, define the future‑state...
- ...Data EngineerTiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science... ...consulting team in the world.We are seeking an experienced Data Engineer to join our data team. In this role, you will be responsible for...Senior
- Must have skill: Snowflake SQL, Data warehouse, Python, AWS-Lambda, ETL/ELT Job Description: Required Skills: 6-8 years+ experience on... ...functional metrics in any specific business Responsibilities: • Lead data warehouse development activities for a team, leading more than...
- Senior / Lead Data Engineer We are seeking a hands-on Senior / Lead Data Engineer to provide technical leadership for the platforms, pipelines, and data products that power analytics, applications, and investment decision-making across the firm. You will architect scalable...
- ...Senior Data EngineerREMOTE Senior Data Engineer Needed For Growing Insurance Tech Company!We are a growing insurance tech company that is on the lookout for a talented Senior Data Engineer in the NYC area!Why join us?Competitive base salary between $150k and $210k!401k...SeniorRemote workWork from home
- ...by designing and implementing a scalable data architecture that enables better decision... ...This hands-on individual contributor will lead the design and implementation of Guidant'... ...technology initiatives. Data Engineering & Architecture ~ Design and implement Guidant...Full time
$136.13k - $150.29k
...SummaryServe as a technical expert for organization-wide security engineering initiatives. Develop a set of security standards and best... ...to respond to and recover from a security breach. Assist with data forensic capabilities, cyber security research and development,...SeniorFull timeWork experience placementWork at officeRemote workRelocation packageFlexible hours$150k - $200k
...Belvedere Trading is a leading proprietary trading firm proudly headquartered in downtown... ...software systems are continually re-engineered, optimized, and maintained to stay on top... ...Trading is looking for a proven Senior Data Engineer to work directly with our trading...SeniorFull time$50 - $52.5 per hour
...Title: Senior Data Reporting Engineer Location: Deerfield, IL – Hybrid (4 Days Onsite / 1 Day Remote) Duration & Type: 6-Month Contract with Potential for Extension or Full-Time Conversion – Hours, Mon-Fri: 8-5pm CST Compensation: Competitive hourly W2 rate...SeniorHourly payFull timeContract workTemporary workLocal areaRemote work- ...opportunities! At Xenon7, we work with leading enterprise clients and innovative... ...on high-impact projects across Data, AI, Cloud, and Software Engineering. Our expertise in AI solution architecture... .... Job Summary We are seeking a Senior Data Engineer with extensive...SeniorFull timeContract workFor contractors3 days per week
- ..., insurance, and advisory services with leading market intelligence. We take a fundamental... .... About You: You enjoy building data foundations that people can trust and use... .... ~ Use AI tools to accelerate engineering and investigation while validating transformations...SeniorFull timeLocal areaImmediate startRemote workFlexible hours
$91.7k - $163.7k
...Senior Data EngineerOptum Rx is helping people access safe and effective prescription medications... .... Growing together.As a Senior Data Engineer on the Optum Rx Data Engineering Ops... ...critical data systems and pipelines. You will lead data loads monitoring, incident...SeniorMinimum wageFull timeWork experience placementLocal areaRemote work$140k - $170k
...like to meet you. ABOUT THE ROLE We are looking for a Senior Data Engineer (remote) to own and evolve the backbone of our data platform.... ...efficiency through automation and process enhancements. Lead with technical depth : review code and set engineering best...SeniorTemporary workLive inRemote workFlexible hours- ...Description Job Description Description: Hybrid At least 2 days per week in office in Chicago, IL Our client seeks a Senior Data Engineer to design, build, and operate large-scale data processing for attribution, measurement, forecasting, and privacy-preserving...SeniorHourly payWork at officeLocal area2 days per week
- Tiger Analytics is seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines on AWS, collaborating with data scientists and AI teams. You will work with S3, Glue, Lambda, Redshift, Databricks, Spark, and Airflow to support pharma data sources...Senior
$10k
...recognized by both Fast Company and Nielsen for its industry leading innovation. To learn more about fairlife and its complete line... ..., please visit fairlife.com. job purpose : The Sr. Data Engineer will play a key role in delivering fairlife's ambition of building...SeniorTemporary workWork at officeLocal area3 days per week- JPC is seeking a Sr. Data Engineer with AI Experience for the Chicago, IL area. The role is hybrid (3 days in the office) with in-person interviews required. The project focuses on rebuilding Caboodle extraction to a clean incremental raw ingestion flow, avoiding joins,...SeniorTemporary workWork at office
- Belvedere Trading, a leading proprietary trading firm headquartered in downtown Chicago, is seeking a Senior Data Engineer to work directly with trading desks to improve trading performance through robust data solutions. You will design scalable data architectures, implement...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Lead Data Engineer. Be the first to apply!
- senior living director Chicago, IL
- heritage senior living Chicago, IL
- senior manager customer operations Chicago, IL
- senior support engineer Chicago, IL
- senior product manager mobile Chicago, IL
- senior c++ developer Chicago, IL
- senior java developer Chicago, IL
- senior software engineer ruby on rails Chicago, IL
- sr finance manager Chicago, IL
- sr marketing manager Chicago, IL



