Senior Lead Data Engineer
$128.47k - $208.77kCaterpillar
Career Area:Technology, Digital and DataJob Description:Your Work Shapes the World at Caterpillar Inc. When you join Caterpillar, you'rejoining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don'tjust talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.Cat Digital is the digital and technology arm of Caterpillar Inc., leveraging the latest technologies to build industry leading digital solutions for our customers and dealers. With over 1.5 million connected assets worldwide, our teams use data, technology, advanced analytics, telematics, and AI capabilities to help our customers build a better, more sustainable world.Job Summary: Our global team is responsible for bringing digital capabilities to Caterpillar’s world-famous yellow iron. Working with your yellow partners and Cat Dealers, we execute key components of digital and marketing portfolios, including global marketing & brand, enterprise data, analytics and AI, equipment management, eCommerce, digital marketing, rental & used digital solutions, and aftermarket leads & insights.As a Senior Lead Data Engineer on the Data Engineering team, you will be responsible for developing Python data pipelines that build business data objects used to support applicationsWhat You Will Do:Responsibilities of the incumbents are across functional lines with individuals assigned in new program development.Competent to perform all programming, project management, and development assignments without close supervision; normally assigned the more complex aspects of systems work.Works directly on complex application/technical problem identification and resolution.Interpreting design requirements for engineering implementationBuilding and deploying CICD pipelinesImplementing source to target mapping as pipeline codeResponsibility for Unit and Integration testingMaintains high standards of software quality within the team by establishing good practices and habitsIdentifies and encourage areas for growth and improvement within the teamEmployee is also responsible for performing other job duties as assigned by Caterpillar management from time to time.What You Will Have:Software Development Strong expertise in software development tools and activities; ability to produce software products or systems in line with product requirements.Software Development Life Cycle: Strong expertise in software development life cycle; ability to use a structured methodology for delivering and managing new or enhanced software products to the marketplace.Software Product Design/Architecture: Strong expertise in software product design; ability to convert market requirements into the software product design.Software Product Technical Knowledge: Strong expertise in technical aspects of a software products; ability to design, configure and integrate technical aspects of software products.Software Product Testing: Strong expertise in software product testing; ability to design, plan, and execute testing strategies and tactics to ensure software product quality and adherence to stated requirements.Considerations For Top Candidates:Software development experience and solid knowledge of OOP principlesExperience in designing and developing software applications in PythonExperience working with Git version control on medium to large teamsDeploying software using CI/CD tools such as Jenkins, Github Actions, Azure Devops etc.Experience with AWS components such as Lambda, Kinesis, Event Bridge, CloudWatch, CloudFormation, Dynamo, Fargate, S3, Sage Maker, IAM and RDSExperience working with SnowflakeHands‑on experience with GenAI developer toolsExperience with tools such as GitHub Copilot or Claude Code, or similar AI coding assistants to improve developer productivity, code quality, and delivery speedAdditional Details:This position requires the candidate tobe in Chicago, ILDomestic relocation assistance is NOT available for this positionVisa sponsorship is available with this positionSummary Pay Range:$128,470.00 - $208,770.00Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location,job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar.Benefits:Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.Medical, dental, and vision benefits*Paid time off plan (Vacation, Holidays, Volunteer, etc.)*401(k) savings plans*Health Savings Account (HSA)*Flexible Spending Accounts (FSAs)*Health Lifestyle Programs*Employee Assistance Program*Voluntary Benefits and Employee Discounts*Career Development*Incentive bonus*Disability benefitsLife InsuranceParental leaveAdoption benefitsTuition Reimbursement* These benefits also apply to part-time employeesVisa sponsorship is available for eligible applicants.Posting Dates:Any offer of employment is conditioned upon the successful completion of a drug screen.Caterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities. Qualified applicants of any age are encouraged to apply.Not ready to apply? Join our Talent Community.SummaryLocation: Chicago, IllinoisType: Full time
- Work Flexibility: RemoteAs a Senior Lead, Data Engineering, you will serve as a technical leader who helps shape the future of enterprise data solutions. In this role, you will drive complex data initiatives, influence technical strategy, and partner with teams across the...SeniorFull timeFor contractorsRemote work
$209k - $238.5k
...Senior Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers,...SeniorFull timePart timeInternshipLocal area- Senior Databricks Architect / Lead Data Engineer We are seeking an experienced Senior Databricks Architect / Lead Data Engineer to lead the design, development, and implementation of modern data platforms leveraging Azure Databricks. The ideal candidate will possess deep...Senior
- ...agile methodologies, encouraging a culture of innovation and high performance in a leading financial institution. As an Agility Lead in the Corporate Sector's Reference Data Engineering team, you will play a significant role as a champion for the adoption and continuous...SuggestedTemporary work
$92k - $138k
Lead Data Engineer Lead II - Data EngineeringWho We Are:Born digital, UST transforms lives through the power of technology. We walk alongside our clients and partners, embedding innovation and agility into everything they do. We help them create transformative experiences...SuggestedFull timeTemporary workPart timeWork at officeLocal areaRemote workFlexible hours$180k - $200k
...harborcapital.com/careers, search for this position and click on "Apply" to start your application!Role DescriptionWe are seeking a Lead Data Engineer to drive the design, architecture, and delivery of scalable data platforms, AI-powered data products, and enterprise-grade...Full timeWork at office$90k - $200k
...DescriptionCapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients... ...responsibilities for the Lead Machine Learning Engineer position... ...ConsultingExperience level: Mid-Senior LevelIndustry: Management ConsultingWork at officeRemote workVisa sponsorshipWork visaFlexible hours- ...Lead Data EngineerLocations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE (Preferred Location... ...Lead the design, development, and deployment of scalable data engineering solutions that deliver operational and analytical data to third...Work at office
- ...Job TitleMust have skill: Snowflake SQL, Data warehouse, Python, AWS-Lambda, ETL/ELTJob Description: Required Skills:6-8 years+ experience... ...functional metrics in any specific businessResponsibilities:• Lead data warehouse development activities for a team, leading more than...
- ...Lead Data EngineerProven strong experience on building re-usable framework, libraries, and data platform capabilities Azure and Databricks experience Strong experience of python, building re-usable python based frameworks Experience with data lake environment must Work...
$98k - $182k
...audience activation business. We are a small, high-impact team of engineers operating at massive scale—trillions of user events flow... ...Connected TV publishers (LG, Samsung), your work directly connects our data ecosystem to the biggest platforms in the world.This role...Local areaFlexible hours$190k - $220k
...Data Engineering Lead (Hybrid)Chicago, ILAbout Rewards NetworkFor 41 years, Rewards Network has been helping restaurants grow revenue, increase... ...into team progress, architectural decisions, and risks to senior leadership, communicating tradeoffs clearly and escalating when...Full timeWork at officeLocal areaFlexible hours3 days per week- ...Lead Data EngineerRoel: Lead Data Engineer Location: Chicago IL, Locals only. Duration: Longterm Contract Interview Type: Video and Final interview is in-person interview.Snowflake/Snowpipe, SQL, Python/PySparkData Modeling, Data Engineering with Modeling Techniques -...Contract workLocal area
$126.2k - $264.1k
In response to increased concurrent projects for the delivery of our data centers, Oracle is recruiting a Lead Principle Commissioning Engineer. The role is a senior multi-disciplinary data center commissioning lead with a focus all levels of commissioning activities up...Contract workTemporary workLive inFlexible hours- ...Lead Data EngineerAre you a Data Engineer with over 10 years of experience and expertise working with Databricks on AWS? We are investing in the next evolution of our data, analytics, and artificial intelligence ecosystem. We are looking for a Lead Data Engineer who's...
- THE GLOBAL LEADER IN DATA & ANALYTICS RECRUITMENTHarnham Search and Selection Company Number: 05723485Harnham Search and Selection is a registered company in England and Wales. Reg no. 05723485Harnham Europe Limited Company Number: 09956940Harnham GmbH HRB: 196954Harnham...SeniorWork at office
$140k - $170k
...VAHybridFull Time$140k - $170k Join a growing, data-driven organization that is investing... ...capabilities. We are seeking a Senior Databricks Data Engineer to design, build, and optimize... ...Prior experience mentoring engineers or leading technical initiatives What You Will Be...SeniorFull time$140k - $165k
Chicago, IllinoisHybridDirect Hire$140k - $165k A well-established, global professional services organization is expanding its Data & AI engineering team and hiring a Data Engineer to support a large-scale cloud data platform initiative. This role is based in Chicago and...SeniorFull timeImmediate start$156k - $226k
Develop and maintain the data architecture and predictive models powering gTech’s risk graph.Design and deploy automated key risk indicators... ..., automated source of truth.Partner with core Data Science and Engineering teams to transition our risk analysis from reactive (incident...Senior- ...Data EngineerTiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science... ...consulting team in the world.We are seeking an experienced Data Engineer to join our data team. In this role, you will be responsible for...Senior
$60k - $120k
A healthcare-focused technology company is looking for a Senior DataBricks Developer for a fully remote role. The ideal candidate will have over 7 years of experience in data engineering, strong skills in Python and SQL, and hands-on experience with Databricks. The position...SeniorRemote workFlexible hours$179.4k - $204.7k
...Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment...Full timePart timeInternshipLocal area- ...on innovation and automation, IBKR provides clients with access to over 150 markets across 200+ countries and territories. We are a data-driven organization that leverages cutting-edge technology to deliver best-in-class trading solutions, and our teams thrive in a fast...SeniorWork at officeRemote work
- ...Capital One is seeking a Senior Manager Data Engineer to lead a high-performing team building cloud-based data solutions using Databricks, PySpark, and Snowflake. You will collaborate with agile teams to design, develop, and deploy scalable data pipelines for real-time...Senior
$91.7k - $163.7k
...start Caring. Connecting. Growing together.Position SummaryAs a Senior Data Engineer on the Optum Rx Data Engineering Ops team, you will be... ...performance of critical data systems and pipelines. You will lead data loads monitoring, incident resolution, data quality checks...SeniorMinimum wageFull timeWork experience placementLocal areaRemote work$150k - $200k
...Full-Time /On-siteBelvedere Trading is a leading proprietary trading firm proudly... ...and software systems are continually re-engineered, optimized, and maintained to stay on top... ...Belvedere Trading is looking for a proven Senior Data Engineer to work directly with our...SeniorFull time- ...VeeRteq Solutions Inc. is seeking a Senior Data Engineer to design and manage scalable ETL pipelines using PySpark, Python, SQL, and cloud services. The role requires deep experience with Databricks, AWS, and modern DevOps practices. You will build data pipelines, implement...SeniorRemote work3 days per week
- DescriptionThe Data & AI Platform Engineer at Sabert Corporation is a hybrid role that plays a strategic and hands-on role at the intersection of... ...our benefits click here.Learn More About Sabert:We are a leading global manufacturer of innovative food packaging products...
$128.01k - $152.18k
...businesses to manage risks with confidence.Job DescriptionAI-First Data Strategy for P&C Insurance Carrier | Lead Innovation in Property & Casualty Insurance Data SolutionsWe are seeking a Senior Data Engineer to spearhead our transition to a modern, first, AI-first data...SeniorFull timeWork at officeLocal area- ...Senior Data EngineerLocation: Chicago, IL 60604Work Arrangement: Hybrid – 3 days per week in the Chicago officeContract Duration: 6 MonthsExperience... ...: 8–10+ YearsWe are looking for an experienced Senior Data Engineer with strong expertise in data modeling, cloud data...Senior3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Lead Data Engineer. Be the first to apply!
- senior operations technician Chicago, IL
- senior operations associate Chicago, IL
- senior cloud service delivery manager Chicago, IL
- senior it service manager Chicago, IL
- senior project engineer Chicago, IL
- senior chief engineer Chicago, IL
- sr operations manager Chicago, IL
- senior account director Chicago, IL
- senior director clinical development Chicago, IL
- senior customer service representative Chicago, IL

