Lead Data Engineer
Full-time
Rootshell Enterprise Technologies, Inc.
Role Description
Lead Data Engineer
Remote must be in USA
Skill Set: Pyspark, Python, AWS, GIS, Palantir Foundry
Need a SME in Python coding (Data structures and algorithms)
- Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.
- Collaborate with product and technology teams to design and validate the capabilities of the data platform.
- Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability.
- Provide technical support and usage guidance to the users of our platform's services.
- Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.
Qualifications
- Experience building and optimizing data pipelines in a distributed environment.
- Experience supporting and working with cross-functional teams.
- Proficiency working in Linux environment.
- 5+ years of advanced working knowledge of SQL, Python, and PySpark.
- Knowledge on Palantir.
- Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline.
- Experience with platform monitoring and alerts tools.
Vacancy posted 16 hours ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Remote vacancy
$138k - $185k
...hackajob is collaborating with Excella to connect them with exceptional professionals for this role. Lead Consultant Data Engineer (DHS) Arlington, Virginia, United States Excella is a transformative technology firm that helps organizations unlock new possibilities...SuggestedWork from homeHome officeFlexible hours$107k - $135k
...Overview The Lead Data Engineer is responsible for the design, architecture and support of systems, services and applications required for the collection, storage, processing, and analysis of all forms of data to enable data-driven decisions and outcomes across the enterprise...SuggestedContract workWork at officeRemote workWork visaRelocation package3 days per week$150k - $180k
...diverse, and we are therefore committed to embracing diversity of thought and experience within our team. We are looking for a Lead Data Engineer to join our team. This is a high-impact, strategic role focused equally on technical leadership and hands-on execution. You...SuggestedRemote work- ...its comprehensive technology, actionable insights, and industry leading support. Backed by over 25 years of experience and... ...future of financial advice, visit The Team You’ll Join The Lead Data Engineer will play a critical implementation role on the Data Engineering...SuggestedWork experience placementRemote work
- .... Within ValueAdded Services (VAS), we are building AInative data foundations that transform how data is discovered, understood... ...decisioning across Visa's ecosystem. Opportunity We are seeking a Lead Data Engineer to define and drive the vision for VAS Data Foundations—a...SuggestedWork experience placementWork at officeLocal areaRemote workWorldwide2 days per week3 days per week
$160.06k - $183.33k
...Automotive - USA Job Details Job Family Group: Engineering / Product Development Management Level:... ...to complex problems and deliver leading‑edge software products. Serve as a technical... ...to the engineering efforts of data scrum teams. Key Responsibilities Engineer...Work at officeRemote workFlexible hours- ...Overview Title: Lead Data Engineer (AWS Lakehouse) Location: Dallas, TX or Houston, TX (hybrid) Duration: Direct Hire Work Requirements: US Citizen, GC Holders or Authorized to Work in the U.S. Job Description We’re hiring a hands-on Lead Data Engineer to help modernize...Work at officeLocal areaRemote workFlexible hours
- ...A leading educational institution is seeking a Lead Data Engineer who will design scalable data pipelines and lead a team to improve overall university outcomes. The role requires strong knowledge of cloud platforms, particularly AWS and Databricks, and excellent project...Remote workFlexible hours
- About this role: Within COO Technology, Wells Fargo is seeking a Lead Data Engineer to help shape and scale our cloud‑native data ecosystem. In this role, you will focus on Google Cloud Platform (GCP) services and frameworks, leading the design, build, and operation of...Full timeWork experience placementWork at officeRemote workFlexible hours
$160.56k - $193k
...Description Fortune Brands Innovations, Inc. is an industry-leading home, security and digital products company. We’re focused on... ...Explore life at Fortune Brands here. Job Description Lead Data Engineer, Fortune Brands Innovations Group, Inc., Deerfield, IL. Administer...Full timeRemote workFlexible hours- ...the world of you What You’ll Do Design and implement scalable data pipelines and data infrastructure that support various business... ...reusable frameworks, templates, and self-service tooling so both engineering and business teams can move faster. Own source code management,...Full timePart timeRemote workWork from homeFlexible hours
- Role Description The primary mission of the Lead Data Engineer role is to help our business evolve into a data and insights-driven organization. The Lead Data Engineer will provide technical leadership to our Product Team by helping design and implement our next generation...Full timeWork at office
$126.4k - $165.9k
Role Description The Lead Data Engineer is responsible for leading a team of data engineers in the design, development, and implementation of data solutions using Microsoft Fabric and Azure data platform technologies. The ideal candidate will have a strong understanding...Full timeTemporary workWork experience placementRemote workWorldwideAfternoon shift$122k - $207k
...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Lead Data Engineer Position Title: Lead Data Engineer Location: Austin, TX Who is Mastercard? Mastercard is a global technology company...Full timePart timeWorldwideFlexible hours$145.86k - $190.5k
...operational ETL jobs, produce reports, troubleshoot issues, investigate data issues, and assist business personnel in answering data-related... ..., Managing Information Technology, Statistics, Mathematics, Engineering, or related, or its foreign equivalent, or equivalent...Full timeWork experience placementWork at officeRemote workFlexible hours$142.3k - $195.7k
Role Description We are seeking an experienced and strategic Lead Data Engineer to join our ITSM Applied AI and Analytics team. This individual will lead the development and evolution of our enterprise-facing data store built on Azure Databricks, driving architectural...Bi-weekly payFull timeTemporary workRemote workWork from homeHome office$158k - $253k
Role Description Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational...Full time$127k - $236.5k
Role Description L3Harris Enterprise Data and AI team is seeking a Data Engineer with experience in managing enterprise-level data life cycle processes. This role includes: ~Overseeing data ETL/ELT pipelines ~Ensuring adherence to data standards ~Maintaining data...Full timeFlexible hours- ...Job Description Job Description Tech Lead – Data Platform | Remote A fast-growing financial technology company is seeking a Tech... ...architecture of the data platform, partner with Product and Engineering leadership, and lead the implementation of scalable, cloud-...Remote work
$140k - $231k
...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Lead Data Engineer Overview We are seeking a Lead Data Engineer with expertise in Apache Spark, Apache Iceberg, Apache Airflow, and AWS to...Full timePart timeWorldwideFlexible hours$70 - $90 per hour
...Job Overview Our client is a nationally recognized organization seeking a Lead Data Engineer to join a growing data and engineering team. This role will focus on building scalable data platforms, supporting analytics initiatives, and driving data engineering best practices...Contract workTemporary workRemote work$190k - $220k
...diverse, and we are therefore committed to embracing diversity of thought and experience within our team. We are looking for a Lead Data Engineer to join our team. This is a high-impact, strategic role focused equally on technical leadership and hands-on execution. You...Remote workWork visaShift work- Role Description At IT Labs, we are looking for an experienced Lead Data Engineer to support one of the most innovative companies in the digital health space. Our client is transforming healthcare through a technology-driven platform that connects employers and patients...Full timeContract workRemote work
- Role Description We’re hiring a Data Engineering Lead to help scale and guide a growing team of data engineers. This role is ideal for someone who enjoys solving technical challenges hands-on while also shaping engineering best practices, coaching others, and helping cross...Full timeRemote work
- Role Description We are seeking an experienced Lead Data Engineer with strong Terraform expertise to design, build and maintain scalable data solutions on Google Cloud Platform. In this role, you will lead the development of robust data pipelines while driving best practices...Full time
$142.3k - $195.7k
Role Description The Lead Data Engineer oversees data processing architectures and solutions ensuring the efficient conversion of structured and unstructured data to insights at enterprise scale. You will work on problems of diverse scope and complexity ranging from moderate...Full timeTemporary workWork at officeRemote workHome office$220k - $300k
Role Description The Lead Data Engineer on the Nebula team plays a significant technical leadership role in shaping and scaling the data foundation that powers analytics, reporting, AI development, and operational decision-making across the organization. This role combines...Local areaRemote workFlexible hours- ...Job Description Job Description Overview BigBear.ai is seeking a Lead Data Engineer to support one of our customer. This position will be based out of Washington, D.C. and will offer remote flexibility. You will be joining our amazing BigBear.ai team to...Temporary workRemote work
$130k - $150k
Role Description ~Must have 7+ years of relevant experience in Data Engineering and delivery. ~5+ years of relevant work experience in Big... .... Company Description EXL (NASDAQ: EXLS) is a leading data analytics and digital operations and solutions company....Full timeWork experience placement$160.56k - $193k
Role Description Lead Data Engineer, Fortune Brands Innovations Group, Inc., Deerfield, IL. ~Administer a cloud data warehouse platform (e.g., Snowflake or similar), including roles/permissions, performance tuning, security, & cost governance. ~Utilize Git for version...Full timeRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!












