Lead Data Engineer - Spark & PySpark Platform Lead
HILABS Inc
A cutting-edge healthcare data platform company is seeking a Lead Data Engineer with expertise in Big Data technologies. This role involves leading the end-to-end design of data platforms, and building scalable systems using Spark and PySpark. Candidates should have 6 to 10 years of experience in large-scale architecture and distributed systems. The position is onsite in Bethesda, Maryland, offering competitive salary and comprehensive benefits, along with opportunities for mentorship and growth. #J-18808-Ljbffr HILABS Inc
- ...looking for highly motivated and technically strong Lead Data Engineers with deep expertise in Big Data platforms and a passion for building scalable, data-... ...candidates will have strong hands-on experience in Spark, PySpark, distributed systems, and modern data ecosystem...PlatformRelocationRelocation package
- Capital One is hiring a Lead Data Engineer in McLean, VA to design, develop, and operate cloud‑... ...and full‑stack systems using Python, PySpark, AWS, and leading data warehousing tools... ...robust, high‑performant data platforms that empower financial services for millions...Platform
$229.9k - $262.4k
Senior Lead Data Engineer (Python, AWS, Spark, Kakfa, SQL, Snowflake, DynamoDB, Databricks, GenAI) Do you love building and pioneering in the technology... ...increasing business value. The team builds scalable platforms that deliver omnichannel messages in owned and paid Adtech...PlatformFull timePart timeInternshipLocal area$197.3k - $225.1k
Lead Data Engineer (Python, PySpark, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems... ...data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL). 4+ years experience working on real‑...SuggestedFull timeInternshipH1bLocal area- ...our customers with the data and insight to make smart... ...senior data engineers who share our passion for... ...Job Description You’ll lead a team that owns the AI... ...contribute to our data platform. The role also offers the... ...DataLakes. 3+ Knowledge of Spark, Python, or Scala Strong...Platform
$110.7k - $174.6k
...Summary Our Deloitte AI & Engineering team to transform technology platforms, drive innovation, and help make... ...through innovation.Work You’ll DoAs a Lead Data Engineer II on the AI & Data team... ...4+ years of experience with PySpark and extract, transform, load/extract...PlatformLocal area$197.3k - $225.1k
...Overview Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI) Do you love building and pioneering in the technology... ...increasing business value. The team builds scalable platforms that deliver omnichannel messages in owned and paid Adtech...PlatformFull timePart timeInternshipH1bLocal area- ...Department Summary:MITRE’s Data Science and Engineering department is looking for qualified... ..., and maintainable data platforms and pipelines in cloud-... ..., as appropriate.Lead technical workstreams or complex... ...Data Architectures, such as Spark, Hadoop, Ray, DaskData Storage...PlatformInternshipLocal area
$130k - $150k
...We are seeking a proactive Lead AI & Data Analytics Engineer to support a federal... ...Foundry, Microsoft Power Platform, Advana, Jupiter, and Databricks... ...Databricks, SQL, Python, PySpark, or similar tools. Build... ...technologies (e.g. Databricks, Spark, Kafka, Hadoop, Snowflake,...PlatformFull timeContract work- Responsibilities Lead the design, development... ...and maintain data products, dashboards... ...Microsoft Power Platform. Work within Advana... ...Databricks, SQL, Python, PySpark, or similar tools.... ...analytics, data engineering, platform... ...(e.g. Databricks, Spark, Kafka, Hadoop, Snowflake...PlatformContract work
- ...training facility, and leading market tools, we help our... ...variety of modern big data tools / approaches to... ...objectivesDevelop / update big data platform requirements to assess... ...of technical data engineering experience; U.S.... ...with Advana, Databricks, Spark preferred)Experience...PlatformLocal area
- ...advancement Training & development Lead Data Engineer – Azure Databricks Location:... ...and optimization of scalable cloud data platforms while establishing engineering standards... ...experience with Azure Databricks, Python, PySpark, SQL, ETL/ELT development, and modern...Platform
$197.3k - $225.1k
...Overview Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Do you enjoy... ...tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) ~4+ years of experience working...PlatformFull timePart timeInternshipH1bLocal area$229.9k - $262.4k
...Overview Senior Lead Data Engineer (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Do you enjoy solving... .../computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) ~4+ year experience working on real...PlatformFull timePart timeInternshipLocal area- Two Six Technologies is seeking an experienced Lead Data Engineer to join a cross-functional team in Arlington, VA, focusing on mission tracking... .... The role centers on designing secure data sharing across platforms, aligning storage strategies, and maintaining complex data...Platform
$128.04k - $173.23k
...Required: None Job Family: Data Science and Data Engineering Job Qualifications: Skills:... ...projects and grow a rewarding career. The Lead Data Migration - Archival - DR... ...integrated data governance, engineering, data platform, reporting, analytics, and Artificial...PlatformFull timeTemporary workPart timeWork at officeImmediate startRemote workWorldwideFlexible hours- Capital One in McLean, VA seeks a Senior Lead Data Engineer to join Intelligent Foundations & Experiences. You will design, develop, and deploy data-driven solutions at scale, lead a team of engineers, and collaborate with product managers to deliver real-time analytics...Platform
$128.04k - $173.23k
...Required: None Job Family: Data Science and Data Engineering Job Qualifications: Skills:... ...Required: No Job Description: Lead Data Engineer Seize your opportunity... ...integrated data governance, engineering, data platform, reporting, analytics, and Artificial...PlatformFull timeTemporary workPart timeWork at officeImmediate startRemote workWorldwideFlexible hours- Capital One is looking for a Senior Lead Data Engineer in McLean, VA to spearhead data projects using Python, AWS, and Snowflake. You will collaborate with Agile teams to create innovative solutions that address real business challenges and enhance customer experiences...
$132k - $198k
...Two Six Technologies is seeking an experienced and motivated Lead Data Engineer to work within a cross-functional development team focused... ...framework that ensures consistent data exchange across different platform instances. Work closely with backend and database teams to...PlatformContract workWork at officeLocal area$170.9k - $185k
Exceptional Hospitality Starts with YouJob title: Lead Data EngineerLocation: McLean, VA (position... .... Apply industry-standard software engineering principles throughout the lifecycle,... ...distributed computing frameworks, such as Apache Spark, Hadoop MapReduce, and Apache; and...Remote workWorldwide- Capital One is seeking a Lead Data Engineer to design, develop, test, and support Big Data solutions across Agile teams. You will work with Java, Scala, Python, and cloud data warehouses such as Redshift/Snowflake, mentoring engineers and driving performance improvements...
$159.1k - $265.1k
Our Deloitte AI & Engineering team works to transform technology platforms, drive innovation, and help make a significant... ...Work You'll Do As a Lead AI and Data Science Engineer II on the team... ...experience programming in Python, Pyspark, Pytorch, and Tensorflow. ~...PlatformLocal area- Capital One in McLean, VA is seeking a Lead Data Engineer to drive data platform initiatives across cloud and big data technologies, delivering scalable, secure solutions for customers nationwide. You will collaborate with agile teams and engineers skilled in Java, Python...Platform
$197.3k - $225.1k
Lead Data Engineer - Intelligent Foundations and Experiences (IFX) As a Lead Data Engineer at Capital One, you will join an interdisciplinary... ...computing tools such as MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL. 4+ years of experience in real‑time data and...Full timeLocal area$197.3k - $225.1k
Lead Data Engineer - IC Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast... ...4+ years experience with Distributed data/computing tools (Spark, MapReduce, Hadoop, Hive, EMR, Kafka, Gurobi, or MySQL) 4+ years...InternshipH1bLocal area- Lead Data Engineer - Nexus Data Products Lead Data Engineer at Capital One will craft and pioneer data solutions in a fast-paced, collaborative... ...data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL). 4+ years experience working on real-time...InternshipLocal area
- Capital One is seeking a Sr. Lead Data Engineer in McLean, VA, to innovate at the forefront of technology within the organization. You will... ...development experience, particularly with data movement, cloud platforms, and programming languages like Python and SQL. The position...Platform
- Capital One in McLean, VA is seeking a Lead Data Engineer for Intelligent Foundations and Experiences. In this role, you'll work with Agile teams... ...in data engineering, with proven expertise in AWS, Spark, and data warehousing solutions like Redshift and Snowflake....Full time
$229.9k - $262.4k
Capital One is seeking a Senior Lead Data Engineer to join their team in McLean, Virginia. This role involves designing and implementing technical solutions by collaborating with Agile teams and leading developers in machine learning and cloud technologies. The ideal candidate...Platform
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer - Spark & PySpark Platform Lead. Be the first to apply!
- platform engineer Bethesda, MD
- platform developer Bethesda, MD
- senior platform engineer Bethesda, MD
- data network cabling Bethesda, MD
- data capturer Bethesda, MD
- clinical data coordinator remote Bethesda, MD
- data tech Bethesda, MD
- data technician Bethesda, MD
- provider data management Bethesda, MD
- data recovery Bethesda, MD

