Lead Data Engineer - Spark & PySpark Platform Lead
HILABS Inc
A cutting-edge healthcare data platform company is seeking a Lead Data Engineer with expertise in Big Data technologies. This role involves leading the end-to-end design of data platforms, and building scalable systems using Spark and PySpark. Candidates should have 6 to 10 years of experience in large-scale architecture and distributed systems. The position is onsite in Bethesda, Maryland, offering competitive salary and comprehensive benefits, along with opportunities for mentorship and growth. #J-18808-Ljbffr HILABS Inc
Vacancy posted 17 hours ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer - Spark & PySpark Platform Lead in Bethesda, MD vacancy
- ...looking for highly motivated and technically strong Lead Data Engineers with deep expertise in Big Data platforms and a passion for building scalable, data-... ...candidates will have strong hands-on experience in Spark, PySpark, distributed systems, and modern data ecosystem...PlatformRelocationRelocation package
- Capital One is hiring a Lead Data Engineer in McLean, VA to design, develop, and operate cloud‑... ...and full‑stack systems using Python, PySpark, AWS, and leading data warehousing tools... ...robust, high‑performant data platforms that empower financial services for millions...Platform
$229.9k - $262.4k
Senior Lead Data Engineer (Python, AWS, Spark, Kakfa, SQL, Snowflake, DynamoDB, Databricks, GenAI) Do you love building and pioneering in the technology... ...increasing business value. The team builds scalable platforms that deliver omnichannel messages in owned and paid Adtech...PlatformFull timePart timeInternshipLocal area- ...our customers with the data and insight to make smart... ...senior data engineers who share our passion for... ...Job Description You’ll lead a team that owns the AI... ...contribute to our data platform. The role also offers the... ...DataLakes. 3+ Knowledge of Spark, Python, or Scala Strong...Platform
Ex Parte
Bethesda, MD2 days ago $197.3k - $225.1k
Lead Data Engineer (Python, PySpark, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems... ...data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL). 4+ years experience working on real‑...SuggestedFull timeInternshipH1bLocal area$110.7k - $174.6k
...Summary Our Deloitte AI & Engineering team to transform technology platforms, drive innovation, and help make... ...through innovation.Work You’ll DoAs a Lead Data Engineer II on the AI & Data team... ...4+ years of experience with PySpark and extract, transform, load/extract...PlatformLocal area- ...Department Summary:MITRE’s Data Science and Engineering department is looking for qualified... ..., and maintainable data platforms and pipelines in cloud-... ..., as appropriate.Lead technical workstreams or complex... ...Data Architectures, such as Spark, Hadoop, Ray, DaskData Storage...PlatformInternshipLocal area
$130k - $150k
...We are seeking a proactive Lead AI & Data Analytics Engineer to support a federal... ...Foundry, Microsoft Power Platform, Advana, Jupiter, and Databricks... ...Databricks, SQL, Python, PySpark, or similar tools. Build... ...technologies (e.g. Databricks, Spark, Kafka, Hadoop, Snowflake,...PlatformFull timeContract workNavaide
Arlington, VAmore than 2 months ago- Responsibilities Lead the design, development... ...and maintain data products, dashboards... ...Microsoft Power Platform. Work within Advana... ...Databricks, SQL, Python, PySpark, or similar tools.... ...analytics, data engineering, platform... ...(e.g. Databricks, Spark, Kafka, Hadoop, Snowflake...PlatformContract work
- ...training facility, and leading market tools, we help our... ...variety of modern big data tools / approaches to... ...objectivesDevelop / update big data platform requirements to assess... ...of technical data engineering experience; U.S.... ...with Advana, Databricks, Spark preferred)Experience...PlatformLocal area
- ...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC -... ...pipelines using technologies such as AWS Glue, Spark, and Databricks. Optimize database... ...table enable us to grow as a global platform and they are causally linked with our...PlatformLong term contractWork at office
InterSources
McLean, VA4 days ago $138k - $185k
...Lead Consultant Data Engineer (DHS) Arlington, Virginia, United States Excella is a transformative... ...Create and automate data pipelines and platforms. Write clean, efficient, and well-... ...with big data technologies such as Spark, Kafka, and file formats like Parquet...PlatformWork from homeHome officeFlexible hoursExcella Consulting
Arlington, VA2 days ago$197.3k - $225.1k
Lead Data Engineer (Python, Scala, Spark) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big...Full timePart timeInternshipH1bLocal area- The Data Environments and Engineering Department (L176) in the Data and Human Centered... ...join our department as a Lead Data Engineer. Candidates... ...models Knowledge of cloud platforms and technologies such as Amazon... ...such as Kafka, NiFi, Spark, Airflow, and Hadoop. Familiarity...Platform
$197.3k - $225.1k
...Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Do you enjoy solving... ...computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) ~4+ years of experience...PlatformFull timePart timeInternshipH1bLocal areaCapital One
McLean, VA2 days ago$164k - $200k
...million people worldwide each year. As the leading medical society representing doctors... ...is in search of a high-performing Lead Data Engineer to play a vital role as a hands-on... ...applications, and operational workflows.Optimize Platform Cost & Performance: Continually refine...PlatformFull timeWork at officeWorldwideFlexible hours2 days per week1 day per week$229.9k - $262.4k
...Sr. Lead Data Engineer (Enterprise Platforms Technology)Do you love building and pioneering in the technology space? Do you enjoy solving complex business... .../computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, or MySQL)4+ year experience working on real-time data...PlatformFull timePart timeInternshipLocal areaCapital One
McLean, VA2 days ago- ...Big Data Platform Software EngineerLead, architect, design and develop secure, scalable, high... .... Provide technical leadership in Data Engineering practices. Partner with architecture,... ...measurable success. Drive meetings and lead discussions. Prioritize projects across...Platform
Software Technology Inc
Washington DC1 day ago $132k - $198k
...Two Six Technologies is seeking an experienced and motivated Lead Data Engineer to work within a cross-functional development team focused... ...that ensures consistent data exchange across different platform instances. Work closely with backend and database teams to...PlatformContract workWork at officeLocal areaTwo Six Technologies
Arlington, VA17 hours ago$229.9k - $262.4k
...Overview Senior Lead Data Engineer (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Do you enjoy solving... .../computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) ~4+ year experience working on real...PlatformFull timePart timeInternshipLocal areaCapital One
McLean, VA11 days ago$106.61k - $284.28k
...protecting customer, patient, member, and colleague data is fundamental to our mission. The Lead Data Privacy Engineer will play a critical role in advancing... ...databases, data lakes, and enterprise-scale data platforms. Demonstrated application of AI, automation,...PlatformHourly payFull timeTemporary workWork experience placementLocal areaCVS Health
Washington DC2 days ago- American Society of Clinical Oncology (ASCO) seeks a Lead Data Engineer to architect and implement scalable data pipelines for AI, analytics... ...drive cost-efficient, reliable data solutions across cloud platforms. #J-18808-Ljbffr American Society of Clinical Oncology (ASCO...Platform
- Two Six Technologies is seeking an experienced Lead Data Engineer to join a cross-functional team in Arlington, VA, focusing on mission tracking... .... The role centers on designing secure data sharing across platforms, aligning storage strategies, and maintaining complex data...Platform
- Capital One is looking for a Senior Lead Data Engineer in McLean, VA to spearhead data projects using Python, AWS, and Snowflake. You will collaborate with Agile teams to create innovative solutions that address real business challenges and enhance customer experiences...
- Capital One in McLean, VA seeks a Senior Lead Data Engineer to join Intelligent Foundations & Experiences. You will design, develop, and deploy data-driven solutions at scale, lead a team of engineers, and collaborate with product managers to deliver real-time analytics...Platform
$128.04k - $173.23k
...Required: None Job Family: Data Science and Data Engineering Job Qualifications: Skills:... ...projects and grow a rewarding career. The Lead Data Migration - Archival - DR... ...integrated data governance, engineering, data platform, reporting, analytics, and Artificial...PlatformFull timeTemporary workPart timeWork at officeImmediate startRemote workWorldwideFlexible hoursGDIT
Washington DC12 days ago$197.3k - $225.1k
...Lead Data Engineer - HR Tech Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems... ...Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) ~4+ year experience working on real-time...Full timePart timeInternshipH1bLocal areaCapital One
McLean, VA1 day ago$229.9k - $262.4k
...Senior Lead Data Engineer (Bank Tech)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems... ...data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)4+ year experience working on real-time...Full timePart timeInternshipLocal areaCapital One
McLean, VA1 day ago- Capital One is seeking a Lead Data Engineer to design, develop, test, and support Big Data solutions across Agile teams. You will work with Java, Scala, Python, and cloud data warehouses such as Redshift/Snowflake, mentoring engineers and driving performance improvements...
$159.1k - $265.1k
Our Deloitte AI & Engineering team works to transform technology platforms, drive innovation, and help make a significant... ...Work You'll Do As a Lead AI and Data Science Engineer II on the team... ...experience programming in Python, Pyspark, Pytorch, and Tensorflow. ~...PlatformLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer - Spark & PySpark Platform Lead. Be the first to apply!
Related searches
- platform engineer Bethesda, MD
- platform developer Bethesda, MD
- senior platform engineer Bethesda, MD
- data network cabling Bethesda, MD
- data capturer Bethesda, MD
- clinical data coordinator remote Bethesda, MD
- data tech Bethesda, MD
- data technician Bethesda, MD
- provider data management Bethesda, MD
- data recovery Bethesda, MD