Lead Data Engineer - Spark & PySpark Platform Lead
HILABS Inc
A cutting-edge healthcare data platform company is seeking a Lead Data Engineer with expertise in Big Data technologies. This role involves leading the end-to-end design of data platforms, and building scalable systems using Spark and PySpark. Candidates should have 6 to 10 years of experience in large-scale architecture and distributed systems. The position is onsite in Bethesda, Maryland, offering competitive salary and comprehensive benefits, along with opportunities for mentorship and growth. #J-18808-Ljbffr HILABS Inc
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer - Spark & PySpark Platform Lead in Bethesda, MD vacancy
- ...looking for highly motivated and technically strong Lead Data Engineers with deep expertise in Big Data platforms and a passion for building scalable, data-... ...candidates will have strong hands-on experience in Spark, PySpark, distributed systems, and modern data ecosystem...PlatformRelocationRelocation package
$229.9k - $262.4k
Senior Lead Data Engineer (Python, AWS, Spark, Kakfa, SQL, Snowflake, DynamoDB, Databricks, GenAI) Do you love building and pioneering in the technology... ...increasing business value. The team builds scalable platforms that deliver omnichannel messages in owned and paid Adtech...PlatformFull timePart timeInternshipLocal area- ...our customers with the data and insight to make smart... ...senior data engineers who share our passion for... ...Job Description You’ll lead a team that owns the AI... ...contribute to our data platform. The role also offers the... ...DataLakes. 3+ Knowledge of Spark, Python, or Scala Strong...Platform
$138k - $185k
...exceptional professionals for this role. Lead Consultant Data Engineer (DHS) Arlington, Virginia, United... ...and automate data pipelines and platforms. Write clean, efficient, and well-... ...experience with big data technologies such as Spark, Kafka, and file formats like Parquet...PlatformWork from homeHome officeFlexible hoursExcella
Arlington, VA18 days ago$130k - $150k
...We are seeking a proactive Lead AI & Data Analytics Engineer to support a federal... ...Foundry, Microsoft Power Platform, Advana, Jupiter, and Databricks... ...Databricks, SQL, Python, PySpark, or similar tools. Build... ...technologies (e.g. Databricks, Spark, Kafka, Hadoop, Snowflake,...PlatformContract work- Total Wine & More is seeking a Lead Data Engineer (Warehousing) to lead the next evolution of the Enterprise Data & Analytics Platform at our Bethesda, MD HQ. You will partner with data services teams to deliver reports, datasets, and predictive models, while building robust...Platform
$210.6k
...Services and Systems, Inc. (dba Total Wine & More) is seeking a Lead Data Engineer (Warehousing) to work at our Bethesda, MD HQ. You will... ...develop vision for next evolution of Enterprise Data & Analytics Platform. Partner with Data Services product owners, data warehouse...PlatformHourly payMinimum wage- The Data Environments and Engineering Department (L176) in the Data and Human Centered... ...join our department as a Lead Data Engineer. Candidates... ...models Knowledge of cloud platforms and technologies such as Amazon... ...such as Kafka, NiFi, Spark, Airflow, and Hadoop. Familiarity...Platform
- ...Lead Data Engineer (Python, AWS, SQL, GenAI) Enterprise Platforms Technology (EPTech) is a group that establishes best practices for building technology solutions... ...computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4+ years working on real‑time...PlatformInternshipLocal area
SwiftCruit
McLean, VA1 day ago $179.4k - $204.7k
Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Do you enjoy solving complex... ...application development including Python, SQL, Spark, ETL tools, AWS Glue 4+ years of experience with...PlatformFull timePart timeInternshipH1bLocal area- Capital One is seeking a Senior Lead Data Engineer to drive the Intelligent Foundations & Experiences... ..., build, and optimize cloud-based data platforms and real-time analytics. You'll... ...and work with Redshift/Snowflake, Hadoop/Spark, and NoSQL, ensuring scalable, robust solutions...Platform
- FINRA is looking for a Lead Software Engineer to drive the development of software products while mentoring other engineers. This role requires strong expertise in big data technologies and cloud services, with a focus on improving software quality and efficiency. The ideal...
$229.9k - $262.4k
Sr. Lead Data Engineer (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Do you enjoy solving complex business... .../computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, or MySQL) 4+ years of experience working on real-time...PlatformFull timePart timeInternshipLocal area- Rividium Inc. is searching for a Data Engineering Lead (Advanced Analytics) in Alexandria, Virginia. This role supports various IT and data... ...the integrity and structure of data while coordinating with platform teams. The ideal candidate should possess a Bachelor's degree...Platform
- Capital One in McLean, VA seeks a Senior Lead Data Engineer to join Intelligent Foundations & Experiences. You will design, develop, and deploy data-driven solutions at scale, lead a team of engineers, and collaborate with product managers to deliver real-time analytics...Platform
- Capital One is looking for a Senior Lead Data Engineer in McLean, VA to spearhead data projects using Python, AWS, and Snowflake. You will collaborate with Agile teams to create innovative solutions that address real business challenges and enhance customer experiences...
- ...training facility, and leading market tools, we help our... ...variety of modern big data tools / approaches to... ...Develop / update big data platform requirements to assess... ...of technical data engineering experience; U.S. Federal... ...with Advana, Databricks, Spark preferred) Experience...PlatformFull timeLocal area
KPMG
Washington DC13 days ago - SwiftCruit is seeking a Lead Data Engineer with strong skills in Python, AWS, and SQL. This role involves collaborating across Agile teams... ...be proficient with big data technologies and cloud computing platforms. Join us to innovate and empower millions of Americans! #J-...Platform
$197.3k - $225.1k
...Overview Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Do you enjoy... ...tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) ~4+ years of experience working...PlatformFull timePart timeInternshipH1bLocal area$159.1k - $265.1k
Our Deloitte AI & Engineering team works to transform technology platforms, drive innovation, and help make a significant... ...Work You'll Do As a Lead AI and Data Science Engineer II on the team... ...experience programming in Python, Pyspark, Pytorch, and Tensorflow. ~...PlatformLocal area$197.3k - $225.1k
...Lead Data Engineer - HR Tech Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in... ...Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4+ year experience working on real-time...Full timePart timeInternshipH1bLocal areaCapital One National Association
McLean, VA16 hours ago$161k - $266k
...governments realize their greatest potential. Title and Summary Lead Data & AI Security Engineer Mastercard is a global technology company in the... ...code/systems for vulnerabilities. Experience with cloud platforms, APIs, and distributed systems preferred. Leadership...PlatformWorldwide- Capital One is seeking a Senior Lead Data Engineer for its Bank Tech division. You will design and deliver scalable data solutions, lead developers... ...strong Java, Python, Scala skills plus 2+ years in cloud platforms and 4+ years in big data tools. This role emphasizes...Platform
- Capital One is seeking a Lead Data Engineer for Enterprise Platforms Technology in McLean, VA. You will design, develop, test, and support data-driven solutions across cloud-based and on-premises environments, collaborating with Agile teams and ML-focused developers to...Platform
- Capital One is seeking a Sr. Lead Data Engineer in McLean, VA, to innovate at the forefront of technology within the organization. You will... ...development experience, particularly with data movement, cloud platforms, and programming languages like Python and SQL. The position...Platform
$229.9k - $262.4k
Capital One National Association is seeking a Sr. Lead Data Engineer to drive a major transformation within the company. This role involves collaborating with Agile teams to develop solutions using emerging technologies like data movement tools and cloud services. The...Platform$193.4k - $220.7k
Capital One in McLean, VA is seeking a Lead Data Engineer to build innovative data solutions in a fast-paced environment. The ideal candidate will collaborate with Agile teams and work with advanced technologies, building solutions that empower millions of customers. This...Platform$193.4k - $220.7k
Lead Data Engineer (Intelligent Foundations and Experiences) Do you love building and pioneering in the technology space? Do you enjoy solving... ...data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL). 4+ years of experience working on real-time...Full timePart timeInternshipLocal area$197.3k - $225.1k
Lead Data Engineer - Intelligent Foundations and Experiences (IFX) As a Lead Data Engineer at Capital One, you will join an interdisciplinary... ...computing tools such as MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL. 4+ years of experience in real‑time data and...Full timeLocal area- Capital One is seeking a Lead Data Engineer to join the Intelligent Foundations & Experiences group. You will collaborate with agile teams to design, develop, test, and support full-stack data solutions, working with ML, distributed microservices, and cloud data warehousing...Platform
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer - Spark & PySpark Platform Lead. Be the first to apply!
