Senior Spark Platform Engineer: Scale & Reliability
Doordashusa
DoorDash is hiring a Senior Software Engineer to lead the Spark Platform, setting the long-term direction for our in-house Spark deployment. You will shape architecture spanning runtime, shuffle service, and scheduler, ensuring reliability at scale across data, analytics, and ML workloads.
You will partner with the Engineering Manager on roadmap, hiring, and team development, and mentor others while driving collaboration with Data Engineering, ML Platform, and product teams.
#J-18808-LjbffrVacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the Senior Spark Platform Engineer: Scale & Reliability in San Francisco, CA vacancy
- ...Pivotal Health in San Francisco is seeking a Senior Platform Engineer to design, scale, and harden the foundation powering our platform. You will... ...engineering teams to evolve cloud architecture, improve reliability and security, and ensure scalable, event-driven systems...Senior
Pivotal Health
San Francisco, CA7 hours ago - A leading IoT infrastructure provider in San Francisco is seeking a Senior Platform Engineer. In this role, you will own the systems that drive engineering productivity and reliability. You will focus on building TypeScript tooling, optimizing PostgreSQL, and ensuring...Senior
- About the TeamThe Spark Platform team owns and operates DoorDash's... ...service, cluster scheduler, and reliability tooling that powers the... ...company at significant scale and continue to expand the... ...tooling.About the RoleAs a Senior Software Engineer on Spark Platform, you will...SeniorHourly payWork at officeLocal areaRemote workRelocationFlexible hours
- ...Crusoe is looking for a Senior Software Engineer in San Francisco to design, build, and scale their billing platform. This role is vital for delivering accurate and reliable billing experiences. Candidates should have experience in complex billing systems and a strong...Senior
Crusoe
San Francisco, CA7 hours ago - ...A leading market intelligence firm is seeking an experienced engineering leader to transform AI-powered systems. Responsibilities include designing scalable distributed systems, mentoring engineers, and collaborating with ML teams. Ideal candidates have 7+ years in distributed...Senior
AlphaSense, Inc.
San Francisco, CA7 hours ago - ...Lightning AI is seeking a Senior Software Engineer to design, build, and scale core backend services that power Lightning AI... ...and AI engineering teams to improve reliability, scalability, and developer experience across the platform. You will work on authentication,...Senior
Lightning-Ai
San Francisco, CA7 hours ago - ...Persona is seeking a Senior Engineer for the Data Platform team in San Francisco, California. In this role,... ...systems that manage data at massive scale, working on datalakes and data pipelines... ...teams to ensure performance, reliability, and cost efficiency of the platform...SeniorFull time
Persona
San Francisco, CA7 hours ago - ...security, delivering an AI-powered platform that governs and secures... ...systems. As a Staff Platform Engineer, you will play a critical... ...leadership role. You will own reliability for major platform domains, design... ...• Work on a large-scale, cloud-native SaaS platform...Senior
Saviynt
San Francisco, CAa month ago - ...Harvey is building the AI platform trusted by the world’s leading law firms and... ...enterprises. We’re seeking a Production Engineer to design, operate, and scale Harvey’s global compute and... ...production foundations. You will improve reliability, capacity planning, automation, and...Senior
Harvey
San Francisco, CA7 hours ago - About the RoleWe’re looking for an experienced Site Reliability Engineer (SRE) to help us scale our platform with reliability, observability, and operational... ...AWS)Experience supporting data-intensive platforms (Spark, Airflow, Kafka, etc.)Familiarity with security practices...Senior
$215k - $275k
...any developer or data scientist can scale an ML application from their laptop to... ...About the role:Anyscale is looking for a Senior Site Reliability Engineer to join the Infrastructure team.... ...infrastructure that powers Anyscale’s cloud platform.You will have the opportunity to work...SeniorWork at office- Modal Labs is expanding its infrastructure team in NYC and Stockholm to scale our reliable cloud platform and production systems for a rapidly growing customer base. We seek deep systems thinkers who enjoy stacking nines, own reliability, and can operate Kubernetes, Postgres...
- ...is the pioneering Causal AI platform. We help the world's largest... ...to perform under real-world scale, reliability, and security demands — and we're looking for an engineer who wants to own the foundation... ...with data-intensive platforms (Spark, Airflow, Kafka) and storage...Senior
- ...Apple Service Engineering (ASE) seeks a senior SRE software engineer to own the architectural direction... ...controllers and namespace management, raise reliability, and contribute to upstream... ...functional teams to shape the Compute roadmap and ensure scale. #J-18808-Ljbffr...Senior
Socket.dev
San Francisco, CA7 hours ago $191.4k - $252.72k
A leading data and AI company is looking for a Senior Staff Technical Program Manager - Reliability to lead key initiatives across engineering teams. This role requires managing large-scale programs, defining strategic roadmaps, and driving the adoption of reliability...Senior$232k - $319k
...too, let's talk.The Infrastructure Platform and Shared Services TeamOkta... ...technical leader to help us continue to scale the service with great people and reliable, cost-effective, and efficient... ...the velocity of SRE and product engineering by developing robust platforms, powerful...SeniorPermanent employmentLocal areaWorldwideFlexible hours$156.06k - $211.14k
Afresh, the AI platform for grocery, began by tackling... ...in 2025, we have scaled to 6 enterprise-grade... ...feed them is not.As a Senior AI Platform Engineer, you build the AI and... ...that makes grocery data reliably usable by LLMs, the... ...stack (Databricks/Spark, MLflow, cloud warehouses...SeniorFull timeLive inWork at officeLocal areaRemote workWork from homeHome officeFlexible hours3 days per week$210.8k - $272.8k
...Thumbtack is hiring for a Site Reliability Engineer to enhance the reliability and scalability of our services in San Francisco, CA. You'll... ...help shape our engineering capabilities and promote a robust platform. Salary for this role ranges from $210,800 to $272,800 based...SeniorThumbtack
San Francisco, CA7 hours ago$295k - $405.5k
...technology wholesale platform built on the... ...About this roleAs the Senior Staff Machine Learning Platform Engineer, you will own the... ...science velocity at scale. This role will... ...ML workflows using Spark, Delta Lake, and MLflowOptimize... ...performance, reliability, and cost of the...SeniorWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per week$190.8k - $267.1k
...Reddit, Inc. is seeking a Senior Engineer for the Core Platform team to develop innovative solutions for scaling Reddit. You will mentor junior engineers and work on platform API projects that impact millions of users worldwide. The ideal candidate will have 5+ years...SeniorRemote workWorldwideReddit, Inc.
San Francisco, CA7 hours ago- ...BuildOps is seeking a Senior Software Engineer to design, build, and scale product features across frontend and backend systems. You will own projects end... ...well-tested code. You will mentor teammates and drive reliability using AI-driven tooling. You’ll work in a fast-...Senior
BuildOps
San Francisco, CA7 hours ago - A leading AI research company in San Francisco is seeking a software engineer for its Fleet High Performance Computing team. In this role, you'll ensure the reliability and uptime of the compute fleet, working with automation systems and monitoring tools. Ideal candidates...Senior
- ...Discord is seeking a Software Engineer to help build the next generation Data Platform that powers decisions for millions of gamers worldwide. You will join a... ...and the modern data stack. Join us to help gamers connect and create communities at scale. #J-18808-LjbffrSeniorWorldwide
EngineersOfAI
San Francisco, CA7 hours ago - ...Discord is seeking a senior software engineer to help build a scalable data platform that powers decisions for millions of gamers worldwide. You will own data ingestion... ..., Rust, or Go, and hands-on expertise in large-scale data infrastructure such as pipelines, streaming,...SeniorWorldwide
Triwill Group
San Francisco, CA7 hours ago - APPIT Software Solutions is hiring a Senior Data Engineer (Apache Spark) in San Francisco, USA . Lead the design of large-scale distributed data processing systems using Apache Spark and cloud platforms at APPIT Software in San Francisco. Responsibilities Architect and...SeniorFlexible hours
$140k - $200k
...foundational member of our engineering team: a highly... ...of our data platform. You will be part... ...: Develop and scale robust, fault-tolerant... ...jobs, ensuring reliability, monitorability,... ...such as Spark, Flink, or Dask.... ...Lake, Iceberg). Seniority level Mid-Senior...SeniorFull time- DescriptionWe are looking for a Senior or Staff level Site Reliability Engineer to strengthen the reliability, scalability... ..., and operational maturity of our platform in San Francisco, California. This... ...distributed systems at scale.• Hands-on experience with observability...Senior
$230k - $265k
...they need through the platforms they already sell on.... ...looking for a software engineer to join Parafin’s Infrastructure... ...critical to building reliable, scalable, and... ...platform. Stand up and scale low-latency model serving... ...Proficiency with SQL; hands-on Spark/PySpark experience. ~...SeniorFull timeWork from homeFlexible hoursParafin
San Francisco, CA1 day ago$152.5k - $205k
...the world’s leading internet financial platform companies, building the foundation of... ...Circle to power trusted, internet-scale financial innovation. Learn more at circle... ....What you’ll be responsible for:As a Senior Site Reliability Engineer on Circle’s platform team, you’ll...SeniorFlexible hours$155k - $400k
...the roleThe Streaming Platform team at Sentry is building... ...low latency and high reliability. We are creating a... ...makes it easy for Sentry engineers to deploy and run Streaming Applications at scale by simplifying the... ...such as Kafka, Flink, Spark Streaming, or similar...SeniorWork experience placement
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Spark Platform Engineer: Scale & Reliability. Be the first to apply!
Related searches
- platform engineer San Francisco, CA
- platform engineering manager San Francisco, CA
- client platform engineer San Francisco, CA
- platform developer San Francisco, CA
- senior platform engineer San Francisco, CA
- data platform engineer San Francisco, CA
- senior lead project manager San Francisco, CA
- senior robotics software engineer San Francisco, CA
- senior devops engineer remote San Francisco, CA
- senior sas administrator San Francisco, CA