Senior Distributed Systems Engineer for Inference Platform
Jobleads-US
Hedra Inc. in San Francisco is seeking a Senior or Staff Software Engineer with deep expertise in building and operating distributed production systems.
You will work on Hedra’s inference infrastructure, designing and operating systems that schedule, route, and manage compute-intensive workloads across diverse resources. The role emphasizes reliability, performance, and cost efficiency, requiring you to reason from first principles and drive thoughtful tradeoffs.
#J-18808-Ljbffr Jobleads-US- ...Baseten powers mission-critical inference for AI companies, uniting research, flexible infrastructure, and developer... ...performance, scalability, and reliability across the platform. As a distributed systems engineer on the Inference Platform, you will own end-to-end projects...PlatformFlexible hours
- ...Baseten is hiring distributed systems engineers to build the runtime that powers large-scale LLM inference. You will deploy and operate Model APIs, routing, autoscaling, and orchestration on Kubernetes, while focusing on speed, reliability, and cost efficiency. You...Platform
- Senior AI Engineer, MLOps & Distributed SystemsThe OpportunityJoin the team building the intelligence... ...pod is creating the systems that determine what... ...reliable online and batch inference capabilities that meet... ...or operating MLOps or ML platform capabilities, such as inference...PlatformSeniorFull timeInternshipWork at officeLocal areaRemote workWorldwide3 days per week
- ...Hedra Hedra is the platform, models, and... .... We build the systems that make large-scale visual inference fast, reliable, and... ...leading investors. Engineers at Hedra work across... ...’re looking for a Senior or Staff Software... ...and operating distributed production systems...PlatformSeniorWork at office
- ...Tubi is seeking a Staff Software Engineer for the ML Infrastructure team to build world-class ML inference platforms powering recommendations, search, and content understanding. You will advance low-latency model serving, feature/vector stores, and experimentation engines...Platform
- ...Atlassian products and platforms. We aim to deliver... ...and Conversational AI system that integrates seamlessly... ...About This RoleAs a Senior ML System Engineer on the AI & ML Platform’s Inference team, you will design... ...will own everything from distributed infrastructure (global...PlatformSeniorWork at officeLocal area
- ...Databricks is seeking a Senior Software Engineer for the Files team to push the boundaries of storage and distributed systems. You will shape the filesystem strategy to power agentic workloads and data-centric platforms, collaborating across platform teams. You will...PlatformSenior
- ...Databricks is seeking a Senior Software Engineer for the Files team to innovate at the intersection of storage, performance, and distributed systems. You will shape our filesystem strategy to... ...and operate scalable filesystem platforms, optimize performance from API to...PlatformSenior
- ...Search PlatformThe Search Platform team is responsible... ...agentic search systems, addressing tail latency... ...query processing, and ML inference. Turn advances in... ...fragmented systems, mentor senior engineers, and align technical... ...operations.Strong distributed-systems expertise...PlatformSeniorWork at officeLocal area
$148.5k - $223.9k
...immediate opportunities for senior software developers... ...in developing distributed filesystems in an ever... ...of users of our cloud platform. Build efficient components... ...review, mentoring junior engineers, and providing... ...developing distributed systems at scale. - Proficiency...PlatformSeniorFull timeImmediate start- ...Beam is an ultrafast AI inference platform. We built a serverless runtime... ...to help us with Platform Engineering work. We’re working on lots... ...fun problems: Low‑level systems development: working with container... ...working with a large distributed system ~ Comfortable with...Platform
$166k - $225k
...best data and AI infrastructure platform so our customers can use deep data... ...improve their business. Founded by engineers — and customer obsessed — we leap... ...be building the next generation distributed data storage and processing systems that can outperform specialized...PlatformSeniorLocal areaWorldwide- ...Sierra is the leading platform for customer-facing AI agents, based in San Francisco. We are seeking a Software Engineer on the Inference team to define architectures for self-hosted... ...at scale. You will work across distributed systems to build, optimize, and operate...Platform
- ...Modal is seeking a systems engineer to advance the container runtime stack used for inference workloads, working close to Linux, containers... ..., storage, GPU drivers, and distributed systems. You will build... ...architecture of Modal’s container platform. You will also collaborate...Platform
$152k
About the roleWe are seeking an experienced Senior Systems Engineer to own our macOS platform and drive endpoint management and device trust standards across... ...documentation that scales understanding across a distributed team.Nice-to-haveJamf Certified Admin (300/400) or equivalent...PlatformSeniorFull timeWork at officeLocal areaRemote workShift work$117k - $161k
...mission. If you are too, let's talk.The Senior Systems Engineer OpportunityAs a Senior Systems... ...for root-cause trends while solving platform problems, devising solutions based on... ...fast-paced environment supporting a distributed, global company.Governance Mindset: A...PlatformSeniorPermanent employmentLocal areaWorldwideFlexible hours$180k - $240k
...Senior Systems Engineer We are looking for a Senior Systems Developer to lead the design, development... ..., and operation of large-scale distributed systems powering high-performance infrastructure... ..., partnering closely with platform, networking, and hardware teams to deliver...PlatformSeniorFlexible hours$180k - $230k
San Francisco, CAProduct Systems Engineering - Product Systems /Full time... ...traditional space mission.As a Senior Product Systems Engineer at... ...You will define how Loft's platform is structured, how... ...software-heavy systems, including distributed components, APIs,...PlatformSeniorFull timeTemporary work- ...Description ThisWay Global is looking for a Distributed Systems Engineer in a remote role within the United States. ThisWay Global, Inc. is... ...business areas: ADCAP — AI & Data Center Acceleration Platform: A data center development and operations platform supporting...PlatformFull timeRemote work
$272k - $336k
...Waymo Systems Engineering RoleWaymo is an autonomous driving technology company with the mission... ...also be applied to a range of vehicle platforms and product use cases. The Waymo Driver... ...and process data from massive, distributed relational/non-relational databasesProven...PlatformSeniorOdd jobFull timeRemote work- ...into action. We’re looking for engineers who want to build the operating system for AI Data Applications and... ...We're looking for experienced distributed systems engineers to build the core... ...is primarily in DevOps, SRE, or platform operations (Terraform, Kubernetes...Platform
- ...Distributed Systems EngineerAs a distributed systems engineer, you'll work across the stack to solve problems as they come up and help build Archil volumes. You... ...the cloud, by building the next, default storage platform in the cloud.Over the past 15 years, S3 has become...PlatformFlexible hours
$165k - $200k
...at Crusoe. About This Role As a Senior Systems Engineer, you’ll play a key role in building and... ...off-hours syncs to support distributed operations What You’ll Bring to the... ...Lumos or similar identity governance platforms ~ Proven ability to build automation...PlatformSeniorFull timeTemporary work$175k - $300k
...forward. The Production Engineering Team Examples of key exciting... ...: build the observability platform that turns raw telemetry... ...actual state inspection, and distributed command execution. One interface... ...scripts. Make the system's view of itself always match...PlatformLocal area$200k - $300k
...take action inside enterprise systems is hard. The moment an agent... ..., and trust become the real engineering challenge. Arcade is the... ...tools catalog, actions platform, and governance model that will... ...authentication, integrations, distributed systems, and AI experts from...PlatformWork at officeShift work$190k - $230k
...About This Role We’re seeking a Senior Systems Engineer to play a key role in executing Crusoe... ...enterprise systems, and integration platforms—building scalable agent workflows, enabling... ...~ Experience designing scalable, distributed systems in cloud environments (AWS, GCP...PlatformSeniorFull timeTemporary work$159.2k - $301.6k
The Opportunity We are looking for a Senior AI Systems Engineer with deep C++ expertise to help build... ...generation of AI-enabled product and platform capabilities. This role sits at the intersection... ...and tracing for AI systems or distributed systems. Experience with privacy-...PlatformSeniorFull timeTemporary workLocal areaRemote workWorldwide$185.5k - $232k
...Senior Site Reliability Engineer New York, NY; Boston, MA; San Francisco... ...built technology platforms, processes, and... ...infrastructure, delivery systems, and operational... ..., ML pipelines, inference, and agentic software... ...infrastructure and distributed systems, with strong...PlatformSeniorWork experience placementWork at officeLocal areaRelocation3 days per week$250k
...next-generation GPU platform designed for AI... ...experimentation, and inference at scale. The company... ...is looking for a Senior / Staff Site Reliability Engineer to support and scale... ...observability across distributed compute... ...available infrastructure systems Improve CI/CD pipelines...PlatformSeniorFull timeRemote work- ...Hitachi Rail is looking for an enthusiastic self-motivated Senior System Engineer who thrives in a fast-paced environment. The position is based... ...Management Systems. Our systems work within enterprise platforms utilising message brokers, canonical data models and utilising...PlatformSeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Distributed Systems Engineer for Inference Platform. Be the first to apply!
- senior linux systems engineer San Francisco, CA
- system engineer contract San Francisco, CA
- data systems engineer San Francisco, CA
- senior staff systems engineer San Francisco, CA
- microsoft systems engineer San Francisco, CA
- operations support system engineer San Francisco, CA
- advanced systems engineer San Francisco, CA
- software system engineer San Francisco, CA
- space systems engineer San Francisco, CA
- electronic systems engineer San Francisco, CA



