Senior Distributed Systems Engineer for Inference Platform
Hedra Inc.
Hedra Inc. in San Francisco is seeking a Senior or Staff Software Engineer with deep expertise in building and operating distributed production systems. You will work on Hedra’s inference infrastructure, designing and operating systems that schedule, route, and manage compute-intensive workloads across diverse resources. The role emphasizes reliability, performance, and cost efficiency, requiring you to reason from first principles and drive thoughtful tradeoffs. #J-18808-Ljbffr Hedra Inc.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Distributed Systems Engineer for Inference Platform in San Francisco, CA vacancy
- Baseten powers mission-critical AI inference at scale. We seek distributed systems engineers to own the runtimes and APIs that run large-scale LLM inference and hosted endpoints. You’ll work across the stack from developer tooling to orchestration on Kubernetes, driving...PlatformSenior
- ...Atlassian, we are seeking an ML System Engineer to join the AI & ML Platform Inference team. You will design and optimize... ...model serving systems from distributed infrastructure to low-level performance... .... You will collaborate with senior ML engineers to fine-tune and deploy...PlatformSenior
- ...Hedra Hedra is the platform, models, and... ...intelligence. We build the systems that make large-scale visual inference fast, reliable,... ...investors. Engineers at Hedra work across... ...’re looking for a Senior or Staff Software... ...building and operating distributed production systems...PlatformSeniorWork at office
- Senior AI Engineer, MLOps & Distributed SystemsThe OpportunityJoin the team building the intelligence... ...pod is creating the systems that determine what... ...reliable online and batch inference capabilities that meet... ...or operating MLOps or ML platform capabilities, such as inference...PlatformSeniorFull timeInternshipWork at officeLocal areaRemote workWorldwide3 days per week
Hinge Health
San Francisco, CA2 days ago - ...Search PlatformThe Search Platform team is responsible... ...agentic search systems, addressing tail latency... ...query processing, and ML inference. Turn advances in... ...fragmented systems, mentor senior engineers, and align technical... ...operations.Strong distributed-systems expertise...PlatformSeniorWork at officeLocal area
Atlassian
San Francisco, CA4 days ago $148.5k - $223.9k
...immediate opportunities for senior software developers... ...in developing distributed filesystems in an ever... ...of users of our cloud platform. Build efficient components... ...review, mentoring junior engineers, and providing... ...developing distributed systems at scale. - Proficiency...PlatformSeniorFull timeImmediate startSalesforce
San Francisco, CA4 days ago- Sigma Computing is seeking a Senior Software Engineer - Backend to build distributed backend services and APIs for our cloud data analytics platform. You will work on high-performance systems for interactive data exploration and analysis, using Rust, Go, GraphQL, Node,...PlatformSenior
- Sierra is building a leading platform for customer-facing AI... ...We are seeking a Software Engineer on Inference to define Sierra’s inference... ...reliable, and cost-efficient systems. This role is a systems-first position intersecting distributed infrastructure and AI, requiring...Platform
- Rippling is seeking a backend engineer to help evolve distributed processing engines and databases. You will work across product and platform layers, delivering scalable services used by 10+ product teams. You will write testable, high-performance backend code in Python...PlatformSenior
$166k - $225k
...best data and AI infrastructure platform so our customers can use deep data... ...improve their business. Founded by engineers — and customer obsessed — we leap... ...be building the next generation distributed data storage and processing systems that can outperform specialized...PlatformSeniorLocal areaWorldwideDataBricks
San Francisco, CA2 days ago- ...Tuesday Information Systems at Lambda is responsible... ...—Finance, GTM, Engineering, and People—to implement... ..., integrations, data platform and analytics, compliance... ...for large-scale distributed systems. Engage in service... ...latency, and control inference costs across teams....PlatformSeniorWork at officeLocal areaWork from homeFlexible hours
- TypeSafe AI, a San Francisco-based AI lab, is seeking a senior backend engineer to own the API platform for inference. You will work across distributed systems and networking, helping ensure latency, uptime, and backward compatibility while writing robust backend services...PlatformSeniorWork at office
$152k
About the roleWe are seeking an experienced Senior Systems Engineer to own our macOS platform and drive endpoint management and device trust standards across... ...documentation that scales understanding across a distributed team.Nice-to-haveJamf Certified Admin (300/400) or equivalent...PlatformSeniorFull timeWork at officeLocal areaRemote workShift workChime
San Francisco, CA2 days ago$117k - $161k
...mission. If you are too, let's talk.The Senior Systems Engineer OpportunityAs a Senior Systems... ...for root-cause trends while solving platform problems, devising solutions based on... ...fast-paced environment supporting a distributed, global company.Governance Mindset: A...PlatformSeniorPermanent employmentLocal areaWorldwideFlexible hoursOkta
San Francisco, CA16 hours ago- TypeSafe is seeking a senior backend engineer to build and maintain its API platform for inference. You’ll work on latency‑sensitive, user‑facing services with uptime... ...backward compatibility requirements across distributed systems and networking. Our stack includes Python,...PlatformSeniorWork at office
$180k - $230k
San Francisco, CAProduct Systems Engineering - Product Systems /Full time... ...traditional space mission.As a Senior Product Systems Engineer at... ...You will define how Loft's platform is structured, how... ...software-heavy systems, including distributed components, APIs,...PlatformSeniorFull timeTemporary workLoft Orbital
San Francisco, CA16 hours ago- ...into action. We're looking for engineers who want to build the operating system for AI Data Applications and... ...We're looking for experienced distributed systems engineers to build the core... ...is primarily in DevOps, SRE, or platform operations (Terraform, Kubernetes...Platform
Tensorlake, Inc.
San Francisco, CA2 days ago $272k - $336k
...Waymo Systems Engineering Role Waymo is an autonomous driving technology company with the mission... ...also be applied to a range of vehicle platforms and product use cases. The Waymo... ...extract and process data from massive, distributed relational/non-relational databases...PlatformSeniorOdd jobFull timeRemote workLatent Logic
San Francisco, CA4 days ago- ...the world. The Production Engineering Team Examples of key... ...time: build the observability platform that turns raw telemetry into... ...actual state inspection, and distributed command execution. One... ...hundred scripts. Make the system's view of itself always match...PlatformLocal area
Fluidstack
San Francisco, CA5 days ago $230k
...take action inside enterprise systems is hard. The moment an agent... ..., and trust become the real engineering challenge. Arcade is the... ...tools catalog, actions platform, and governance model that will... ...authentication, integrations, distributed systems, and AI experts from...PlatformWork at officeShift workArcade AI, Inc
San Francisco, CA4 days ago$190k - $220k
As a Senior Inference Engineer at vCluster Labs, you are the first engineer we... ...with our CTO to build the platform's inference layer from the... ...Salesforce Tower), but our team is distributed around the globe with a... ...architecture for DGX systems. We offer the following...PlatformSeniorRemote workFlexible hours$159.2k - $301.6k
The Opportunity We are looking for a Senior AI Systems Engineer with deep C++ expertise to help build... ...generation of AI-enabled product and platform capabilities. This role sits at the intersection... ...and tracing for AI systems or distributed systems. Experience with privacy-...PlatformSeniorFull timeTemporary workLocal areaRemote workWorldwideAdobe Systems
San Francisco, CA2 days ago- DoorDash is seeking a highly capable engineer to design and operate high-performance distributed storage systems. You will work on data abstraction layers, improve reliability and latency, and ship platform features used by product engineers. The role spans two teams within...Platform
$215k - $275k
About the Role Join a small engineering team building the backend infrastructure... ...a radiology-focused healthcare platform and its AI copilot. You will own critical systems across data ingestion, warehousing, and distributed model inference, helping make the platform...PlatformSeniorVisa sponsorship$185.5k - $232k
...Senior Site Reliability Engineer New York, NY; Boston, MA; San Francisco... ...built technology platforms, processes, and... ...infrastructure, delivery systems, and operational... ..., ML pipelines, inference, and agentic software... ...infrastructure and distributed systems, with strong...PlatformSeniorWork experience placementWork at officeLocal areaRelocation3 days per weekFormation Bio (Formerly TrailSpark)
San Francisco, CA5 days ago- ...Revel Revel is the software platform for hardware test and control... ...team, which has fewer than six engineers. You will be responsible for... ...problems at all levels of the system. You design, build, and... ...of these as well: Understand distributed systems fundamentals and their...PlatformPermanent employmentImmediate startFlexible hours
$165k - $200k
...Crusoe. About This Role As a Senior Systems Engineer, you’ll play a key role in building and... ...off-hours syncs to support distributed operations What You’ll Bring to the... ...Lumos or similar identity governance platforms ~ Proven ability to build automation...PlatformSeniorTemporary workCrusoe
San Francisco, CA2 days ago$250k
...next-generation GPU platform designed for AI... ...experimentation, and inference at scale. The company... ...is looking for a Senior / Staff Site Reliability Engineer to support and scale... ...observability across distributed compute... ...available infrastructure systems Improve CI/CD pipelines...PlatformSeniorFull timeRemote workSan Francisco, CAmore than 2 months ago- You.com is seeking a backend generalist to own the inference gateway that routes all model calls. You will design and optimize provider/model selection, caching behavior, and metering, ensuring reliable, cost-aware routing at scale. The role emphasizes building aproxy/gateway...PlatformSenior
$204k - $216k
...collective intelligence platform for professional... ...in silos, in legacy systems, in the heads of a few... ...You build and run the inference infrastructure that turns... ..., and platform engineering, and you make the difference... ...programming and distributed systems fundamentals....PlatformSapience AI Corporation
San Francisco, CA10 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Distributed Systems Engineer for Inference Platform. Be the first to apply!
Related searches
- system performance engineer San Francisco, CA
- senior linux systems engineer San Francisco, CA
- software system engineer San Francisco, CA
- ground systems engineer San Francisco, CA
- advanced systems engineer San Francisco, CA
- computer system validation engineer San Francisco, CA
- computer systems engineer San Francisco, CA
- operations support system engineer San Francisco, CA
- microsoft systems engineer San Francisco, CA
- sr systems engineer San Francisco, CA