Distributed Systems Engineer - AI Inference Platform
Jobleads-US
Baseten is hiring distributed systems engineers to build the runtime that powers large-scale LLM inference. You will deploy and operate Model APIs, routing, autoscaling, and orchestration on Kubernetes, while focusing on speed, reliability, and cost efficiency.
You’ll own end-to-end projects from architecture through deployment, with emphasis on performance, observability, and developer experience. This is a hands-on, high-impact role at Baseten in San Francisco.
#J-18808-Ljbffr Jobleads-USVacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Distributed Systems Engineer - AI Inference Platform in San Francisco, CA vacancy
- ...Baseten powers mission-critical inference for AI companies, uniting research, flexible infrastructure, and developer tooling... ..., scalability, and reliability across the platform. As a distributed systems engineer on the Inference Platform, you will own end-to-end...PlatformFlexible hours
- ...Sierra is the leading platform for customer-facing AI agents, based in San Francisco. We are seeking a Software Engineer on the Inference team to define architectures for self-hosted... ...at scale. You will work across distributed systems to build, optimize, and operate...Platform
- ...Tubi is seeking a Staff Software Engineer for the ML Infrastructure team to build world-class ML inference platforms powering recommendations, search, and content understanding. You will advance low-latency model serving, feature/vector stores, and experimentation engines...Platform
- ...Hedra Inc. in San Francisco is seeking a Senior or Staff Software Engineer with deep expertise in building and operating distributed production systems. You will work on Hedra’s inference infrastructure, designing and operating systems that schedule, route, and manage...Platform
- Senior AI Engineer, MLOps & Distributed SystemsThe OpportunityJoin the team building... ...Notifications pod is creating the systems that determine what... ...reliable online and batch inference capabilities that meet clear... ...or operating MLOps or ML platform capabilities, such as...PlatformFull timeInternshipWork at officeLocal areaRemote workWorldwide3 days per week
Hinge Health
San Francisco, CA3 days ago - ...Chroma Inc. is seeking an experienced distributed-systems engineer to help scale our open source data plane and cloud platform in San Francisco. You will design and optimize the... ...retrieval, and metadata components to support AI workloads at scale. You will collaborate...Platform
- ...Mixpeek is seeking a distributed systems engineer to help scale our data plane and cloud platform. You will build reliable components for vector search, storage, and metadata handling to support AI workloads at scale. You will work primarily with Rust, C++, or Zig,...Platform
- ...Hedra Hedra is the platform, models, and... .... We build the systems that make large-scale visual inference fast, reliable, and... ...leading investors. Engineers at Hedra work across... ...and operating distributed production systems... ...need to come from an AI company or already...PlatformWork at office
- ...Beam is an ultrafast AI inference platform. We built a serverless runtime... ...someone to help us with Platform Engineering work. We’re working on lots... ...fun problems: Low‑level systems development: working with... ...working with a large distributed system ~ Comfortable with...Platform
Beam
San Francisco, CA3 days ago - ...have a legal entity. Responsibilities As a ML System Engineer on the AI & ML Platform’s Inference team, you will design and optimize large-scale... ...end. You will have the chance to own everything from distributed infrastructure (global KV cache, continuous batching...PlatformWork at officeLocal area
Atlassian
San Francisco, CA3 days ago - ....About the Central AI OrgOur organization... ...Atlassian products and platforms. We aim to deliver... ...Conversational AI system that integrates... ...a Senior ML System Engineer on the AI & ML Platform’s Inference team, you will design... ...own everything from distributed infrastructure (...PlatformWork at officeLocal area
Atlassian
San Francisco, CA1 day ago - ...Modal is seeking a systems engineer to advance the container runtime stack used for inference workloads, working close to Linux, containers... ..., storage, GPU drivers, and distributed systems. You will build... ...architecture of Modal’s container platform. You will also collaborate...Platform
$153k - $376k
...accessible to all. Figma’s platform helps teams bring... ...code, or iterating with AI. From idea to product,... ...build. As a Software Engineer on our Infrastructure... ...build, and operate the systems that power our real-... ...looking for experienced distributed systems engineers...PlatformMinimum wageFull timeLocal areaRemote workWorldwideFlexible hoursFigma
San Francisco, CA2 days ago- ...the infrastructure that allows AI agents to reliably search,... ...role matters Own critical systems that power autonomous web understanding... ...large scale, highly-available distributed systems, data pipelines, and observability to keep our platform fast and reliable. What you...PlatformFull timeRemote workTrial period
$148.5k - $223.9k
...SalesforceSalesforce is the #1 AI CRM, where humans with... ...in developing distributed filesystems in an ever... ...of users of our cloud platform. Build efficient... ...review, mentoring junior engineers, and providing technical... ...developing distributed systems at scale. -...PlatformFull timeImmediate startSalesforce
San Francisco, CA5 days ago$117.2k - $223.9k
...SalesforceSalesforce is the #1 AI CRM, where humans with... ...Salesforce's Agentforce platform, we're enabling... ...Join our team of talented engineers and help us advance the integration... ..., and the security of distributed and scalable distributed systems. This role requires hands...PlatformFull timeSalesforce
San Francisco, CA2 days ago$172.5k - $260.1k
...SalesforceSalesforce is the #1 AI CRM, where humans with... ...of users to our platform, powering next-... ...high-energy backend Java engineer to lead the design, architecture... ...that enable our systems to self-heal and self-... ...ultra-resilient distributed systems, driving live-...PlatformFull timeSalesforce
San Francisco, CA3 days ago- ...is seeking a Senior Software Engineer for the Files team to... ...of storage, performance, and distributed systems. You will shape our filesystem... ...workloads across thousands of data, AI, and agentic tasks. You... ...operate scalable filesystem platforms, optimize performance from...Platform
$166k - $225k
...running the world's best data and AI infrastructure platform so our customers can use deep... ...their business. Founded by engineers — and customer obsessed — we leap... ...building the next generation distributed data storage and processing systems that can outperform...PlatformLocal areaWorldwideDataBricks
San Francisco, CA3 days ago$300k - $400k
...mission of Thinking Machines is to build AI that extends human will and judgment.... ...the Role We're hiring a Software Engineer, Distributed Systems to design and build the core distributed... ...clusters and Tinker's serving platform, and shows up anywhere we need software...PlatformVisa sponsorshipWork visaRelocation package- ...Description ThisWay Global is looking for a Distributed Systems Engineer in a remote role within the United States. ThisWay Global, Inc. is an AI-first technology company headquartered... ...ADCAP — AI & Data Center Acceleration Platform: A data center development and...PlatformFull timeRemote work
GrabJobs
San Francisco, CA1 day ago - ...into action. We’re looking for engineers who want to build the operating system for AI Data Applications and Workflows.... ...We're looking for experienced distributed systems engineers to build the core... ...is primarily in DevOps, SRE, or platform operations (Terraform,...Platform
Tensorlake Inc.
San Francisco, CA4 days ago - ...Distributed Systems EngineerAs a distributed systems engineer, you'll work across the stack to solve problems as they come up... ...generation of applications (and with AI, more applications will be... ...building the next, default storage platform in the cloud.Over the past 15...PlatformFlexible hours
Archil
San Francisco, CA3 days ago $175k - $300k
...they had to do. Powerful AI will be the biggest... ...forward. The Production Engineering Team Examples of... ...the observability platform that turns raw telemetry... ...state inspection, and distributed command execution. One... ...scripts. Make the system's view of itself always...PlatformLocal areaFluidStack
San Francisco, CA5 days ago$200k - $260k
...Revolution Needs You Every AI app needs agentic tools that... ...tools catalog, actions platform, and governance model that will... ...authentication, integrations, distributed systems, and AI experts from Okta,... ...ship. ~7+ years of software engineering experience comprising of:...PlatformWork at officeShift workArcade
San Francisco, CA1 day ago$180k - $230k
San Francisco, CAProduct Systems Engineering - Product Systems /Full time /On... ...You will define how Loft's platform is structured, how capabilities... ...-heavy systems, including distributed components, APIs, processing... ...IoT connectivity, on-orbit AI, national security missions,...PlatformFull timeTemporary workLoft Orbital
San Francisco, CA1 day ago$166k - $343k
Presales Systems Engineer - HPE Networking (Northern California)This role... ...Networking is a leading provider of AI driven next-generation... ...on datacenter, campus and distributed branch networks. The Systems... ...SASE and Network Management platforms, both on Premises and in Cloud...PlatformFull timeWork experience placementLocal areaImmediate startRemote workWork from homeHewlett Packard Enterprise
San Francisco, CA3 days ago$300k - $400k
...is to democratize frontier AI R&D across scientific disciplines... ...for it. We’re looking for a Systems Engineer who knows how to find... ...fix what matters Reliable distributed systems - design how work and... ...agent harnesses, training, and inference run efficiently together...- ...Sierra’s AI agents rely on foundation models; as a Software Engineer on Inference, you’ll help define the inference architecture across... ...providers. You’ll work on systems for serving and routing... ...role at the intersection of distributed infrastructure and AI. You don...
$189.6k - $237k
Scale’s ML platform (RLXF) team builds our internal distributed framework for large language... ...training and inference. The platform has... ...heart of the field of AI as an... ...excitement about system optimizationExperience... ...systemsStrong software engineering skills, proficient...PlatformFull timeScale AI
San Francisco, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Distributed Systems Engineer - AI Inference Platform. Be the first to apply!
Related searches
- senior linux systems engineer San Francisco, CA
- system engineer contract San Francisco, CA
- data systems engineer San Francisco, CA
- senior staff systems engineer San Francisco, CA
- microsoft systems engineer San Francisco, CA
- operations support system engineer San Francisco, CA
- advanced systems engineer San Francisco, CA
- software system engineer San Francisco, CA
- space systems engineer San Francisco, CA
- electronic systems engineer San Francisco, CA