Senior Systems Engineer, AI Inference Platform
OpenAI
OpenAI in San Francisco is seeking an experienced systems generalist to build an automated inference optimization platform across hardware, compiler, and runtime contexts. You will design the OpenAI-hosted control plane and partner-side software, focusing on reliable long-running workflows, reproducible performance results, and secure handling of model and hardware data. This cross-stack role collaborates with research, infrastructure, security, product, and partnerships to deliver scalable, #J-18808-Ljbffr OpenAI
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior Systems Engineer, AI Inference Platform in San Francisco, CA vacancy
- At Atlassian, we are seeking an ML System Engineer to join the AI & ML Platform Inference team. You will design and optimize large-scale model serving systems... ...across production workloads. You will collaborate with senior ML engineers to fine-tune and deploy open-source...PlatformSenior
- Cloudflare is seeking a Senior Systems Engineer for its AI inference platform. You will design and build core infrastructure powering AI inference across a global network, working with AI/ML engineers, hardware partners, and product teams to solve distributed systems challenges...PlatformSenior
- Baseten powers mission-critical AI inference at scale. We seek distributed systems engineers to own the runtimes and APIs that run large-scale LLM inference and hosted endpoints. You’ll work across the stack from developer tooling to orchestration on Kubernetes, driving...PlatformSenior
- Hedra Inc. in San Francisco is seeking a Senior or Staff Software Engineer with deep expertise in building and operating distributed production systems. You will work on Hedra’s inference infrastructure, designing and operating systems that schedule, route, and manage...PlatformSenior
$194k - $266k
..., TX, United States Position Title: Senior Systems Engineer, AI Gateway About Us At Cloudflare, we are... ...San Francisco, CA About the Role AI inference is becoming core infrastructure.... ...AI, Agents, and the broader Developer Platform organization to make Cloudflares AI platform...PlatformSeniorTemporary workLocal areaFlexible hours- ...Cloud, is a leader in AI cloud infrastructure serving... ...Information Systems at Lambda is responsible... ...company—Finance, GTM, Engineering, and People—to implement... ...applications, integrations, data platform and analytics,... ...latency, and control inference costs across teams....PlatformSeniorWork at officeLocal areaWork from homeFlexible hours
Lambda Inc.
San Francisco, CA4 days ago - Sierra is building a leading platform for customer-facing AI agents, based in San Francisco with offices... ...Asia. We are seeking a Software Engineer on Inference to define Sierra’s inference... ...fast, reliable, and cost-efficient systems. This role is a systems-first position...Platform
- ...TX, United States Position Title: Senior Systems Engineer, Workers AI About Us At Cloudflare, we are on... ...core infrastructure that powers AI inference across Cloudflare’s global network... ...management, and a model deployment platform serving both Cloudflare and customers...PlatformSeniorLocal areaWorldwide
$155.6k - $307.4k
Adobe is seeking an exceptional AI infrastructure authority to lead the development of the AI Inference Platform in San Francisco. The role involves collaborating with teams... ...like Pytorch and experience with distributed systems, Kubernetes, and strong problem-solving...PlatformSenior- Sierra is the leading platform for customer-facing AI agents, based in San Francisco. We are seeking a Software Engineer on the Inference team to define architectures for self-hosted and provider... .... You will work across distributed systems to build, optimize, and operate core...Platform
- Cloudflare is hiring a Senior Systems Engineer for AI Gateway in Austin, TX or San Francisco, CA. You will build a scalable AI inference layer at the edge, design APIs and developer workflows... ...teams to ship production-ready platforms. You should have 5+ years of experience...PlatformSenior
- You.com is seeking a backend generalist to own the inference gateway that routes all model calls. You will design and optimize provider/model selection, caching behavior, and metering, ensuring reliable, cost-aware routing at scale. The role emphasizes building aproxy/gateway...PlatformSenior
- Databricks is seeking high-agency engineers to power model inference at enterprise scale. You... ...will collaborate across platform, infra, and ML teams to... ...and developers building AI applications on Databricks... ...infrastructure and scalable systems across production #J-1880...PlatformSenior
- Baseten is hiring a Software Engineer focused on testing within the Platform team. You will own the end-to-end testing strategy, building unit, integration... ...testing frameworks for a mission-critical AI inference platform. You will design end-to-end test infrastructure...PlatformSenior
$160k - $250k
Together AI is searching for a skilled engineer to join their team, focusing on building and optimizing a large-scale inference platform. This role involves developing low-latency systems and collaborating with research teams to deploy advanced AI models. Candidates should...PlatformSenior$250k - $320k
(Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure About The Role We're looking for a software... ...runs our GPU inference fleet. The platform team builds the manifest-driven API... ...the automated self-healing system so each new failure mode becomes a...PlatformSeniorPermanent employmentFull timeTogether Computer Inc
San Francisco, CA1 day ago- ...have a legal entity. Responsibilities As a senior Machine Learning Systems Engineer on the Search Platform team, you will own and drive the design, development... ...-step retrieval workflows. Partner with Rovo and AI platform teams to evolve search infrastructure as...PlatformSeniorWork at officeLocal area
Atlassian
San Francisco, CA2 days ago - ...Talent Solutions Partners is seeking a senior backend engineer to own the radiology-focused platform's data ingestion, warehousing, and model inference infrastructure on AWS. You will... ...and experience with HIPAA-compliant systems. On-site in San Francisco, visa sponsorship...PlatformSeniorVisa sponsorship
$180k - $230k
San Francisco, CAProduct Systems Engineering - Product Systems /Full time /On... ...space mission.As a Senior Product Systems Engineer at... ...You will define how Loft's platform is structured, how capabilities... ...IoT connectivity, on-orbit AI, national security missions,...PlatformSeniorFull timeTemporary workLoft Orbital
San Francisco, CA5 days ago$206.1k - $269.08k
...Engineering | San Francisco, United States | Remote... ...by people and AI agents working together... ...the evaluation systems, datasets, quality... ...you’ll do As a Senior Machine Learning... ..., experimentation platforms, and online quality... ...architecture, and inference; balancing quality...PlatformSeniorWork at officeLocal areaRemote workAtlassian Corp.
San Francisco, CA2 days ago- ...Hedra Hedra is the platform, models, and... ...intelligence. We build the systems that make large-scale visual inference fast, reliable, and... ...leading investors. Engineers at Hedra work... ...’re looking for a Senior or Staff Software Engineer... ...to come from an AI company or already...PlatformSeniorWork at office
Hedra Inc.
San Francisco, CA4 days ago - We are looking for a Senior Data Scientist - Experimentation & Causal Inference to serve as the statistical... ...services — our platform engineering team handles that. Your... ...will build the automated systems that answer that... ...methods in production. AI-Native Workflow: Strong...PlatformSenior
$200k - $250k
...com, we are building the AI Search Infrastructure that powers modern AI systems. Our goal is to create... ...information. Our platform combines proprietary vertical... .... Our team includes engineers, researchers, product... ...through one layer: our inference gateway. It allows...PlatformSeniorImmediate startRemote workWork from homeFlexible hoursMixpeek
San Francisco, CA2 days ago- DocuSign in San Francisco seeks a Senior Software Engineer to design, build, and scale intelligent, enterprise-grade software with a focus on agentic AI systems and complex integrations across platforms. This hands-on role emphasizes distributed systems, APIs, and security...PlatformSenior
$124k - $280k
...people in data and analytics engineering focus on leveraging advanced... ...developing and implementing advanced AI and ML solutions to drive... ...algorithms, models, and systems to enable intelligent decision... ...Apart- Certification in Cloud Platforms [e.g., AWS Certified Solutions...PlatformSeniorFull timeH1bPwC
San Francisco, CA5 days ago- ...: Search PlatformThe Search Platform team is responsible for powering... ...high quality agentic search systems, addressing tail latency,... ..., query processing, and ML inference. Turn advances in information... ...fragmented systems, mentor senior engineers, and align technical and product...PlatformSeniorWork at officeLocal area
Atlassian
San Francisco, CA4 days ago $190k - $260k
Harvey is a secure AI platform for professionals in law, tax, and finance... ...our expert team of lawyers, engineers and research scientists. We’... ...develop and improve our AI systems, including: fine-tuning... ...latency and expensive model inference, … and more. Impact: Work directly...PlatformSenior- ...powering the next generation of AI products. We build the... ...but practical: a unified platform where high-performance inference, orchestration, and... ...that owns fal's core product systems — the connected tissue the... ...usage, cost, and access. Engineer for correctness and resilience...PlatformSeniorVisa sponsorshipRelocation package
The Consensus
San Francisco, CA2 days ago $250k - $350k
...is to develop reliable AI systems for the world’s most... ...the Scale Generative AI Platform (SGP), focused on... ...Machine Learning Research Engineer, you will operate across... ...training/fine-tuning, inference, memory and retrieval,... ...direction, mentor senior and staff-track engineers...PlatformSeniorFull timeScale AI
San Francisco, CA6 days ago- ...technology company in California is seeking an engineer to build AI agents for doctor’s offices. The ideal candidate will work on full-stack systems that handle real money and patient data... ...Python, Postgres, and Google Cloud Platform. This role offers the opportunity to...PlatformSenior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Systems Engineer, AI Inference Platform. Be the first to apply!
Related searches
- data systems engineer San Francisco, CA
- director systems engineering San Francisco, CA
- senior windows systems engineer San Francisco, CA
- system safety engineer San Francisco, CA
- system design engineer San Francisco, CA
- ground systems engineer San Francisco, CA
- system engineer contract San Francisco, CA
- system performance engineer San Francisco, CA
- software system engineer San Francisco, CA
- wireless systems engineer San Francisco, CA