Senior AI Inference Infrastructure Engineer
OpenAI
OpenAI is seeking an experienced software engineer to join the GPT Infrastructure team and help build an automated inference optimization platform that scales research prototypes into production‑ready solutions. You will design durable APIs and control‑plane services, integrate hardware and software toolchains, and collaborate across Research, Infrastructure, Security, and Partnerships to deliver reliable, observable systems with strong developer ergonomics. #J-18808-Ljbffr OpenAI
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior AI Inference Infrastructure Engineer in San Francisco, CA vacancy
$300k
...interpretable, and steerable AI systems. We want AI to be safe... ...of committed researchers, engineers, policy experts, and business... ...About the Role The Cloud Inference team scales and optimizes Claude... ...providers, and make smart infrastructure decisions that keep us cost-effective...SeniorFull timeWork at officeVisa sponsorshipFlexible hoursAnthropic
San Francisco, CA19 hours ago- ...seeking an experienced systems generalist to build an automated inference optimization platform across hardware, compiler, and runtime... ...data. This cross-stack role collaborates with research, infrastructure, security, product, and partnerships to deliver scalable, #J...Senior
$250k
...Ready to architect AI infrastructure that powers next-generation research and cloud... ...team is now building a serverless inference platform, beginning with cost-efficient... ...is a unique chance to join as a Senior Inference Platform Engineer at an early stage and help define...SeniorFull timeSan Francisco, CAmore than 2 months ago- Parafin, Inc. is seeking a Software Engineer to lead the evolution of its ML Platform within the Infrastructure team. You will build scalable, reliable systems for model experimentation, training, evaluation, inference, and retraining powering underwriting and ML-driven...Senior
$225k
...opportunity? Join a rapidly scaling AI cloud infrastructure provider building next-generation... ...AI training, experimentation, and inference workloads. The company is operating... .... The company is looking for a Senior Network Engineer to design, deploy, and support ultra...SeniorFull timeRemote workSan Francisco, CAmore than 2 months ago$81.4k - $151.8k
...Family Group:TechnologySenior Cloud Engineer - ML/AI PlatformWe are seeking a Senior Cloud Engineer with deep... ...enablement• Develop frameworks, infrastructure-as-code, and automation to accelerate... ...SageMaker (training, pipelines, inference, JumpStart), Bedrock• Deep hands...SeniorFull timeContract workPart timeLocal area$320k
...interpretable, and steerable AI systems. We want AI to be safe... ...of committed researchers, engineers, policy experts, and business... ...role We're building the infrastructure that lets people talk to Claude... ...real-time media, low-latency inference, and distributed systems—...SeniorFull timeWork at officeVisa sponsorshipFlexible hoursAnthropic
San Francisco, CA19 hours ago$187k
...team builds and operates the infrastructure, tooling, and developer experience... ...data scientists and ML engineers to develop, train, deploy, and... ...feature computation, real-time inference, and experimentation. You’ll... ...and evolution of advanced AI technologiesHands-on experience...SeniorFull timeWork at officeLocal areaRemote work- Causal is building a Large Physics foundation Model and seeks infrastructure engineers for high-throughput, low-latency inference at scale in San Francisco. You will work on evaluating physical observations, backtesting, and large-batch workflows, collaborating with researchers...
$300 per month
...only vertically integrated AI infrastructure company built from the ground... ...Crusoe, our Production Engineering team ensures the reliability... ...platform. We’re looking for a Senior Production Engineer with a... ...large-scale training and inference clustersAutomate observability...SeniorTemporary work- Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. The storage and observability team is responsible for designing, implementing...Senior
$238k - $290k
...combining frontier agentic AI, an enterprise-grade... ...a Backend Platform Engineer at Harvey, you will help... ...on. In this mid-to-senior level role, you’ll design... ...with Model Infrastructure team to tackle challenges... ...high-throughput model inference, managing streaming and...SeniorFlexible hoursShift work$151.8k - $265.35k
...exceptional content effortlessly. The AI for Engineering team builds a scalable, production-grade... ...orchestration, tool integration, memory systems, inference services, data flows, evaluation loops,... ...into adaptive AI systems.Mentor senior engineers in modern AI system design,...SeniorFull timeTemporary workLocal areaWorldwide$295k - $405.5k
...ours.About this roleAs the Senior Staff Machine Learning Platform Engineer, you will own the... ...take advantage of modern AI productivity tools. You... ...platform including training, inference, feature management,... ...distributed systems, ML infrastructure, and cloud architecture....SeniorWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per week$245k - $295k
...the only vertically integrated AI infrastructure company built from the ground up... ...About the RoleWe are seeking a Senior Manager, Infrastructure Platform Engineering to lead a team building core... ...GPU clusters, AI training, and inference workloadsWorking knowledge of platform...SeniorTemporary workImmediate start- Perplexity is building a self-serve compute platform that lets inference engineers run training jobs and inference services without worrying about GPU provisioning or cluster configuration. You will own the platform surface and drive reliability, observability, and performance...Senior
- ...notch technology products.As a Senior Lead Software Engineer at JPMorgan Chase within the Corporate Sector, Infrastructure Platforms team, you are an... ...platforms optimized for AI/ML workloads.Partner with AI... ..., ML training, and inference.Experience with Infrastructure...SeniorFor contractors
$172.5k - $260.1k
...SalesforceSalesforce is the #1 AI CRM, where humans with... ...Salesforce.Join the Engineering Development and... ...— a foundational data infrastructure that powers analytics,... ...engineers across varying seniority levels — building high... ..., and real-time inference, and how they shape telemetry...SeniorFull timeContract work$250k
...your career? Join a rapidly scaling AI cloud infrastructure provider building next-generation... ...AI training, experimentation, and inference. The company is developing some of... ...growth. The company is looking for a Senior Storage Engineer with experience supporting high-...SeniorFull timeRemote workSan Francisco, CAmore than 2 months ago$240k - $360k
...the RoleWe're looking for a Senior Staff Data Engineer to be the technical... ...evolves as the company's AI ambitions scale. You'll work... ..., serving layers, and the infrastructure that makes ML models production... ...model training and inference workflows reliably.Raise the...SeniorWork at officeLocal areaImmediate startRemote workWorldwide3 days per week$160k - $300k
...Apiphany is a pioneering foundational AI company for physical product... ...our mission is to revolutionize how engineering decisions are made, turning complexity... ...together. About the Role As a Senior / Staff Infrastructure Engineer at Apiphany, you’ll design,...SeniorWork at officeVisa sponsorshipFlexible hoursApiphany
San Francisco, CA1 day ago- Capital One seeks a Sr Director, AI Engineering to lead the Intelligent Foundations and Experiences (IFX) team. You will oversee AI software components, model training, inference, guardrails, governance, and observability, partnering with engineers, researchers, PMs to...Senior
$200k
...We do this by building the financial infrastructure that makes it easier for more people... ...to every product we build. As a Senior Infrastructure Engineer, you will shape the platform infrastructure... ...We may use artificial intelligence (AI) tools to support parts of the...SeniorWork at office2 days per weekAngelList
San Francisco, CAa month ago- ...Capabilities, and Skills · 5+ years of hands-on experience in infrastructure engineering with demonstrated depth and breadth of knowledge across... ...and compute validation. · Familiarity with using generative AI tools to accelerate engineering and research cycles. Job...Senior
PB consulting
San Francisco, CA3 days ago $160k - $260k
...unique combination of proprietary infrastructure and software, we empower over... ...done” end-to-end. You use AI to work smarter and solve... ...IT drives our IT support, IT engineering and business engineering functions... ...face.What you’ll doAs a Senior / Staff Network Engineer, you...SeniorTemporary workWork at officeLocal areaRemote workWorldwideFlexible hoursWeekend work$170k - $230k
...innovative virtual payment products. Our infrastructure will be across multiple continents over... ...+ years of experience in infrastructure engineering or software engineering ~ Strong experience... ...environment ~ Proficiency using AI-powered development tools (e.g., Claude...SeniorWork at officeLocal areaHome officeFlexible hoursHighnote
San Francisco, CA13 days ago- Causal Labs in San Francisco is seeking an experienced Infrastructure Engineer to build high-throughput inference systems for large-scale evaluation and backtesting against historical physical observations. You will design techniques to improve latency and throughput,...Senior
$225k - $275k
...and intelligence. As the only vertically integrated AI infrastructure company built from the ground up, we own and operate... ...at Crusoe.About this RoleCrusoe Cloud is seeking a Senior Staff Network Deployment Engineer to serve as the technical owner of how we deploy network...SeniorTemporary workRemote work$229.9k - $262.4k
Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI) Overview: At Capital One, we are... ...experiences. Our investments in technology infrastructure and world-class talent — along with... ...training, large language model inference, similarity search, guardrails,...SeniorFull timePart timeLocal areaCapital One
San Francisco, CA4 days ago$220k
Perplexity is looking for an engineer to join their team in San Francisco. You will work on building and operating the inference engine, supporting new models, migrating GPU kernels, and developing a Rust-based serving runtime. The ideal candidate has 3+ years of experience...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference Infrastructure Engineer. Be the first to apply!
Related searches
- ai engineer San Francisco, CA
- ai research engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- ai engineer remote San Francisco, CA
- ai developer San Francisco, CA
- principal infrastructure engineer San Francisco, CA
- remote infrastructure engineer San Francisco, CA