Senior AI Inference Infrastructure Engineer
OpenAI
OpenAI is seeking an experienced software engineer to join the GPT Infrastructure team and help build an automated inference optimization platform that scales research prototypes into production‑ready solutions. You will design durable APIs and control‑plane services, integrate hardware and software toolchains, and collaborate across Research, Infrastructure, Security, and Partnerships to deliver reliable, observable systems with strong developer ergonomics. #J-18808-Ljbffr OpenAI
- ...seeking an experienced systems generalist to build an automated inference optimization platform across hardware, compiler, and runtime... ...data. This cross-stack role collaborates with research, infrastructure, security, product, and partnerships to deliver scalable, #J...Senior
$250k
...Ready to architect AI infrastructure that powers next-generation research and cloud... ...team is now building a serverless inference platform, beginning with cost-efficient... ...is a unique chance to join as a Senior Inference Platform Engineer at an early stage and help define...SeniorFull time- Oscar Associates Limited (US) in San Francisco offers a hybrid Senior ML Inference Engineer role. You will enhance AI-native infrastructure powering generative and multimodal models, with ownership across inference systems and production performance. The ideal candidate...Senior
- Parafin, Inc. is seeking a Software Engineer to lead the evolution of its ML Platform within the Infrastructure team. You will build scalable, reliable systems for model experimentation, training, evaluation, inference, and retraining powering underwriting and ML-driven...Senior
$120k - $200k
...Senior Infrastructure Engineer At Bland.com, our goal is to empower enterprises to make AI-phone agents at scale. Based out of San Francisco, we're a quickly growing team striving... ...real-time voice processing, scale ML inference, and integrate with enterprise telephony...SeniorWork at officeNight shift- ...Senior Network Engineer Houston; New York; San Francisco; Seattle About Nscale... ...GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large... ...fabrics, management networks, inference traffic paths, and storage...Senior
$190k - $280k
...Senior Network Engineer San Francisco About the Role Together AI is looking for a Senior Network Engineer to design, deploy... ...operate the global network infrastructure supporting our production... ...Understanding of AI training and inference traffic patterns and the...SeniorFull time$200k
...We do this by building the financial infrastructure that makes it easier for more people... ...to every product we build. As a Senior Infrastructure Engineer, you will shape the platform infrastructure... ...We may use artificial intelligence (AI) tools to support parts of the...SeniorWork at office2 days per week$216.2k - $270.25k
Scale GP is building the infrastructure that makes enterprise AI seamless. We are looking for a Senior or Staff Infrastructure Engineer to act as a primary technical lead, engineering the... ...' for our knowledge retrieval and inference engines. You won't just be managing resources...SeniorFull time$225k
...opportunity? Join a rapidly scaling AI cloud infrastructure provider building next-generation... ...AI training, experimentation, and inference workloads. The company is operating... .... The company is looking for a Senior Network Engineer to design, deploy, and support ultra...SeniorFull timeRemote work$160k - $230k
...About the Role Together AI is building the AI Acceleration Cloud, an end-to-end platform for... ...generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. As a Senior Backend Engineer, you will play a key role in...SeniorFull timeRemote work- ...About David AI David AI is the first audio data... ...of former Scale AI engineers and operators. In less... ...of product engineers, infrastructure specialists, and machine... ...About this role As a Senior Software Engineer,... ...data. Scaled up inference and train compute for...SeniorFull timeWork at office
- Causal is building a Large Physics foundation Model and seeks infrastructure engineers for high-throughput, low-latency inference at scale in San Francisco. You will work on evaluating physical observations, backtesting, and large-batch workflows, collaborating with researchers...
- ...worldwide.We’re a team of engineers, clinicians, and... ...Function of PositionAs a Senior Software Engineer -... ...development for robotic motion AI. You will work closely... ...and maintain software infrastructure for robotic... ...data processing, model inference, and experimentation....SeniorLocal areaWorldwideFlexible hours
- ...Superintelligence Cloud, is building the world's premier AI cloud storage platform in the San Francisco Bay Area. We seek a Senior Software Engineer to join the storage team, developing next‑... ...environment that powers AI training and inference across petabyte-scale datasets. You will...Senior
- Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. The storage and observability team is responsible for designing, implementing...Senior
$300 per month
...only vertically integrated AI infrastructure company built from the ground... ...Crusoe, our Production Engineering team ensures the reliability... ...platform. We’re looking for a Senior Production Engineer with a... ...large-scale training and inference clustersAutomate observability...SeniorTemporary work- ...the San Francisco Bay Area is seeking a Senior Software Engineer to join the Mk8s team. You will design... ...GPU-aware orchestration that powers AI workloads across a distributed platform... ...Kubernetes, and platform services for inference, while collaborating across stacks to...Senior
$245k - $295k
...the only vertically integrated AI infrastructure company built from the ground up... ...the Role We are seeking a Senior Manager, Infrastructure Platform Engineering to lead a team building core systems... ...GPU clusters, AI training, and inference workloads Working knowledge...SeniorTemporary workImmediate start$238k - $290k
...combining frontier agentic AI, an enterprise-grade... ...a Backend Platform Engineer at Harvey, you will help... ...on. In this mid-to-senior level role, you’ll design... ...with Model Infrastructure team to tackle challenges... ...high-throughput model inference, managing streaming and...SeniorFlexible hoursShift work$151.8k - $265.35k
...exceptional content effortlessly. The AI for Engineering team builds a scalable, production-grade... ...orchestration, tool integration, memory systems, inference services, data flows, evaluation loops,... ...into adaptive AI systems.Mentor senior engineers in modern AI system design,...SeniorFull timeTemporary workLocal areaWorldwide$295k - $405.5k
...Wisconsin.About this roleAs the Senior Staff Machine Learning Platform Engineer, you will own the... ...advantage of modern AI productivity tools. You... ...platform including training, inference, feature management,... ...distributed systems, ML infrastructure, and cloud architecture....SeniorWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per week- ...notch technology products.As a Senior Lead Software Engineer at JPMorgan Chase within the Corporate Sector, Infrastructure Platforms team, you are an... ...platforms optimized for AI/ML workloads.Partner with AI... ..., ML training, and inference.Experience with Infrastructure...SeniorFor contractors
$250k - $280k
...Job Description Job Description Staff / Principal Founding Engineer (Backend-Leaning) – AI Systems Platform San Francisco (in-office) $250–280K base + 0.75–1.5% equity (package flexible for the right person) Description: We’re partnering with a well-funded...SeniorWork at officeImmediate startFlexible hours$180k - $250k
...Senior Infrastructure Engineer Title of Role: Senior Infrastructure Engineer Location: San Francisco, hybrid Company Stage of Funding: Seed - AI, Devtools, Enterprise, Data Office Type: Hybrid Salary: $180K-$250K Company Description We're representing...SeniorWork at office- ...Description Confidential client — a Series A AI research lab (11-50 employees)... ...leading venture investors and advised by senior AI research leaders. Full-Time, In-person... ...About the Role: As a Senior Software Engineer, Infrastructure and Platform, you will design and build...SeniorFull timeH1bVisa sponsorship
$140k - $200k
...pioneering the future of Physical AI. Our advanced vision... ...systems - from robots to smart infrastructure - building a safer and more... ...Data Infrastructure / Quality Engineering role will play a crucial... ...high-performance GPU cloud inference services, with specific expertise...SeniorWork experience placementLocal area$172.5k - $260.1k
...SalesforceSalesforce is the #1 AI CRM, where humans with... ...Salesforce.Join the Engineering Development and... ...— a foundational data infrastructure that powers analytics,... ...engineers across varying seniority levels — building high... ..., and real-time inference, and how they shape telemetry...SeniorFull timeContract work$240k - $360k
...the RoleWe're looking for a Senior Staff Data Engineer to be the technical... ...evolves as the company's AI ambitions scale. You'll work... ..., serving layers, and the infrastructure that makes ML models production... ...model training and inference workflows reliably.Raise the...SeniorWork at officeLocal areaImmediate startRemote workWorldwide3 days per week$210k - $300k
...About Nimble Nimble is an AI robotics company building the... ...obsessed team of the world's best engineers and operators. If you are... ...Engineer to join our ML Infrastructure team. In this role, you'll help build the training and inference systems that power our general...SeniorLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference Infrastructure Engineer. Be the first to apply!
- ai ml engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- ai research engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- ai developer San Francisco, CA
- ai engineer San Francisco, CA
- ai engineer remote San Francisco, CA
- senior infrastructure engineer San Francisco, CA
- lead infrastructure engineer San Francisco, CA




