Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Inference Infrastructure Engineer

OpenAI

OpenAI is seeking an experienced software engineer to join the GPT Infrastructure team and help build an automated inference optimization platform that scales research prototypes into production‑ready solutions. You will design durable APIs and control‑plane services, integrate hardware and software toolchains, and collaborate across Research, Infrastructure, Security, and Partnerships to deliver reliable, observable systems with strong developer ergonomics. #J-18808-Ljbffr OpenAI

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior AI Inference Infrastructure Engineer in San Francisco, CA vacancy
  •  ...seeking an experienced systems generalist to build an automated inference optimization platform across hardware, compiler, and runtime...  ...data. This cross-stack role collaborates with research, infrastructure, security, product, and partnerships to deliver scalable, #J... 
    Senior

    Slope

    San Francisco, CA
    20 hours ago
  • $250k

     ...Ready to architect AI infrastructure that powers next-generation research and cloud...  ...team is now building a serverless inference platform, beginning with cost-efficient...  ...is a unique chance to join as a Senior Inference Platform Engineer at an early stage and help define... 
    Senior
    Full time
    San Francisco, CA
    more than 2 months ago
  • Oscar Associates Limited (US) in San Francisco offers a hybrid Senior ML Inference Engineer role. You will enhance AI-native infrastructure powering generative and multimodal models, with ownership across inference systems and production performance. The ideal candidate... 
    Senior

    Oscar Technology

    San Francisco, CA
    5 days ago
  • Parafin, Inc. is seeking a Software Engineer to lead the evolution of its ML Platform within the Infrastructure team. You will build scalable, reliable systems for model experimentation, training, evaluation, inference, and retraining powering underwriting and ML-driven... 
    Senior

    Parafin Inc

    San Francisco, CA
    2 days ago
  • $120k - $200k

     ...Senior Infrastructure Engineer At Bland.com, our goal is to empower enterprises to make AI-phone agents at scale. Based out of San Francisco, we're a quickly growing team striving...  ...real-time voice processing, scale ML inference, and integrate with enterprise telephony... 
    Senior
    Work at office
    Night shift

    Bland AI

    San Francisco, CA
    8 hours ago
  •  ...Senior Network Engineer Houston; New York; San Francisco; Seattle About Nscale...  ...GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large...  ...fabrics, management networks, inference traffic paths, and storage... 
    Senior

    Nscale

    San Francisco, CA
    2 days ago
  • $190k - $280k

     ...Senior Network Engineer San Francisco About the Role Together AI is looking for a Senior Network Engineer to design, deploy...  ...operate the global network infrastructure supporting our production...  ...Understanding of AI training and inference traffic patterns and the... 
    Senior
    Full time

    Together AI

    San Francisco, CA
    2 days ago
  • $200k

     ...We do this by building the financial infrastructure that makes it easier for more people...  ...to every product we build. As a Senior Infrastructure Engineer, you will shape the platform infrastructure...  ...We may use artificial intelligence (AI) tools to support parts of the... 
    Senior
    Work at office
    2 days per week

    AngelList

    San Francisco, CA
    24 days ago
  • $216.2k - $270.25k

    Scale GP is building the infrastructure that makes enterprise AI seamless. We are looking for a Senior or Staff Infrastructure Engineer to act as a primary technical lead, engineering the...  ...' for our knowledge retrieval and inference engines. You won't just be managing resources... 
    Senior
    Full time

    Scale AI

    San Francisco, CA
    2 days ago
  • $225k

     ...opportunity?  Join a rapidly scaling AI cloud infrastructure provider building next-generation...  ...AI training, experimentation, and inference workloads. The company is operating...  .... The company is looking for a Senior Network Engineer to design, deploy, and support ultra... 
    Senior
    Full time
    Remote work
    San Francisco, CA
    more than 2 months ago
  • $160k - $230k

     ...About the Role Together AI is building the AI Acceleration Cloud, an end-to-end platform for...  ...generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. As a Senior Backend Engineer, you will play a key role in... 
    Senior
    Full time
    Remote work

    Together Ai

    San Francisco, CA
    1 day ago
  •  ...About David AI David AI is the first audio data...  ...of former Scale AI engineers and operators. In less...  ...of product engineers, infrastructure specialists, and machine...  ...About this role As a Senior Software Engineer,...  ...data. Scaled up inference and train compute for... 
    Senior
    Full time
    Work at office

    David AI

    San Francisco, CA
    21 hours ago
  • Causal is building a Large Physics foundation Model and seeks infrastructure engineers for high-throughput, low-latency inference at scale in San Francisco. You will work on evaluating physical observations, backtesting, and large-batch workflows, collaborating with researchers... 

    causal

    San Francisco, CA
    4 days ago
  •  ...worldwide.We’re a team of engineers, clinicians, and...  ...Function of PositionAs a Senior Software Engineer -...  ...development for robotic motion AI. You will work closely...  ...and maintain software infrastructure for robotic...  ...data processing, model inference, and experimentation.... 
    Senior
    Local area
    Worldwide
    Flexible hours

    Intuitive Surgical

    San Francisco, CA
    2 days ago
  •  ...Superintelligence Cloud, is building the world's premier AI cloud storage platform in the San Francisco Bay Area. We seek a Senior Software Engineer to join the storage team, developing next‑...  ...environment that powers AI training and inference across petabyte-scale datasets. You will... 
    Senior

    Lambda

    San Francisco, CA
    1 day ago
  • Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. The storage and observability team is responsible for designing, implementing... 
    Senior

    Together AI

    San Francisco, CA
    2 days ago
  • $300 per month

     ...only vertically integrated AI infrastructure company built from the ground...  ...Crusoe, our Production Engineering team ensures the reliability...  ...platform. We’re looking for a Senior Production Engineer with a...  ...large-scale training and inference clustersAutomate observability... 
    Senior
    Temporary work

    Crusoe

    San Francisco, CA
    2 days ago
  •  ...the San Francisco Bay Area is seeking a Senior Software Engineer to join the Mk8s team. You will design...  ...GPU-aware orchestration that powers AI workloads across a distributed platform...  ...Kubernetes, and platform services for inference, while collaborating across stacks to... 
    Senior

    Lambda

    San Francisco, CA
    3 days ago
  • $245k - $295k

     ...the only vertically integrated AI infrastructure company built from the ground up...  ...the Role We are seeking a Senior Manager, Infrastructure Platform Engineering to lead a team building core systems...  ...GPU clusters, AI training, and inference workloads Working knowledge... 
    Senior
    Temporary work
    Immediate start

    Crusoe

    San Francisco, CA
    11 days ago
  • $238k - $290k

     ...combining frontier agentic AI, an enterprise-grade...  ...a Backend Platform Engineer at Harvey, you will help...  ...on. In this mid-to-senior level role, you’ll design...  ...with Model Infrastructure team to tackle challenges...  ...high-throughput model inference, managing streaming and... 
    Senior
    Flexible hours
    Shift work

    Harvey

    San Francisco, CA
    2 days ago
  • $151.8k - $265.35k

     ...exceptional content effortlessly. The AI for Engineering team builds a scalable, production-grade...  ...orchestration, tool integration, memory systems, inference services, data flows, evaluation loops,...  ...into adaptive AI systems.Mentor senior engineers in modern AI system design,... 
    Senior
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe Systems

    San Francisco, CA
    2 days ago
  • $295k - $405.5k

     ...Wisconsin.About this roleAs the Senior Staff Machine Learning Platform Engineer, you will own the...  ...advantage of modern AI productivity tools. You...  ...platform including training, inference, feature management,...  ...distributed systems, ML infrastructure, and cloud architecture.... 
    Senior
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday
    Flexible hours
    3 days per week

    Faire

    San Francisco, CA
    5 days ago
  •  ...notch technology products.As a Senior Lead Software Engineer at JPMorgan Chase within the Corporate Sector, Infrastructure Platforms team, you are an...  ...platforms optimized for AI/ML workloads.Partner with AI...  ..., ML training, and inference.Experience with Infrastructure... 
    Senior
    For contractors

    JP Morgan Chase

    San Francisco, CA
    3 days ago
  • $250k - $280k

     ...Job Description Job Description Staff / Principal Founding Engineer (Backend-Leaning) – AI Systems Platform San Francisco (in-office) $250–280K base + 0.75–1.5% equity (package flexible for the right person) Description: We’re partnering with a well-funded... 
    Senior
    Work at office
    Immediate start
    Flexible hours

    Xpertalent

    San Francisco, CA
    6 days ago
  • $180k - $250k

     ...Senior Infrastructure Engineer Title of Role: Senior Infrastructure Engineer Location: San Francisco, hybrid Company Stage of Funding: Seed - AI, Devtools, Enterprise, Data Office Type: Hybrid Salary: $180K-$250K Company Description We're representing... 
    Senior
    Work at office

    Recruiting from Scratch

    San Francisco, CA
    1 day ago
  •  ...Description Confidential client — a Series A AI research lab (11-50 employees)...  ...leading venture investors and advised by senior AI research leaders. Full-Time, In-person...  ...About the Role: As a Senior Software Engineer, Infrastructure and Platform, you will design and build... 
    Senior
    Full time
    H1b
    Visa sponsorship

    Thomas Talent Network

    San Francisco, CA
    18 days ago
  • $140k - $200k

     ...pioneering the future of Physical AI. Our advanced vision...  ...systems - from robots to smart infrastructure - building a safer and more...  ...Data Infrastructure / Quality Engineering role will play a crucial...  ...high-performance GPU cloud inference services, with specific expertise... 
    Senior
    Work experience placement
    Local area

    Ouster

    San Francisco, CA
    7 days ago
  • $172.5k - $260.1k

     ...SalesforceSalesforce is the #1 AI CRM, where humans with...  ...Salesforce.Join the Engineering Development and...  ...— a foundational data infrastructure that powers analytics,...  ...engineers across varying seniority levels — building high...  ..., and real-time inference, and how they shape telemetry... 
    Senior
    Full time
    Contract work

    Salesforce

    San Francisco, CA
    5 days ago
  • $240k - $360k

     ...the RoleWe're looking for a Senior Staff Data Engineer to be the technical...  ...evolves as the company's AI ambitions scale. You'll work...  ..., serving layers, and the infrastructure that makes ML models production...  ...model training and inference workflows reliably.Raise the... 
    Senior
    Work at office
    Local area
    Immediate start
    Remote work
    Worldwide
    3 days per week

    Hinge Health

    San Francisco, CA
    6 days ago
  • $210k - $300k

     ...About Nimble Nimble is an AI robotics company building the...  ...obsessed team of the world's best engineers and operators. If you are...  ...Engineer to join our ML Infrastructure team. In this role, you'll help build the training and inference systems that power our general... 
    Senior
    Local area
    Flexible hours

    Nimble Robotics

    San Francisco, CA
    18 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Inference Infrastructure Engineer. Be the first to apply!