Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Inference Systems Engineer

Jobleads-US

Sierra’s AI agents rely on foundation models; as a Software Engineer on Inference, you’ll help define the inference architecture across self-hosted models and third‑party providers. You’ll work on systems for serving and routing inference, managing capacity and quota, and optimizing latency, reliability, and cost.

This is a systems‑first role at the intersection of distributed infrastructure and AI. You don’t need to be an ML researcher—but you should love solving complex problems and applying

#J-18808-Ljbffr Jobleads-US
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Inference Systems Engineer in San Francisco, CA vacancy
  •  ...is the leading platform for customer-facing AI agents, based in San Francisco. We are seeking a Software Engineer on the Inference team to define architectures for self-...  ...scale. You will work across distributed systems to build, optimize, and operate core inference... 
    Suggested

    Jobleads-US

    San Francisco, CA
    1 day ago
  •  ...Baseten is hiring distributed systems engineers to build the runtime that powers large-scale LLM inference. You will deploy and operate Model APIs, routing, autoscaling, and orchestration on Kubernetes, while focusing on speed, reliability, and cost efficiency. You... 
    Suggested

    Jobleads-US

    San Francisco, CA
    1 day ago
  •  ...Tubi is seeking a Staff Software Engineer for the ML Infrastructure team to build world-class ML inference platforms powering recommendations, search, and content understanding. You will advance low-latency model serving, feature/vector stores, and experimentation engines... 
    Suggested

    Jobleads-US

    San Francisco, CA
    2 days ago
  •  ...priorities. We can hire people in any country where we have a legal entity. Responsibilities As a ML System Engineer on the AI & ML Platform’s Inference team, you will design and optimize large-scale model serving systems end-to-end. You will have the chance to... 
    Suggested
    Work at office
    Local area

    Atlassian

    San Francisco, CA
    2 days ago
  •  ...have a legal entity.About the Central AI OrgOur organization is dedicated to...  ...Search, Q&A, and Conversational AI system that integrates seamlessly with all...  ...This RoleAs a Senior ML System Engineer on the AI & ML Platform’s Inference team, you will design and optimize... 
    Suggested
    Work at office
    Local area

    Atlassian

    San Francisco, CA
    21 hours ago
  •  ...Baseten powers mission-critical inference for AI companies, uniting research, flexible infrastructure, and developer tooling to deploy...  ..., and reliability across the platform. As a distributed systems engineer on the Inference Platform, you will own end-to-end projects... 
    Flexible hours

    Jobleads-US

    San Francisco, CA
    1 day ago
  •  ...mission, we're investing deeply in Generative AI — pioneering advanced modeling and rapid...  ...re seeking a Principal Machine Learning Systems Engineer (P60) to lead technical directions of...  ...with large-scale model training, inference pipelines, or search/retrieval systems.ð... 
    Work at office
    Local area

    Atlassian

    San Francisco, CA
    4 days ago
  •  ...Modal is seeking a systems engineer to advance the container runtime stack used for inference workloads, working close to Linux, containers, storage, GPU drivers, and distributed systems. You will build production runtime infrastructure in Rust and Go, diagnose tough... 

    Jobleads-US

    San Francisco, CA
    1 day ago
  • $124k - $280k

     ...SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies...  ...on developing and implementing advanced AI and ML solutions to drive innovation and...  ...and optimising algorithms, models, and systems to enable intelligent decision-making and... 
    Full time
    H1b

    PwC

    San Francisco, CA
    21 hours ago
  • $300k - $400k

     ...Our first goal is to democratize frontier AI R&D across scientific disciplines. We...  ...lot more work for it. We’re looking for a Systems Engineer who knows how to find bottlenecks and...  ...sandboxes, agent harnesses, training, and inference run efficiently together across CPUs and... 

    Jobleads-US

    San Francisco, CA
    2 days ago
  • $166k - $343k

    Presales Systems Engineer - HPE Networking (Northern California)This role has been designated as ‘Remote/Teleworker’, which means you will primarily...  ...HPE.Job Description:HPE Networking is a leading provider of AI driven next-generation networking solutions. We advance the... 
    Full time
    Work experience placement
    Local area
    Immediate start
    Remote work
    Work from home

    Hewlett Packard Enterprise

    San Francisco, CA
    2 days ago
  • $180k - $230k

    San Francisco, CAProduct Systems Engineering - Product Systems /Full time /On-siteWanna join the adventure?Loft Orbital builds a space infrastructure...  ...service across Earth observation, IoT connectivity, on-orbit AI, national security missions, and more. Leveraging our... 
    Full time
    Temporary work

    Loft Orbital

    San Francisco, CA
    21 hours ago
  • $145k - $195k

    San Francisco, CAProduct Systems Engineering - Product Systems /Full time /On-siteWanna join the adventure?Loft Orbital builds a space infrastructure...  ...service across Earth observation, IoT connectivity, on-orbit AI, national security missions, and more. Leveraging our... 
    Full time
    Temporary work

    Loft Orbital

    San Francisco, CA
    21 hours ago
  •  ...Thinking Machines is seeking a Software Engineer, Distributed Systems to design and build the core distributed systems that run Inkling and Tinker across thousands of machines. You’ll work on orchestration, scheduling, storage, and networking to coordinate reliably at... 

    Jobleads-US

    San Francisco, CA
    5 days ago
  • $300k - $400k

     ...Mirendil Inc. is seeking a Systems Engineer in San Francisco to locate bottlenecks and optimize how compute is utilized. You will influence AI workload design, system co-design, and data movement across machines to maximize goodput while ensuring correctness under load... 

    Jobleads-US

    San Francisco, CA
    2 days ago
  •  ...Vercel is hiring an IT Systems Engineer to strengthen identity and device management for our global team. This hands-on role focuses on IAM,...  ...security, and automation, with opportunities to use Terraform and AI to improve IT workflows. You will partner with IT and... 
    Work at office

    Jobleads-US

    San Francisco, CA
    1 day ago
  •  ...priorities. We can hire people in any country where we have a legal entity. Responsibilities As a Principal ML System Engineer in the Rovo & AI Engineering org, you will contribute to Atlassian’s biggest bet and fastest area of growth, Rovo Chat. You will bring... 
    Work at office
    Local area

    Atlassian

    San Francisco, CA
    21 hours ago
  •  ...Hedra Inc. in San Francisco is seeking a Senior or Staff Software Engineer with deep expertise in building and operating distributed production systems. You will work on Hedra’s inference infrastructure, designing and operating systems that schedule, route, and manage... 

    Jobleads-US

    San Francisco, CA
    4 days ago
  • $144k - $192k

     ...Mission Summary: We are looking for a Machine Learning Systems Engineer to join our ML Acceleration team. In this role, you will be responsible...  ...machine learning model execution during training and inference, alongside a strong understanding of fundamental machine... 
    Work at office
    Remote work

    Motional

    San Francisco, CA
    1 day ago
  • $210k - $255k

     ...intelligence. As the only vertically integrated AI infrastructure company built from the...  ...the Role:We are seeking a Staff Software Engineer to design, build, and scale Crusoe Cloud'...  ...'ll ship customer-facing features, build systems from 0 to 1, and scale existing services... 
    Full time
    Temporary work

    Crusoe

    San Francisco, CA
    1 day ago
  • $140k - $210k

     ...their own destiny.Klaviyo is building an AI-first company—and that starts with how we...  ...’re looking for a Lead People Technology Engineer to be the first dedicated AI engineer within...  ...Finance to design and build intelligent systems that transform how we hire, develop,... 
    Shift work

    Klaviyo

    San Francisco, CA
    21 hours ago
  • $189.6k - $237k

     ...language model training and inference. The platform has been powering...  ...at the heart of the field of AI as an indispensable provider...  ...have:Strong excitement about system optimizationExperience with multi...  ...ML systemsStrong software engineering skills, proficient in... 
    Full time

    Scale AI

    San Francisco, CA
    1 day ago
  • $156k - $195k

    Ironclad is the leading AI contracting platform that transforms agreements into assets. Contracts move faster, insights surface...  ...LinkedIn.About the role:Ironclad is hiring a Senior Finance Systems & AI Engineer to own the data infrastructure, system integrations, and AI... 
    Full time
    Contract work

    Ironclad

    San Francisco, CA
    21 hours ago
  • Senior AI Engineer, MLOps & Distributed SystemsThe OpportunityJoin the team building the intelligence...  ...& Notifications pod is creating the systems that determine what message a member...  ...yearOperate reliable online and batch inference capabilities that meet clear contracts for... 
    Full time
    Internship
    Work at office
    Local area
    Remote work
    Worldwide
    3 days per week

    Hinge Health

    San Francisco, CA
    2 days ago
  • $250k - $350k

     ...ScaleScale’s mission is to develop reliable AI systems for the world’s most important decisions...  ...a Staff Machine Learning Research Engineer, you will operate across the full breadth...  ...areas as needed — training/fine-tuning, inference, memory and retrieval, evaluation and observability... 
    Full time

    Scale AI

    San Francisco, CA
    1 day ago
  • $163.2k - $220.8k

     ...opportunities for professional achievement and career growth. The AI Systems Manager (ASM) will help lead the firm’s enterprise artificial...  ...professionals, cross-functional teams and developers and engineers using the firm’s AI platforms.Create and maintain documentation... 
    Full time
    Contract work
    Remote work
    Worldwide

    Wilson Sonsini Goodrich & Rosati

    San Francisco, CA
    1 day ago
  •  ...Acceler8 Talent partners with a well-funded AI networking hardware startup in the SF Bay Area seeking a Hardware Product Engineer - Thermal to drive development and manufacturing...  ...for high-performance AI networking systems. You will own productization, partner with... 

    Jobleads-US

    San Francisco, CA
    1 day ago
  • $320k - $405k

     ...Staff / Senior Physical Security Systems Engineer Remote-Friendly (Travel Required) | San Francisco, CA About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and... 
    Remote job
    For contractors
    Work at office
    Visa sponsorship
    Flexible hours

    Jobleads-US

    San Francisco, CA
    2 days ago
  • $156k - $195k

     ...About the team We’re looking for a Senior Design Systems Engineer (Web) to join Turo’s Design Systems team. You’ll help us architect, build,...  ...automation for scale, and help lead our team’s efforts to roll out AI-assisted workflows across Product, Design, and Engineering.... 
    Full time
    Work at office
    Local area
    Flexible hours
    Shift work
    3 days per week

    Jobleads-US

    San Francisco, CA
    3 days ago
  •  .... is building the design suite for molecules, training frontier AI/ML models to advance drug discovery. You will develop core frameworks...  ...training and evaluation, in collaboration with researchers and engineers. Your role focuses on creating a scalable, reliable training... 

    Jobleads-US

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Inference Systems Engineer. Be the first to apply!