AI Inference Systems Engineer
Jobleads-US
Sierra’s AI agents rely on foundation models; as a Software Engineer on Inference, you’ll help define the inference architecture across self-hosted models and third‑party providers. You’ll work on systems for serving and routing inference, managing capacity and quota, and optimizing latency, reliability, and cost.
This is a systems‑first role at the intersection of distributed infrastructure and AI. You don’t need to be an ML researcher—but you should love solving complex problems and applying
#J-18808-Ljbffr Jobleads-US- ...is the leading platform for customer-facing AI agents, based in San Francisco. We are seeking a Software Engineer on the Inference team to define architectures for self-... ...scale. You will work across distributed systems to build, optimize, and operate core inference...Suggested
- ...Baseten is hiring distributed systems engineers to build the runtime that powers large-scale LLM inference. You will deploy and operate Model APIs, routing, autoscaling, and orchestration on Kubernetes, while focusing on speed, reliability, and cost efficiency. You...Suggested
- ...Tubi is seeking a Staff Software Engineer for the ML Infrastructure team to build world-class ML inference platforms powering recommendations, search, and content understanding. You will advance low-latency model serving, feature/vector stores, and experimentation engines...Suggested
- ...priorities. We can hire people in any country where we have a legal entity. Responsibilities As a ML System Engineer on the AI & ML Platform’s Inference team, you will design and optimize large-scale model serving systems end-to-end. You will have the chance to...SuggestedWork at officeLocal area
- ...have a legal entity.About the Central AI OrgOur organization is dedicated to... ...Search, Q&A, and Conversational AI system that integrates seamlessly with all... ...This RoleAs a Senior ML System Engineer on the AI & ML Platform’s Inference team, you will design and optimize...SuggestedWork at officeLocal area
- ...Baseten powers mission-critical inference for AI companies, uniting research, flexible infrastructure, and developer tooling to deploy... ..., and reliability across the platform. As a distributed systems engineer on the Inference Platform, you will own end-to-end projects...Flexible hours
- ...mission, we're investing deeply in Generative AI — pioneering advanced modeling and rapid... ...re seeking a Principal Machine Learning Systems Engineer (P60) to lead technical directions of... ...with large-scale model training, inference pipelines, or search/retrieval systems.ð...Work at officeLocal area
- ...Modal is seeking a systems engineer to advance the container runtime stack used for inference workloads, working close to Linux, containers, storage, GPU drivers, and distributed systems. You will build production runtime infrastructure in Rust and Go, diagnose tough...
$124k - $280k
...SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies... ...on developing and implementing advanced AI and ML solutions to drive innovation and... ...and optimising algorithms, models, and systems to enable intelligent decision-making and...Full timeH1b$300k - $400k
...Our first goal is to democratize frontier AI R&D across scientific disciplines. We... ...lot more work for it. We’re looking for a Systems Engineer who knows how to find bottlenecks and... ...sandboxes, agent harnesses, training, and inference run efficiently together across CPUs and...$166k - $343k
Presales Systems Engineer - HPE Networking (Northern California)This role has been designated as ‘Remote/Teleworker’, which means you will primarily... ...HPE.Job Description:HPE Networking is a leading provider of AI driven next-generation networking solutions. We advance the...Full timeWork experience placementLocal areaImmediate startRemote workWork from home$180k - $230k
San Francisco, CAProduct Systems Engineering - Product Systems /Full time /On-siteWanna join the adventure?Loft Orbital builds a space infrastructure... ...service across Earth observation, IoT connectivity, on-orbit AI, national security missions, and more. Leveraging our...Full timeTemporary work$145k - $195k
San Francisco, CAProduct Systems Engineering - Product Systems /Full time /On-siteWanna join the adventure?Loft Orbital builds a space infrastructure... ...service across Earth observation, IoT connectivity, on-orbit AI, national security missions, and more. Leveraging our...Full timeTemporary work- ...Thinking Machines is seeking a Software Engineer, Distributed Systems to design and build the core distributed systems that run Inkling and Tinker across thousands of machines. You’ll work on orchestration, scheduling, storage, and networking to coordinate reliably at...
$300k - $400k
...Mirendil Inc. is seeking a Systems Engineer in San Francisco to locate bottlenecks and optimize how compute is utilized. You will influence AI workload design, system co-design, and data movement across machines to maximize goodput while ensuring correctness under load...- ...Vercel is hiring an IT Systems Engineer to strengthen identity and device management for our global team. This hands-on role focuses on IAM,... ...security, and automation, with opportunities to use Terraform and AI to improve IT workflows. You will partner with IT and...Work at office
- ...priorities. We can hire people in any country where we have a legal entity. Responsibilities As a Principal ML System Engineer in the Rovo & AI Engineering org, you will contribute to Atlassian’s biggest bet and fastest area of growth, Rovo Chat. You will bring...Work at officeLocal area
- ...Hedra Inc. in San Francisco is seeking a Senior or Staff Software Engineer with deep expertise in building and operating distributed production systems. You will work on Hedra’s inference infrastructure, designing and operating systems that schedule, route, and manage...
$144k - $192k
...Mission Summary: We are looking for a Machine Learning Systems Engineer to join our ML Acceleration team. In this role, you will be responsible... ...machine learning model execution during training and inference, alongside a strong understanding of fundamental machine...Work at officeRemote work$210k - $255k
...intelligence. As the only vertically integrated AI infrastructure company built from the... ...the Role:We are seeking a Staff Software Engineer to design, build, and scale Crusoe Cloud'... ...'ll ship customer-facing features, build systems from 0 to 1, and scale existing services...Full timeTemporary work$140k - $210k
...their own destiny.Klaviyo is building an AI-first company—and that starts with how we... ...’re looking for a Lead People Technology Engineer to be the first dedicated AI engineer within... ...Finance to design and build intelligent systems that transform how we hire, develop,...Shift work$189.6k - $237k
...language model training and inference. The platform has been powering... ...at the heart of the field of AI as an indispensable provider... ...have:Strong excitement about system optimizationExperience with multi... ...ML systemsStrong software engineering skills, proficient in...Full time$156k - $195k
Ironclad is the leading AI contracting platform that transforms agreements into assets. Contracts move faster, insights surface... ...LinkedIn.About the role:Ironclad is hiring a Senior Finance Systems & AI Engineer to own the data infrastructure, system integrations, and AI...Full timeContract work- Senior AI Engineer, MLOps & Distributed SystemsThe OpportunityJoin the team building the intelligence... ...& Notifications pod is creating the systems that determine what message a member... ...yearOperate reliable online and batch inference capabilities that meet clear contracts for...Full timeInternshipWork at officeLocal areaRemote workWorldwide3 days per week
$250k - $350k
...ScaleScale’s mission is to develop reliable AI systems for the world’s most important decisions... ...a Staff Machine Learning Research Engineer, you will operate across the full breadth... ...areas as needed — training/fine-tuning, inference, memory and retrieval, evaluation and observability...Full time$163.2k - $220.8k
...opportunities for professional achievement and career growth. The AI Systems Manager (ASM) will help lead the firm’s enterprise artificial... ...professionals, cross-functional teams and developers and engineers using the firm’s AI platforms.Create and maintain documentation...Full timeContract workRemote workWorldwide- ...Acceler8 Talent partners with a well-funded AI networking hardware startup in the SF Bay Area seeking a Hardware Product Engineer - Thermal to drive development and manufacturing... ...for high-performance AI networking systems. You will own productization, partner with...
$320k - $405k
...Staff / Senior Physical Security Systems Engineer Remote-Friendly (Travel Required) | San Francisco, CA About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and...Remote jobFor contractorsWork at officeVisa sponsorshipFlexible hours$156k - $195k
...About the team We’re looking for a Senior Design Systems Engineer (Web) to join Turo’s Design Systems team. You’ll help us architect, build,... ...automation for scale, and help lead our team’s efforts to roll out AI-assisted workflows across Product, Design, and Engineering....Full timeWork at officeLocal areaFlexible hoursShift work3 days per week- .... is building the design suite for molecules, training frontier AI/ML models to advance drug discovery. You will develop core frameworks... ...training and evaluation, in collaboration with researchers and engineers. Your role focuses on creating a scalable, reliable training...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Inference Systems Engineer. Be the first to apply!
- senior ai engineer San Francisco, CA
- ai developer San Francisco, CA
- ai engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- ai engineer remote San Francisco, CA
- machine learning ai engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- ai research engineer San Francisco, CA
- senior linux systems engineer San Francisco, CA
- system engineer contract San Francisco, CA


