Staff Inference Systems Engineer High-Throughput AI
Kindredventures
Kindredventures is recruiting infrastructure engineers to scale large-scale inference and evaluation around a physics-based LPM initiative. You will work on high-throughput systems, latency-optimized serving, and distributed orchestration across Kubernetes, Ray, and Slurm. Ideal candidates have a track record in building efficient inference stacks, GPU-aware optimization, and deep learning frameworks like PyTorch or JAX. Collaboration with researchers and a focus on reliability are essential. #J-18808-Ljbffr
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Staff Inference Systems Engineer High-Throughput AI in San Francisco, CA vacancy
$250k - $320k
(Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure About The Role We're looking... ...automated self-healing system so each new failure mode... ...performance, latency, throughput, and efficiency of our model... ...developers get high-performance inference that...SuggestedPermanent employmentFull timeTogether Computer Inc
San Francisco, CA3 days ago- ...a Machine Learning Systems Administrator / DevOps Engineer, you will maintain and... ...training and our inference cloud. You’ll split... ...productivity, training throughput, and the performance... ...work supporting ML/AI infrastructure, including... ...) Experience with high-performance...SuggestedWork at officeRemote workRelocation package
Zyphra
San Francisco, CA3 days ago $250k - $350k
...mission is to develop reliable AI systems for the world’s most... ...foundry, we provide the high-quality data and full-stack... ...like.About the RoleAs a Staff Machine Learning Research Engineer, you will operate across... ...— training/fine-tuning, inference, memory and retrieval, evaluation...SuggestedFull timeScale AI
San Francisco, CA8 days ago- ...Responsibilities As a ML System Engineer on the AI & ML Platform’s Inference team, you will design and optimize... ...global KV cache).Optimize latency and throughput of model inference under real... ...production workloads.Build reliable, high-concurrency serving systems that...SuggestedWork at officeLocal area
Atlassian
San Francisco, CA5 days ago - Zipline is seeking a Routing engineer to design safe and efficient flight paths for Zipline... ...by Zips, balancing reliability, throughput, and flight performance in real time. You... ...flight operations teams and contribute to a high-availability, low-latency production stack...Suggested
$204k - $216k
...Description About Sapience AI Sapience AI is the... ...in silos, in legacy systems, in the heads of a few... ...You build and run the inference infrastructure that... ...research, and platform engineering, and you make the difference... ...of latency, throughput, and performance optimization...Sapience AI Corporation
San Francisco, CA23 days ago- ...deeply in Generative AI — pioneering advanced... ...Principal Machine Learning Systems Engineer (P60) to lead... ...algorithms with reliable, high-performance infrastructure... ....Optimize latency, throughput, and resource efficiency... ...scale model training, inference pipelines, or search/...Work at officeLocal area
Atlassian
San Francisco, CA6 days ago - ...OpenAI in San Francisco seeks an experienced Software Engineer to help bring inference workloads to AWS Trainium and build the software stack to run... ...kernels, compilers, and model execution. You will develop high‑performance kernels, improve compiler support, and ensure...
OpenAI
San Francisco, CA3 days ago - ...Machine Learning System EngineerAs a ML System Engineer on the AI & ML Platform's Inference team, you will design and optimize large... ...cache).Optimize latency and throughput of model inference under real... ...production workloads.Build reliable, high-concurrency serving systems...
Trello
San Francisco, CA4 days ago - ...A leading tech company in San Francisco is seeking a backend engineer to help build an innovative search engine from scratch. The role involves developing and maintaining high throughput, low latency systems and creating data processing pipelines that handle millions of...
Exa Corporation
San Francisco, CA18 hours ago $320k - $405k
...reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for... ...growing group of committed researchers, engineers, policy experts, and business leaders working... ...hybrid policy: Currently, we expect all staff to be in one of our offices at least 25%...Visa sponsorshipAnthropic
San Francisco, CA4 days ago- ...seeking a Machine Learning Engineer to optimize LLM inference performance in production.... ...performance from GPUs, distributed systems, and multi-node setups with... .... You will work on high-performance infrastructure,... ...quantisation, and caching to scale AI workloads efficiently. #J-1...
Acceler8 Talent
San Francisco, CA20 hours ago - ...be shaped by people and AI agents working together... ...build the evaluation systems, datasets, quality signals... ...Machine Learning Engineer, you’ll tackle the open... ...customer outcomes.Make high-leverage technical decisions... ...architecture, and inference; balancing quality with...Work at officeLocal area
Atlassian
San Francisco, CA4 days ago - ...About Engram EngramToday’s AI is a brilliant stranger: it... ...time, the better we become at inference time. We’re already working with... ...You’ll be among the first ML Systems Engineer, joining a team of machine... ...technical environments and shipping high‑quality code in a fast‑paced...Work at office
Engram
San Francisco, CA4 days ago $124k - $280k
...in data and analytics engineering focus on leveraging advanced... ...implementing advanced AI and ML solutions to... ...algorithms, models, and systems to enable intelligent decision... ...to develop and sustain high performing, diverse,... ...optimization, and throughput modeling — while working...Full timeH1bPwC
San Francisco, CA6 days ago$125.5k - $230.2k
.... The opportunity We are seeking AI Systems Engineers to build and operate the foundational substrate... .... Own secure execution and inference: Ray Serve, vLLM/NIM/Triton, and NVIDIA... ...and cross-environment replication for high availability (Velero, CloudNativePG, Cilium...Contract workSummer holidayFlexible hoursEY
San Francisco, CA18 hours ago$190k - $310k
...Research Systems EngineerAs a research systems engineer, you'll train frontier-scale models and... ...from production dataBuild high-performance internal tools... ...engineers to scale training and inference efficientlyWhat we're... ...learning. Our applied AI team sits side-by-side with...Full timeWork at officeRelocationVisa sponsorshipApplied Compute
San Francisco, CA5 days ago- ...Superintelligence Cloud, is a leader in AI cloud infrastructure serving... ...What You’ll Do Architect high-performance networking... ...operational visibility. Mentor engineers and cross-functional teams on... ...for low-latency and high-throughput data paths, including GPU-to-GPU...Work at officeLocal areaWork from homeFlexible hours
Lambda
San Francisco, CA4 days ago - ...building the leading AI-native platform... ...across the healthcare system. Abby Care... ...caregivers in delivering high-quality care at... ...looking for a Staff Healthcare Analyst... ...with Finance, Engineering, and Product on the... ...Background in causal inference, survival analysis...Full timeContract workWork experience placement
- ...Anthropic is seeking a Senior ML Engineer to join the Core Systems team to optimize training and inference infrastructure for the Claude family of foundation models. You will design high-performance distributed pipelines and work with researchers to remove scaling bottlenecks...
AI Breaking Wire
San Francisco, CA3 days ago - ...security-first enterprise AI company. We build... ...enterprises who are building AI systems. We believe that our... ...a team of researchers, engineers, designers, and more,... ...such as:Building a high-performance data loading... ...checkpointing).Improve training throughput and stability on multi-...Full timeWork at officeLocal areaRemote workHome office
Cohere
San Francisco, CA4 days ago - ...We build the systems that make large-scale visual inference fast, reliable,... ...We’re a small, highly technical team... ...leading investors. Engineers at Hedra work... ...for a Senior or Staff Software Engineer... ..., handle high-throughput workloads, and... ...to come from an AI company or...Work at office
Hedra Inc.
San Francisco, CA1 day ago - ...Senior/Staff Rendering Systems EngineerWorld Labs is a frontier AI research and product company advancing spatial intelligence, the next frontier... ...seeking a Senior/Staff Rendering Systems Engineer to build and scale high-throughput, Unreal Engine–based rendering systems...Work at officeVisa sponsorshipWork visaRelocation packageFlexible hours
WORLD LABS
San Francisco, CA5 days ago - ...Chroma Inc. is seeking a storage systems engineer in San Francisco to research, design, implement and verify components of our scalable storage... ...to deliver reliable solutions. You will contribute to high-performance storage for databases and other demanding applications...
Chroma
San Francisco, CA3 days ago $190k - $274.5k
...thirds of U.S. high schoolers and half... ...and deliver AI-powered learning... ...ML Engineering team builds the... ...recommendation and search systems across multiple... ...architecture. As a Staff Machine... ...Improve latency, throughput, reliability, and... ...near–real-time inference systems at scale...Temporary workWork at officeImmediate start3 days per weekQuizlet
San Francisco, CA3 days ago$350k
...understanding and debugging AI systems. We build world-class, AI-backed... ...an exceptional AI systems engineer to lead the design and development... .... As an early member of a highly collaborative team, you will... ...Interpretability: Inference stacks that are as performant...Visa sponsorshipFlexible hoursTransluce
San Francisco, CA4 days ago$124k - $280k
...people in data and analytics engineering focus on leveraging advanced technologies... ...and implementing advanced AI and ML solutions to drive... ...algorithms, models, and systems to enable intelligent decision... ...ability to develop and sustain high performing, diverse, and inclusive...Full timeH1bPwC
San Francisco, CA7 days ago- ...vehicles, every Physical AI model is trained... .... Our open-source engine, Daft, is purpose-... ...engineer has high ownership across the... ...on the Data Systems team, you will build... ...storage and a high-throughput data engine over petabytes... ...training and inference. We operate as a...Work at officeFlexible hoursNight shift
Mixpeek
San Francisco, CA4 days ago $190k - $230k
...Are Lightning AI is the company behind... ...and deploying AI systems—designed to take... ...training, and production inference, with security,... ...are looking for a Staff Developer Advocate... ...gap between our engineering teams and the AI... ...You’ll Do Create high-impact,...Work at officeWork from homeFlexible hoursShowcify, Inc.
San Francisco, CA3 days ago$272k - $336k
...Senior Staff Regulatory and Compliance Systems EngineerWaymo is an autonomous driving technology company with... ...across 15+ U.S. states.Waymo's Systems Engineering team works together to blend... ...groundbreaking new ways. We set the high performance standards that ensure our...Odd jobFull timeRemote workWaymo
San Francisco, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Inference Systems Engineer High-Throughput AI. Be the first to apply!
Related searches
- project engineer assistant project manager San Francisco, CA
- staff security engineer San Francisco, CA
- staff engineer San Francisco, CA
- research assistant engineering San Francisco, CA
- senior staff systems engineer San Francisco, CA
- engineering aide San Francisco, CA
- senior staff engineer San Francisco, CA
- assistant engineering manager San Francisco, CA
- assistant chief engineer San Francisco, CA
- staff data engineer San Francisco, CA