Staff Inference Systems Engineer — High-Throughput AI
Kindredventures
Kindredventures is recruiting infrastructure engineers to scale large-scale inference and evaluation around a physics-based LPM initiative. You will work on high-throughput systems, latency-optimized serving, and distributed orchestration across Kubernetes, Ray, and Slurm. Ideal candidates have a track record in building efficient inference stacks, GPU-aware optimization, and deep learning frameworks like PyTorch or JAX. Collaboration with researchers and a focus on reliability are essential. #J-18808-Ljbffr Kindredventures
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Staff Inference Systems Engineer — High-Throughput AI in San Francisco, CA vacancy
- Databricks is seeking a Staff Software Engineer for GenAI inference to drive the architecture, development, and... ...engine. The role involves high-throughput, low-latency solutions and full GenAI... ...as well as CUDA and distributed systems design skills. Competitive pay range...Suggested
- Hyphen Connect is seeking a hybrid Systems Engineer and AI Researcher to lead the design and implementation of our agent evaluation framework... .... You will architect sandboxed execution environments, high-throughput reinforcement learning feedback loops, and robust...SuggestedWork at office
$250k - $320k
(Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure About The Role We're looking... ...automated self-healing system so each new failure mode... ...performance, latency, throughput, and efficiency of our model... ...developers get high-performance inference that...SuggestedPermanent employmentFull timeTogether Computer Inc
San Francisco, CA21 hours ago- ...a Machine Learning Systems Administrator / DevOps Engineer, you will maintain and... ...training and our inference cloud. You’ll split... ...productivity, training throughput, and the performance... ...work supporting ML/AI infrastructure, including... ...) Experience with high-performance...SuggestedWork at officeRemote workRelocation package
Zyphra
San Francisco, CA1 day ago $250k - $350k
...mission is to develop reliable AI systems for the world’s most... ...foundry, we provide the high-quality data and full-stack... ...like.About the RoleAs a Staff Machine Learning Research Engineer, you will operate across... ...— training/fine-tuning, inference, memory and retrieval, evaluation...SuggestedFull timeScale AI
San Francisco, CA6 days ago- ...Responsibilities As a ML System Engineer on the AI & ML Platform’s Inference team, you will design and optimize... ...global KV cache).Optimize latency and throughput of model inference under real... ...production workloads.Build reliable, high-concurrency serving systems that...Work at officeLocal area
Atlassian
San Francisco, CA3 days ago - ...a leading platform for customer-facing AI agents, based in San Francisco with offices... ..., and Asia. We are seeking a Software Engineer on Inference to define Sierra’s inference... ...on fast, reliable, and cost-efficient systems. This role is a systems-first position...
$194k - $266k
...United States Position Title: Senior Systems Engineer, AI Gateway About Us At Cloudflare, we... ...San Francisco, CA About the Role AI inference is becoming core infrastructure. Every... ...the stack from distributed systems and high-throughput APIs to developer-facing workflows,...Temporary workLocal areaFlexible hours- ...deeply in Generative AI — pioneering advanced... ...Principal Machine Learning Systems Engineer (P60) to lead... ...algorithms with reliable, high-performance infrastructure... ....Optimize latency, throughput, and resource efficiency... ...scale model training, inference pipelines, or search/...Work at officeLocal area
Atlassian
San Francisco, CA4 days ago - ...is the leading platform for customer-facing AI agents, based in San Francisco. We are seeking a Software Engineer on the Inference team to define architectures for self-... ...at scale. You will work across distributed systems to build, optimize, and operate core inference...
- Crusoe in San Francisco is seeking a Staff Technical Program Manager to lead the Managed Inference platform team. You will ensure end-to-end program delivery for LLM workloads, driving innovation in AI infrastructure powered by clean energy. The ideal candidate has extensive...
- At Atlassian, we are seeking an ML System Engineer to join the AI & ML Platform Inference team. You will design and optimize large-scale model serving systems from distributed infrastructure to low-level performance tuning, enabling reliable, scalable inference across...
- Cloudflare is seeking a Senior Systems Engineer for its AI inference platform. You will design and build core infrastructure powering AI inference across a global network, working with AI/ML engineers, hardware partners, and product teams to solve distributed systems challenges...
- ...be shaped by people and AI agents working together... ...build the evaluation systems, datasets, quality signals... ...Machine Learning Engineer, you’ll tackle the open... ...customer outcomes.Make high-leverage technical decisions... ...architecture, and inference; balancing quality with...Work at officeLocal area
Atlassian
San Francisco, CA1 day ago - ...About Engram EngramToday’s AI is a brilliant stranger: it... ...time, the better we become at inference time. We’re already working with... ...You’ll be among the first ML Systems Engineer, joining a team of machine... ...technical environments and shipping high‑quality code in a fast‑paced...Work at office
Engram
San Francisco, CA1 day ago - OpenAI in San Francisco is seeking an experienced systems generalist to build an automated inference optimization platform across hardware, compiler, and runtime contexts. You will design the OpenAI-hosted control plane and partner-side software, focusing on reliable long...
$124k - $280k
...in data and analytics engineering focus on leveraging advanced... ...implementing advanced AI and ML solutions to... ...algorithms, models, and systems to enable intelligent decision... ...to develop and sustain high performing, diverse,... ...optimization, and throughput modeling — while working...Full timeH1bPwC
San Francisco, CA4 days ago- Baseten powers mission-critical AI inference at scale. We seek distributed systems engineers to own the runtimes and APIs that run large-scale LLM inference and hosted endpoints. You’ll work across the stack from developer tooling to orchestration on Kubernetes, driving...
- ...Superintelligence Cloud, is a leader in AI cloud infrastructure serving... ...What You’ll Do Architect high-performance networking... ...operational visibility. Mentor engineers and cross-functional teams on... ...for low-latency and high-throughput data paths, including GPU-to-GPU...Work at officeLocal areaWork from homeFlexible hours
Lambda
San Francisco, CA1 day ago $203k - $275k
...industry by building an AI platform for wealth... ...we are hiring a Staff Database... ...estate that is the system of record for hundreds... ...staff-level database engineers, working directly with... ...and AWS DMS - for throughput, lag, and correctness... ...are able to reward high performance and ensure...Work at officeImmediate start3 days per weekAltruist
San Francisco, CA5 days ago$204k - $216k
...Description About Sapience AI Sapience AI is the... ...in silos, in legacy systems, in the heads of a few... ...You build and run the inference infrastructure that... ...research, and platform engineering, and you make the difference... ...of latency, throughput, and performance optimization...- ...We build the systems that make large-scale visual inference fast, reliable,... ...We’re a small, highly technical team... ...leading investors. Engineers at Hedra work... ...for a Senior or Staff Software Engineer... ..., handle high-throughput workloads, and... ...to come from an AI company or...Work at office
Hedra Inc.
San Francisco, CA4 days ago - ...seeking an experienced engineer to architect, build, and scale high-performance distributed training and inference infrastructure for... ...expertise in distributed systems, networking, and high-throughput computing, plus strong... ...experience on large #J-18808-Ljbffr AI Breaking Wire
- ...United States Position Title: Senior Systems Engineer, Workers AI About Us At Cloudflare, we are on a... ...the core infrastructure that powers AI inference across Cloudflare’s global network... ...problems in distributed systems and high-performance computing: sub-second model...Local areaWorldwide
$350k
...understanding and debugging AI systems. We build world-class, AI-backed... ...an exceptional AI systems engineer to lead the design and development... .... As an early member of a highly collaborative team, you will... ...Interpretability: Inference stacks that are as performant...Visa sponsorshipFlexible hoursTransluce
San Francisco, CA1 day ago$272k - $336k
...Waymo Systems Engineering Role Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since... ...and hardware systems in groundbreaking new ways. We set the high performance standards that ensure our vehicles run smoothly...Odd jobFull timeRemote workLatent Logic
San Francisco, CA4 days ago$124k - $280k
...people in data and analytics engineering focus on leveraging advanced technologies... ...and implementing advanced AI and ML solutions to drive... ...algorithms, models, and systems to enable intelligent decision... ...ability to develop and sustain high performing, diverse, and inclusive...Full timeH1bPwC
San Francisco, CA5 days ago$190k - $230k
...Are Lightning AI is the company behind... ...and deploying AI systems—designed to take... ...training, and production inference, with security,... ...are looking for a Staff Developer Advocate... ...gap between our engineering teams and the AI... ...You’ll Do Create high-impact,...Work at officeWork from homeFlexible hoursShowcify, Inc.
San Francisco, CA1 day ago- ...vehicles, every Physical AI model is trained... .... Our open-source engine, Daft, is purpose-... ...engineer has high ownership across the... ...on the Data Systems team, you will build... ...storage and a high-throughput data engine over petabytes... ...training and inference. We operate as a...Work at officeFlexible hoursNight shift
Mixpeek
San Francisco, CA1 day ago - ABOUT WORLD LABS World Labs is a frontier AI research and product company advancing spatial intelligence... .... ROLE OVERVIEW We are seeking a Senior/Staff Rendering Systems Engineer to build and scale high-throughput, Unreal Engine-based rendering systems for synthetic...Work at officeVisa sponsorshipWork visaRelocation packageFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Inference Systems Engineer — High-Throughput AI. Be the first to apply!
Related searches
- project engineer assistant project manager San Francisco, CA
- staff security engineer San Francisco, CA
- staff engineer San Francisco, CA
- research assistant engineering San Francisco, CA
- senior staff systems engineer San Francisco, CA
- engineering aide San Francisco, CA
- senior staff engineer San Francisco, CA
- assistant engineering manager San Francisco, CA
- assistant chief engineer San Francisco, CA
- staff data engineer San Francisco, CA