Senior GPU ML Infra Engineer Mid-Training & Inference
Reflection AI
A cutting-edge AI technology company based in San Francisco is seeking a specialist to design and operate large-scale GPU infrastructure. This role requires expertise in deploying GPU systems for high-throughput inference and model performance optimization. The ideal candidate will have hands-on experience with modern inference frameworks and a solid understanding of reinforcement learning technologies. Comprehensive healthcare benefits, parental leave, and daily meals are provided, along with competitive salary and equity packages. #J-18808-Ljbffr Reflection AI
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior GPU ML Infra Engineer Mid-Training & Inference in San Francisco, CA vacancy
- ...scale and optimize our training systems and core... ..., from managing GPU/TPU compute and job... ...researchers and model engineers to translate ideas... ...the intersection of ML, software... ...Will Own training/inference infrastructure: Design... ...research needs into infra capabilities and guide...TrainingFull time
- Perplexity is building a self-serve compute platform that lets inference engineers run training jobs and inference services without worrying about GPU provisioning or cluster configuration. You will own the platform surface and drive reliability, observability, and performance...SeniorTraining
$170.1k - $258.3k
...export, kernel development, and performance engineering so that every cycle on our accelerators... ...The AI Kernels team builds high‑performance GPU kernels and custom libraries that sit at the heart of our on‑vehicle ML inference for ADAS and autonomous driving. We own making...SeniorFull timeLocal areaRemote workWork from homeRelocation packageFlexible hours- ...startup building production-grade ML infrastructure used by... ...customers. They are looking for a Senior AI/ML Engineer to own model training pipelines, evaluation systems, and inference serving at scale. Full-time,... ...with distributed training, GPU optimization, or inference serving...SeniorTrainingFull time
Clera
San Francisco, CA15 hours ago - A leading AI infrastructure company is seeking a Senior ML Performance Engineer to design a comprehensive performance testing platform... ...performance engineering and strong experience with GPU programming and ML inference workloads. Candidates should have expertise in...Senior
- ...Intelligence seeks a systems-focused ML infrastructure engineer to own scheduling, placement... ...for large-scale model training. You will design multi-... ...schedulers, manage heterogeneous GPU/TPU clusters, and ensure... ...translate workloads into scalable infra, optimize utilization, and...Training
$200k - $260k
...Together AI is building the best inference infrastructure for voice... .... We're looking for a Senior ML Engineer to drive the model serving layer... ...frontier. You'll profile GPU utilization, design batching... ...) is a plus. ~ Experience training or fine-tuning speech models...SeniorTrainingFull timeTogether Ai
San Francisco, CA15 hours ago$180k - $270k
...deploying high-throughput, ultra-low-latency inference engines for large language models or... ...AI. Possess a deep understanding of GPU architectures (NVIDIA Ampere/Hopper) and... ...critical intersection between the core ML training team and the backend infrastructure team...TrainingFull timeWork at officeWorldwidePlaud
San Francisco, CA15 hours ago$151.8k - $265.35k
...verticals. We are hiring a Senior Machine Learning Engineer to build the... ...quality matches the training and reference environment... ...reaching production. Own GPU capacity and cost -... ...SLAs. Run production ML operationally - on-... ...of production ML or inference services at scale. Strong...SeniorTrainingFull timeTemporary workLocal areaWorldwide$250k
...performance compute platforms for large-scale AI training and inference workloads. With expanding GPU infrastructure across Europe and the United... ...infrastructure limitations. As a Senior ML Infrastructure Engineer, the successful candidate will help build and...TrainingFull timeSan Francisco, CAa month ago- ...Description Job Description Senior Machine Learning Engineer, Artificial Intelligence... ...Machine Learning (ML) subsystems in... ...-end: data preparation, training, evaluation, inference, and iteration. - Turn... ...iteration. - Tech Stack: GPU-based training and inference...SeniorTrainingRemote workWork from home
Ginas Tech Jobs
San Francisco, CA25 days ago $208k - $263.5k
...at scale. We are roboticists, engineers, operators, and builders. We... ...subcategories: AI Research, Post-Training Optimization, and Data Engineering... ...hardware. Profile real-time inference pipelines to identify and eliminate CPU, GPU, and memory bandwidth bottlenecks...SeniorTrainingFull timeInternshipWork at officeFlexible hoursATOMS Careers page
San Francisco, CA1 day ago$161.93k - $227.33k
...Senior Machine Learning Engineer Brisbane, California About this opportunity... ...machine learning (AI/ML) systems in a cloud... ...for current training paradigms. The Senior... ...model management, and inference. Collaborate closely... ...data. Experience GPU/Accelerator programming...SeniorTrainingWork at officeLocal areaRemote work2 days per week3 days per weekFreenome
Brisbane, CA3 days ago- Machine Learning Engineer - Perception Models At Mach9, ML Engineers build the perception... .... We develop and train cutting‑edge 3D... ...ideal for early‑to‑mid‑career ML engineers... ...scale training and inference of your models and with... ...Familiarity with multi‑GPU training and...Training
$190k - $215k
...motivated and skilled Senior Customer Success... ..., AI, and ML. The ideal candidate... ...running production AI inference workloads and understands... ..., AI agents, or GPU-based inference... ...the product and engineering teams to define customer... ...trends.Customer Training: Deliver training...SeniorTrainingFull timeTemporary work- ...seeking a Member of Technical Staff to design and optimize inference systems. The role involves managing KV cache... ...components. Ideal candidates should have strong software engineering skills and experience with ML inference systems, particularly in Python and C++. This...Senior
- ...scale. About the Role We are looking for a visionary Senior ML Engineer who will bridge the gap between high-level architecture and... ...(or equivalent growth phase) ~2+ years of ML, specifically training or fine-tuning LLM models, embeddings; building clustering...SeniorTrainingFull timeShift work
Palm Venture Studios
San Francisco, CA15 hours ago $141k - $249k
...Build standardized distributed training frameworks for research and... ...adopted into Waabi’s training and inference frameworks. Examples include... ...- Work with researchers and ML engineers on best-practices for optimal... ...Skilled in profiling CPU and GPU code using tools such as...SeniorTrainingWork at officeWork from homeFlexible hours- Senior ML Systems Engineer, Frameworks & Tooling at Cohere Our mission is to scale intelligence to serve humanity. We’re training and deploying frontier models for developers and enterprises who are... .... Collaborate closely with infra teams to ensure Slurm setups, container...SeniorTrainingFull timeWork at officeRemote workFlexible hours
- ...looking for a Machine Learning Engineer to join the growing AI and... ...The team also maintains the ML platform and infrastructure that... ...to scaling and optimizing inference and deployment Shape AI at... ...termination, promotional and training opportunities, without regard...SeniorTrainingFull timeWork at officeWorldwideFlexible hours3 days per week
Strava
San Francisco, CA15 hours ago $250k
...building a next-generation GPU platform designed for AI training, experimentation, and inference at scale. The company is... ...company is looking for a Senior / Staff Site Reliability Engineer to support and scale large... ...working closely with platform, ML, and infrastructure teams...SeniorTrainingFull timeRemote workSan Francisco, CAmore than 2 months ago$220k
Perplexity is looking for an engineer to join their team in San Francisco.... ...work on building and operating the inference engine, supporting new models, migrating GPU kernels, and developing a Rust-... ...software engineering with a focus on ML inference, familiarity with deep...Senior- ...decks — partner with research and infra to prototype, train, and deploy state-of-the-art voice... ...Squeeze silicon — scale training and inference for LLM-class workloads; chase latency... ...-level PyTorch. Proven software engineer who loves ML; comfortable writing production...TrainingFull timeContract workFlexible hoursShift work
Sesame, L.l.c.
San Francisco, CA15 hours ago $128.7k - $261.3k
...development, and performance engineering so that every cycle on... ...into fast, reliable inference across GPUs powering GM... ...compiler, systems, and GPU engineers who enjoy... ...driving. The RoleAs a Senior Compiler Engineer on the... ...reliable, and effortless for ML engineers across the AV...SeniorFull timeLocal areaRemote workWork from homeRelocation packageFlexible hours$148.7k - $199.4k
Job Posting Title:Senior Machine Learning Engineer - ESPNReq ID:10150610Job Description... ...distributed data and ML infrastructure that supports... ...adjacent services such as inference inputs, feature APIs, and... ...Education, Experience/Skills/Training:Basic Qualification:...SeniorTrainingFull timeWorldwide$220k - $320k
inference.net, a growing company in San Francisco, seeks an experienced engineer to optimize AI inference performance. The ideal candidate will have over 2 years of experience in ML systems and GPU programming. Key responsibilities include implementing optimization techniques...Senior$298k - $368k
...from a diverse set of sensors, enabling engineers like you to (1) develop methods for efficiently... ...data, to (2) develop models and model training at scale, to (3) analyze real-world... ...Proven expertise in low-latency on-device inference techniques and a deep understanding of...SeniorTrainingFull timeRemote workWaymo
San Francisco, CA15 hours ago- ...Senior Client Engineer SAN FRANCISCO, CA ENGINEERING FULL-TIME What will you be doing? Training machine learning models over billions of data points. Quantifying predictive uncertainty using probabilistic and Bayesian methods. Creating models that quickly generalize...SeniorTrainingFull timeWork experience placement
1872 Consulting
San Francisco, CA4 days ago - A leading AI evaluation platform in San Francisco is looking for a Senior Software Engineer specializing in ML infrastructure. The successful candidate will design and develop robust real-time data and API systems, enabling insights for researchers and developers. Ideal...Senior
LMArena
San Francisco, CA1 day ago $190k - $205k
...vibration, electrical, and visual signals Production Engineering Write clean, scalable, well-tested Python... ...a large shared codebase. Build end-to-end ML pipelines including data processing, feature extraction, training, evaluation, and deployment. Optimize models...SeniorTrainingFull timeLive inGridware
San Francisco, CA15 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior GPU ML Infra Engineer Mid-Training & Inference. Be the first to apply!
Related searches
- graduate machine learning engineer San Francisco, CA
- senior ml engineer San Francisco, CA
- machine learning engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- machine learning software engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- computer vision machine learning engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- senior operations associate San Francisco, CA
- senior safety specialist San Francisco, CA