Backend Engineer (ML Infra) — Scale AI Training & Inference
Rockstar
A dynamic digital product studio is seeking a Backend Software Engineer (ML Infrastructure) to design and build core systems for training and deploying ML models. This early-career role involves collaborating with ML engineers and focuses on distributed training pipelines and cloud-native infrastructure. The ideal candidate has backend engineering experience, strong foundations in distributed systems, and is comfortable working in Python or Go. The position offers an exciting opportunity to work on real ML infrastructure in a fast-paced environment in San Francisco. #J-18808-Ljbffr Rockstar
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Backend Engineer (ML Infra) — Scale AI Training & Inference in San Francisco, CA vacancy
- A leading AI technology firm in San Francisco is seeking an AI Infra Engineer to enhance their infrastructure. The successful candidate... ...manage Slurm for distributed training. Important skills include... ...aiming at advancements in AI and ML infrastructure. #J-18808-Ljbffr...Training
- ...that is building the AI backbone for the... ...but a full-stack backend for fine-tuning, reinforcement... ...learning, inference, and long-term... ...Backend Software Engineer (ML Infrastructure) to... ...design, build, and scale the core systems that... ...large-scale model training and deployment....Training
Rockstar
San Francisco, CA1 day ago $192k - $260k
...world's best data and AI infrastructure... ...deploy and manage AI/ML models - from traditional... ...-time, low-latency inference, governance,... ...operationalize models at scale with strong SLAs... .... As a Staff Engineer, you'll play a critical... ...certifications and training, and specific work...TrainingLocal areaWorldwideDatabricks
San Francisco, CA5 days ago- Reducto, a fast-growing AI company in San Francisco, is hiring a Machine Learning Infra Engineer. This role involves building and maintaining the training and inference frameworks necessary for optimal performance. Ideal candidates should possess strong Python skills,...Training
$192k - $260k
...s best data and AI infrastructure platform... ...AI model inference for open source... ...role, no prior ML or AI experience... ...’re looking for engineers who have owned high scale operational sensitive... ...sensitive backend systems. A track... ...certifications and training, and specific...TrainingLocal areaWorldwide- ...hiring Software Engineers focused on AI Infrastructure to... ...reliably at production scale. This role exists... ...traditional backend engineering - including... ..., large-scale inference systems,... ...infrastructure supporting training and inference... ...Familiarity with GPU-based ML workloads or...TrainingInternshipImmediate start
SpreeAI
San Francisco, CA4 days ago $125k - $225k
A leading AI infrastructure company is seeking a Senior Backend Engineer to build core backend services for a high-scale observability platform. The ideal candidate will have 5+ years of experience... ...designing APIs specifically for ML workflows and handling real-time data...Remote workSpace Executive
Berkeley, CA4 days ago$150k - $300k
...models to the infra that enables... ...anyone to create, train, and deploy... ...at frontier scale, adapting... ...serving, LLM inference optimization... ...Experience Building ML Systems at... .... Inference Backends: Hands‑on... ...LLM Inference engine development and... ...AI and RL at Prime...TrainingWork at officeRemote workVisa sponsorshipRelocation packageFlexible hoursShift work$160k - $200k
...agentic models to the infra that enables anyone to create, train, and deploy them... ...at frontier scale, adapting models... ...sophisticated AI teams in the world... ...jobs, scale inference workloads against... ...with a customer's ML infrastructure... ...customer, from ML engineers to engineering...TrainingRemote workVisa sponsorshipRelocation packageFlexible hoursDay shiftPrime Intellect
San Francisco, CA5 days ago$250k
...International Consulting Ltd is looking for a talented ML/AI Research Engineer to join their San Francisco team. You will be... ...and managing the infrastructure that powers training, deployment, and governance of large-scale AI systems. The ideal candidate has a strong background...Training$130k - $400k
...Backend Engineer, Marketplace Location: San Francisco... ...-Stage / Series C AI Infrastructure... ...representing a rapidly scaling AI infrastructure... ...support model training, evaluation, and human... ...with product, ML, and operations teams... ...production model inference systems...TrainingWork at officeRelocation packageRecruiting from Scratch
San Francisco, CA5 days ago$166k - $225k
...enabling data and AI teams to solve the... ...business. Founded by engineers — and customer... ...interfacing with data to scaling our services and... ...AI agents, model training, model serving,... ...Collaborate with platform, infra, and ML teams to deliver... ...of experience in backend or infrastructure...TrainingRemote jobLocal areaWorldwide$167.2k - $209k
...DigitalOcean is expanding its AI Infrastructure layer... ...are seeking a Senior Engineer 2 to join our AI Inference Data Plane team. In... ...and delivering high-scale, resilient data plane... ...as code.AI/ML Domain Knowledge: Hands... ...relevant conferences, training, and education. All employees...TrainingLocal areaRemote workWorldwideFlexible hoursDigitalOcean
San Francisco, CA2 days ago$200k - $280k
...of efficient inference (algorithms, architectures, engines) and post-training / RL systems.... ...at production scale. Our mandate... ...computing for ML. Are comfortable... ...with infra, research, and... ...including kernel backends, speculative... ...About Together AI Together...TrainingFull timeTogether AI
San Francisco, CA2 days ago$146.5k
...search, recommendations, AI/ML systems, and the... ...can be inconsistent, and scale amplifies every edge case... ...partnership with Content and Infra-Security ~... ...Content Security, ML Data Engineering, Search & Discovery,... ...relevant education or training; and other business and...TrainingLocal areaHome officeFlexible hoursScribd
San Francisco, CA3 days ago- ...the web by building AI agents that can... ...agent-first, from training our own models to... ...Responsibilities: Scale infra for post-training... ...infra for agentic inference (throughput and... ...closely with product engineers to translate... ...Experience with ML infrastructure (GPU...TrainingWork at officeRelocationVisa sponsorship
Yutori
San Francisco, CA21 days ago $180k - $240k
...Backend Engineer - Infrastructure Los Angeles, San Francisco... ...and challenging to scale. Our ambition is to... ...management and scheduling ML Infrastructure: Construct the ML training infrastructure to enhance our AI researchers' productivity, and inference systems to optimize...TrainingWork experience placementHeyGen
San Francisco, CA1 day ago- AI Chopping Block, Inc. is looking for a core backend engineer to design and operate platform backend services for AI products in San Francisco. The ideal candidate... ...handling system design and collaborating with product and ML research teams to enhance capabilities. This...
$160k - $250k
...Senior Backend Engineer, Inference Platform San Francisco About the Role Together AI is building the Inference Platform that brings the... ...video, and speech models at scale. If you get a thrill from... ...responses. Collaborate with ML researchers to bring new model...Full timeLocal areaTogether AI
San Francisco, CA1 day ago- ...intelligence, AI-driven optimization... ...complexity at scale. We are backed... ...- from ML model training through production... ...Platform Engineering & Payments Integration... ...and maintain inference services in Go... ...Skills Backend / Platform... ...systems Cloud & Infra - AWS...TrainingLocal areaShift work
DEUNA
San Francisco, CA2 days ago - About the Role ML Ops Engineer — Agentic AI Lab (Founding Team... ...the model training, deployment, versioning... ..., and inference rollout Manage hybrid... ...custom inference backends (e.g. vLLM, TGI,... ...engineering, or infra-focused ML roles... ...(spot instance scaling, batch prioritization...TrainingFull time
- ...SEE *ALL* OF OUR JOB OPENINGS! Senior Backend Engineer Seeking a Senior Backend Engineer... ...complex distributed systems at enterprise scale. What You'll Do: Design and... ...interface design Nice to Have AI/ML infrastructure experience or familiarity...Casual work
Three Pillars Recruiting
San Francisco, CA4 days ago - David Joseph & Company is seeking a backend engineer in San Francisco, California. This high-ownership... ...on building core infrastructure for an AI-native platform, emphasizing autonomy... ...and cloud technologies, capable of scaling systems and operating independently. #J...
- ...Backend Engineering Role At Sesame Sesame believes in... ...machine learning inference, scalable agentic... ...cutting-edge applied AI. At the centre of... ...of systems where ML models are a critical... ...it off to the infra team to productionize... ...tradeoffs, and scaling strategies independently...Full timeContract workFlexible hours
SESAME
San Francisco, CA1 day ago - Spherecast is seeking a Senior Backend Engineer to design and implement backend systems that power Agnes, our AI Supply Chain Manager. This role requires hands-on experience... ...efficiently. If you excel in managing large-scale data and systems engineering, this is your chance...
- ...We are looking for an Inference Engineering Manager to lead our AI Inference team. This is a... ...opportunity to build and scale the infrastructure that powers... ...Partner with ML research teams on model optimization... ...Background in training infrastructure and RL workloads...Training
Perplexity
San Francisco, CA1 day ago - ...first company is seeking a Member of Technical Staff to focus on cutting-edge AI research and development. The role involves building and scaling training and inference infrastructure, designing ML kernels, and optimizing performance. Ideal candidates should have a passion...Training
- A cutting-edge AI research firm in San Francisco is seeking talent to build and optimize GPU infrastructure for large-scale model inference and training workloads. The ideal candidate will have hands-on experience with GPU systems and optimization techniques, actively contributing...Training
- Dormont Manufacturing Co is seeking a Senior/Staff Backend Engineer to design and build large-scale systems for their AI platform. In this role, you will ensure reliability and performance, integrating complex workflows for real-time data processing. The ideal candidate...
- A cutting-edge AI technology company based in San Francisco is seeking a specialist to design and operate large-scale GPU infrastructure. This role requires expertise in deploying GPU systems for high-throughput inference and model performance optimization. The ideal candidate...Training
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Backend Engineer (ML Infra) — Scale AI Training & Inference. Be the first to apply!
Related searches
- backend python developer San Francisco, CA
- remote back end developer San Francisco, CA
- back-end developer San Francisco, CA
- entry level back-end developer San Francisco, CA
- senior backend developer San Francisco, CA
- backend software engineer San Francisco, CA
- backend intern San Francisco, CA
- backend .net developer San Francisco, CA
- machine learning remote San Francisco, CA
- machine learning scientist San Francisco, CA