Machine Learning Infrastructure Engineer
$200k - $400kDavid Joseph & Company
Job Description
Job Description
Machine Learning Infrastructure Engineer
San Francisco, CA · On-site (5 days/week) · Full-time
Compensation: $200K–$400K + competitive early-stage equity
Our client is a Series A AI research lab building large-scale foundation models for scientific and physical-AI domains. Backed by top-tier investors, they are pursuing a deliberately non-consensus technical thesis and are among the best-funded teams in their space. The founding team comes from self-driving, robotics, and scientific research, and they are scaling their research and engineering org significantly this year.
Founded 2024 · Small, fast-growing team · Industry: AI / foundation models / physical AI
The RoleYou would own the distributed training and inference backbone for a foundation model trained from scratch — standing up clusters, building data and training pipelines at petabyte scale, and squeezing performance out of GPUs at a low level across model scales.
What you'll be doing
- Design, deploy, and maintain large distributed ML training and inference clusters
- Build efficient, scalable end-to-end pipelines to manage petabyte-scale datasets and training across the full ML lifecycle
- Research and test training approaches, including parallelization techniques and numerical-precision trade-offs across model scales
- Profile and debug low-level GPU operations to optimize performance
- Track new research and bring fresh ideas into the work
Tech stack: Distributed training frameworks (FSDP, DeepSpeed), NVIDIA GPUs, Linux, Python, C++, Kubernetes/Docker, and a major cloud platform (GCP, AWS, or Azure).
Requirements- 2–10 years building large-scale ML infrastructure for core foundation models
- Hands-on experience building infrastructure for foundation models trained from scratch, rather than fine-tuning existing models
- A background at a science-focused or physical-AI company (for example self-driving, robotics, or biology)
- Deep, demonstrable expertise optimizing large-scale training and inference workloads
- Working proficiency with distributed training frameworks such as FSDP or DeepSpeed
- A clear pattern of intentional, mission-driven career decisions
- Able to work on-site 5 days/week in San Francisco (relocation supported)
- Generalist experience spanning the full ML lifecycle
- Low-level GPU performance optimization and debugging (CUDA, JAX)
- Take a bet on a distinctive, non-consensus approach to building intelligence
- Join early, with real ownership of the training and inference backbone
- Work in a domain with fast, objective ground-truth feedback and data at a scale beyond typical LLM training
- Well-funded and building a strong, senior research and engineering team
- Location: San Francisco, CA
- Work policy: In-person 5 days/week (relocation supported)
- Compensation: $200K–$400K + competitive early-stage equity
- Visa sponsorship: Open to supporting work authorization for the right candidate
- Employment type: Full-time
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Machine Learning Infrastructure Engineer in San Francisco, CA vacancy
$212k - $318k
...heavily in building the best creator platform with the best team in the creator economy and are looking for a Senior Machine Learning Engineer, Infrastructure to support our mission.This role is based in San Francisco or New York as an in-office 3 days per week on a hybrid...SuggestedWork at officeLocal areaRemote workWorldwideFlexible hours2 days per week3 days per week$350k
...growing group of committed researchers, engineers, policy experts, and business leaders... ...re looking for an engineer to own the infrastructure behind that research. This is the... ...our models continue to change. Running machine learning workloads at our scale often requires...SuggestedWork at officeVisa sponsorshipFlexible hoursShift work- ...educational institutions Work alongside engineers, scientists, operators, and more from... ...Handshake AI Human data is the core infrastructure of AI advancement. Frontier AI labs currently... ...About the Role Handshake is hiring a Machine Learning Engineer for the Network and Handshake...SuggestedFull timeWork at officeRemote workFlexible hours
- ...opportunity is to push the boundaries of what machine learning can do in the enterprise through... ...Rippling.As a Staff Machine Learning Engineer, you will own the end-to-end ML... ...robust evaluation and experimentation infrastructure: offline benchmarks, A/B testing, and...SuggestedWork at office3 days per week
$246.5k - $339k
...re using the power of tech, data, and machine learning to connect this thriving community of... ...roleAs a Staff Machine Learning Platform Engineer, you will help design, improve, and... ...What You Will DoDesign and operate ML infrastructure, including workspaces, clusters, jobs,...SuggestedWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per week$295k - $405.5k
...re using the power of tech, data, and machine learning to connect this thriving community of... ...Senior Staff Machine Learning Platform Engineer, you will own the technical vision and... ...background in distributed systems, ML infrastructure, and cloud architecture.Demonstrated technical...Work experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per week- ...HudsonEmail: ****@*****.***: (***) ***-****Job Title: Machine Learning Infrastructure EngineerLocation: San Francisco, CA Metro Area (100% On-... ...company is seeking a Machine Learning Infrastructure Engineer to help architect the compute, training, and execution...Full timeWork at officeFlexible hours
- ...Overview Pluralis Research is pioneering Protocol Learning – a fully decentralised way to train and deploy... .... We’re looking for an ML Training Platform Engineer to architect, build, and scale the foundational infrastructure powering our decentralised ML training platform...Work experience placement
Pluralis Research
San Francisco, CA3 days ago $151.8k - $265.35k
...Firefly’s Generative AI Services team is seeking SeniorMachine Learning Engineers for our GenAI Services area. In this high-impact role, you... ....What You’ll Need to SucceedMS or PhD in Computer Science, Machine Learning, or a related field—or equivalent industry experience...Full timeTemporary workLocal areaWorldwide$162.8k - $203.5k
...immersive transportation to improve people's lives warrants modern ML utilizing peta-byte scale data. Our highly motivated Machine Learning Engineers work on these challenging problems and define solutions to directly impact various aspects of our core business.If you...Hourly payWork at officeLocal area3 days per week$189.72k - $332.01k
...in our recruiting process here.With more than 500 million users around the world and 300 billion ideas saved, Pinterest Machine Learning engineers build personalized experiences to help Pinners create a life they love. With just over 4,000 global employees, our teams...Local areaRelocation package$148.7k - $199.4k
Job Posting Title:Senior Machine Learning Engineer - ESPNReq ID:10150610Job Description:Disney Entertainment & ESPN TechnologyOn any given day... ...: DE&E Technologists are designing and building the infrastructure that will power Disney’s media, advertising, and distribution...Full timeWorldwide$140k - $200k
...About the RoleWe’re looking for an ML Engineer to build the production systems that train... ..., monitor, retrain, and serve our machine-learning models reliably. You sit between software... ...to reliable production.Cloud infrastructure, containers, CI/CD, and orchestration....Temporary workWork at officeMonday to FridayMonday to Thursday$180k - $220k
...Ouster, we build sensors and tools for engineers, roboticists, and researchers, so they... ...cars, robotics, industrial, and smart infrastructure applications (among many others). If... ...We are looking for a highly technical Machine Learning Engineer to lead our efforts in Object...Work experience placementLocal area$163.42k - $285.98k
...in our recruiting process here.With more than 600 million users around the world and 300 billion ideas saved, Pinterest Machine Learning engineers build personalized experiences to help Pinners create a life they love. With just over 4,000 global employees, our teams...Local areaRelocation package$138.91k - $285.98k
...group is dedicated to the development and research of applied machine learning. Our initiatives span a diverse range of AI/ML fields,... ...core visual pod, a collaborative group of approximately six engineers and a product prototyping team, to create specialized evaluation...Work at officeLocal areaRemote workRelocationRelocation package$190.2k - $345.65k
...opportunity to operate as a startup founding engineer while having the resources of an innovative,... ...in enterprise software development using Machine Learning and Agentic AI systems to help design and scale the infrastructure behind intelligent, autonomous applications....Full timeTemporary workLocal areaWorldwide$200k - $235k
...side with talented product managers, data scientists, software engineers, fraud intelligence, and operations teams. Together, you'll... .... The Difference You Will Make: As a Senior Machine Learning Engineer on the Trust Frontier AI team, you will actively contribute...Work experience placementCasual workLive inWork at officeRemote work- ...DoorDash's logistics network. The Drive Machine Learning team builds the prediction and... ...outcomes.About the RoleAs a Machine Learning Engineer on the Drive team, you'll own machine... ...Python and experience with modern ML infrastructure and tooling.Deep expertise in at least...Hourly payWork at officeLocal areaRemote workRelocationFlexible hours
$200.35k - $260.91k
...Platforms for B2B, Q1 2026.The OpportunityWe’re hiring a Senior Machine Learning Engineer to join our AI team, reporting directly to the Head of AI... ...experience building distributed ML pipelines on cloud infrastructure (AWS, Databricks, or equivalent).Solid grasp of feature...Full time$209k - $313k
...themselves, live in the moment, learn about the world, and have... ...other digital services.Snap Engineering teams build fun and... ...forefront.We’re looking for a Machine Learning Engineer to join Snap... ...with machine learning, ranking infrastructures, and system designIf you have...Full timeLive inWork at officeLocal area$173k - $259k
...themselves, live in the moment, learn about the world, and have... ...other digital services.Snap Engineering teams build fun and... ...forefront.We’re looking for a Machine Learning Engineer to join Snap... ...with machine learning, ranking infrastructures, and system designIf you have...Full timeLive inWork at officeLocal area$112k - $269k
SummaryYelp engineering culture is driven by our values: we’re a cooperative team that... ...businesses requires the use of cutting-edge Machine Learning (ML) and Artificial Intelligence (AI)... ...understanding of engineering and infrastructure best practices.The curiosity to...Work experience placementLocal areaRemote work- ...intelligence and advanced ML, deep learning techniques to power decision-making... .... About the RoleWe’re looking for a Machine Learning Engineer to help design, build, optimize and... ...experimentation.Improve and scale existing ML infrastructure and data pipelines in partnership...Hourly payWork at officeLocal areaRemote workFlexible hours
$160k - $240k
...organization, tackles challenging problems at the intersection of machine learning, agentic reasoning, and enterprise-scale systems. Our work... ...value agent applications.About the RoleAs a Machine Learning Engineer on the AI Core team, you will develop tailored user...Full timeWork at officeRemote workHome officeFlexible hours$172.5k - $306.63k
...center of Adobe’s creative ecosystem. Our mission is to employ machine learning to enhance our comprehension of the creative content that... ...intelligence to new heights.What You'll DoAs a Senior Machine Learning Engineer on the Content Intelligence team, you will lead the...Full timeTemporary workLocal areaWorldwide- ...worldwide to eliminate busywork and focus on what matters. Learn more at superhuman.com and about our values here.The OpportunityWe... ...complex tasks, leveraging Superhuman ubiquitous UI. As a Machine Learning Engineer on this team, you will be at the heart of our company's...WorldwideHome officeFlexible hours
$244k - $320k
...notifications, our AI-powered personalization engine delivers bespoke experiences that... ...Equality Index!About the RoleOur Machine Learning Engineering team powers personalized experiences... ..., and Redis, hosted via AWSOur infrastructure runs primarily in Kubernetes hosted in...Full time$200k - $300k
San Francisco, CaliforniaHybridFull Time$200k - $300k A health technology company at the top of their industry is seeking a Machine Learning Engineer to join its research and development team. This full-time opportunity offers the chance to build advanced machine learning...Full timeWorldwide- ...ML Infrastructure Engineer San Francisco Company Overview Echo Neurotechnologies is an exciting... ...impact. We emphasize continuous learning and growth, fostering cross-functional... ...Summary We are seeking a Senior Machine Learning Infrastructure Engineer to join...Flexible hours
Echo Neurotechnologies
San Francisco, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Machine Learning Infrastructure Engineer. Be the first to apply!
Related searches
- data scientist machine learning engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- computer vision machine learning engineer San Francisco, CA
- machine learning engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- graduate machine learning engineer San Francisco, CA
- machine learning software engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- senior ml engineer San Francisco, CA
- data infrastructure engineer San Francisco, CA