Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Machine Learning Infrastructure Engineer

Workshop Labs

Workshop Labs Job Posting

Build the infrastructure to serve personal AI models privately and at scale.

We're building the first truly private, personal AI – one that learns your skills, judgment, and preferences without big tech ever seeing your data.

Our core ML systems challenge: how do we serve the world's best personal model, at low cost and high speed, with bulletproof privacy?

What You'll Do

• Build the infrastructure that lets us create & deploy thousands and eventually millions of personalized finetuned models for our customers

• Monitor & optimize in-the-wild model serving performance to hit low latency & cost

• Interface with the TEE-based privacy stack that lets us guarantee user data & models can only be seen & used by the user—not even us—and integrate the privacy architecture with the finetuning & inference code

You Have

• A deep understanding of the machine learning stack. You can dive into the details of how transformers work & performance optimization techniques for them. You have a mental model of GPUs sufficient to reason about performance from first principles. You can drill down from ML code to metal.

• Ability to execute quickly. We ship fast and fail fast so we can win faster. The challenge of human relevance in a post-AGI world isn't going to solve itself.

• A missionary mentality. We're a mission-driven company, looking for mission-first people. If you're passionate about ensuring AI works for people (and not the other way around), you've come to the right place.

• Ready to roll up your sleeves. We're an early stage startup, so we're looking for someone who can wear many hats.

Experience You May Have

• Work at a fast-paced AI startup, or top AI lab

• Experience deploying ML systems at scale. You might have worked with frameworks like vLLM, S-LoRA, Punica, or LoRAX.

• Experience with privacy-first infrastructure. You're familiar with confidential computing & ability to reason about both technical and real-world confidentiality and security. You may have worked with secure enclaves, TEEs, code measurement & remote attestation, Nvidia Confidential Computing, Intel TDX or AMD SEV-SNP, or related confidential computing technologies.

We encourage speculative applications; we expect many strong candidates will have different experience or unconventional backgrounds.

What We Offer

• Generous compensation and early stage equity. We're competitive with the top startups, because we believe the best talent deserves it.

• World-class expertise. We're based in top AI research hubs in San Francisco and London. We're backed by AI experts like Juniper Ventures, Seldon Lab, and angels at Anthropic and Apollo Research. You'll have access to some of the best AI expertise in the world.

• Massive impact. Our mission is to keep people in the economy well after AGI. You'll help shift the trajectory of AI development for the better, helping break the intelligence curse and prevent gradual disempowerment to keep humans in control of the future.

About Workshop Labs

We're building the AI economy for humans. While everyone else tries to automate the world top-down, we believe in augmenting people bottom-up.

Our team previously created evals used by Open AI, completed frontier AI research at MIT/Cambridge/Oxford, worked in Stuart Russell's lab, and led product verticals at high growth startups.

Our founders' essay series on AI's economic impacts and the technology we'll need to keep humans relevant, The Intelligence Curse, has been covered in TIME, The New York Times, and AI 2027.

Our vision is for everyone to have a personal AI aligned to their goals and values, helping them stay durably relevant in a post-AGI economy. As a public benefit corporation, we have a fiduciary duty to ensure that as AI becomes more powerful, humans become more empowered, not disempowered or replaced.

We're an early stage startup, backed by legendary investors like Brad Burnham and Matt McIlwain, visionary product leaders like Jake Knapp and John Zeratsky, philosopher-builders like Brendan McCord, and top AI safety funds like Juniper Ventures. Our investors were early at Anthropic, Slack, Prime Intellect, DuckDuckGo, and Goodfire. Our advisors have held senior roles at Anthropic, Google DeepMind, and UK AISI.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Machine Learning Infrastructure Engineer in San Francisco, CA vacancy
  •  ...San Francisco | Work Directly with CEO & founding team | Report to CEO | OpenAI for Physics | 5 Days Onsite Machine Learning Infrastructure Engineer Location: Onsite in San Francisco Compensation: Competitive Salary + Equity Who We Are UniversalAGI... 
    Suggested
    Work at office
    Flexible hours
    1 day per week

    UniversalAGI

    San Francisco, CA
    2 days ago
  •  ...Machine Learning Engineer In ML Runtime & Optimization Zensors is the spatial intelligence platform for the physical world. Our AI platform...  ...on both cloud and edge compute resources. The AI Infrastructure team at Zensors builds the engine that powers our visual... 
    Suggested
    Work at office

    Zensors

    San Francisco, CA
    5 days ago
  • $183.7k - $248.6k

     ...The opportunity Unity is looking for a Senior Machine Learning Infrastructure Engineer to join our Vector Ads team, where we build the real-time systems that power Unity's global advertising platform. This is a high-scale, low-latency environment — processing billions... 
    Suggested
    Work at office
    Remote work
    Worldwide
    Relocation package

    UNITY

    San Francisco, CA
    2 days ago
  •  ...looking for people that have done genuinely amazing work in infrastructure who are interested in a challenge, working with both traditional...  ...., as well as very different infrastructure around inference engines and GPU loads. This is a role that will inherently require... 
    Suggested

    Morph Inc.

    San Francisco, CA
    2 days ago
  •  ...generation platform, which combines threat intelligence with machine learning, enables financial institutions and governments to...  ...crime at an unprecedented scale. As a Senior Software Engineer, ML Infrastructure at TRM Labs, you will collaborate with data scientists,... 
    Suggested
    Worldwide

    TRM Labs

    San Francisco, CA
    2 days ago
  • $209.7k - $283.8k

     ...San Francisco, CA, USA Staff Machine Learning Engineer, ML Infrastructure Location San Francisco, CA, USA Department AI & Machine Learning Requisition ID JOBREQ-2615904 Role description The opportunity Unity Vector builds an offline ML platform... 
    Work at office
    Worldwide
    Relocation package

    Unity Technologies

    San Francisco, CA
    3 days ago
  • $150k - $195k

     ...Machine Learning Solutions Engineer (ML + Infrastructure Focus) New York, New York, United States; San Francisco, California, United States; Seattle, Washington, United States Who We Are Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we... 
    Work at office
    Local area
    2 days per week

    Lightning AI

    San Francisco, CA
    3 days ago
  • $175k - $300k

     ...meaningful piece of the company. High talent density: Be a part of a great founding team in SF. Shivaal Roy (CTO) was a founding engineer at Glean ($100M+ ARR today) and managed the Assistant and Search teams, where he solved similar problems. Danny Goldman (CEO)... 

    Trove

    San Francisco, CA
    1 day ago
  •  ...Lightfield AI/ML Engineer Lightfield is an AI-native CRM that assembles itself from...  ...to maintain rigid systems, Lightfield learns from how companies actually work, adapting...  ...development of ML product development infrastructure, focusing on scaling and innovating in... 
    Work from home

    LIGHTFIELD INC

    San Francisco, CA
    2 days ago
  • Job Title Disabled veteran A veteran who served on active duty in the U.S. military and is entitled to disability compensation (or who but for the receipt of military retired pay would be entitled to disability compensation) under laws administered by the Secretary of...

    Veho

    San Francisco, CA
    3 days ago
  • $160k - $250k

     ...Machine Learning, Platform Engineer San Francisco About the Role Our team focuses on enabling custom models and dedicated inference on...  ...of existing distributed systems, APIs, databases, and infrastructure Partner with product teams to understand functional... 
    Full time

    Together AI

    San Francisco, CA
    2 days ago
  • $227.2k - $324.5k

     ...Corporation. About the Role: This Software Engineering team works closely with Machine Learning and Product wellbeing to help build world‑class machine...  ...Bonus: Familiarity with the machine‑learning infrastructure. Previous experience with Akka. Ability to... 
    Full time
    Flexible hours

    Tubi Tv

    San Francisco, CA
    2 days ago
  • $132.3k - $245.7k

     ...Staff Machine Learning Engineer Welcome to Warner Bros. Discovery… the stuff dreams are made of. When we say, "the stuff dreams are made...  ...for ML and DS workstreams. Production Velocity: Build infrastructure abstractions and components that allow seamless transition... 
    Temporary work
    Local area

    Warner Bros.

    San Francisco, CA
    3 days ago
  • $320k - $405k

     ...team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to...  ...AI systems. About the role We are seeking a Machine Learning Infrastructure Engineer to join our Safeguards organization, where you'll... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    4 days ago
  •  ...ML Infrastructure Engineer Spectral Labs is a spatial intelligence company building reasoning models for engineering physical systems. Our model SGS-1 is state-of-the-art for parametric geometry, and we are currently building the next generation of models to revolutionize... 

    Spectral Labs

    San Francisco, CA
    15 days ago
  • Overview Pluralis Research is pioneering Protocol Learning - a fully decentralised way to train and deploy...  ...AI. We’re looking for an ML Training Platform Engineer to architect, build, and scale the foundational infrastructure powering our decentralised ML training platform... 
    Work experience placement

    Pluralis Research

    San Francisco, CA
    2 days ago
  • $185k - $275k

    Senior Machine Learning Engineer - GeoAI Platform Wherobots, Inc. San Francisco, California, United States | Information Technology About this...  ...is a distributed‑systems‑first role with meaningful ML infrastructure ownership. You will spend most of your time building high... 
    Full time
    Work at office
    Remote work
    Work visa

    Wherobots, Inc

    San Francisco, CA
    3 days ago
  • $166k - $225k

    P-984 Founded in late 2020 by a small group of machine learning engineers and researchers, Mosaic AI enables companies to securely fine‑tune...  ...to‑end implementation Design and build the core platform infrastructure that supports our customer‑facing product features... 
    Local area
    Worldwide

    Cacheflow

    San Francisco, CA
    3 days ago
  • $200k - $375k

     ...Job Description Job Description Founding Machine Learning Engineer Posted by Transparent Search Group on behalf of Known . About Known Known is building an AI-powered social platform that creates personalized AI companions and predicts human compatibility. The... 
    Full time

    Transparent Search Group

    San Francisco, CA
    4 days ago
  • $151k - $189k

     ...educational institutions Work together with engineers, scientists, operators, and more from...  ...AI Human data is the core infrastructure to AI advancement. Frontier AI labs currently...  ...The ML Opportunity at Handshake: Machine Learning is at the heart of Handshake's mission... 
    Full time
    Work at office
    Remote work
    Flexible hours

    Handshake

    San Francisco, CA
    16 days ago
  •  ..., you’ll feel right at home. If you’re looking for something easier – this isn’t it. The role We’re looking for a Machine Learning Engineer to build and ship consumer-facing AI systems that power personalization, coaching, and next-generation “sleep intelligence... 
    Full time
    Immediate start
    Worldwide
    Night shift

    Eight Sleep

    San Francisco, CA
    3 days ago
  • $160k

     ...oddsmaking is a challenge rooted in engineering, mathematics, and sports betting expertise...  ...team is hiring an experienced Machine Learning Engineer with a background building machine...  ...data science modeling systems and infrastructure at scale ~ Experience with Python and... 
    Remote work

    Swish Analytics

    San Francisco, CA
    26 days ago
  • $90 per hour

     ...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Machine Learning Engineer Expert Type: Contract Compensation: $90/hour Location: Remote Role Responsibilities Develop end-to-... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    17 days ago
  •  ...We're looking for an experienced HPC infrastructure engineer to lead bringup, administration, and operations on is probably the largest anime...  ...serve as the bridge between our researchers and the bare GPU machines, helping to make sure that SLURM jobs are running, parallel... 
    Work at office
    Visa sponsorship

    Spellbrush

    San Francisco, CA
    5 days ago
  • $150k - $265k

     ...company based in the San Francisco Bay Area, is seeking a Machine Learning Engineer (Search Quality) to help build the next generation of AI-...  ...innovative approaches for combining LLMs with search infrastructure to answer nuanced and multi-step queries. Analyze data... 

    ML6

    San Francisco, CA
    2 days ago
  •  ...the most persistent challenges in data infrastructure: extracting accurate, structured information...  ...We are a small, fast-growing team of engineers in San Francisco powering Fortune 100...  ...evaluation, data curation, and active learning pipelines Optimize inference, batching... 
    Visa sponsorship
    Relocation package

    PULSE

    San Francisco, CA
    5 days ago
  • $244k - $320k

     ...notifications, our AI-powered personalization engine delivers bespoke experiences that...  ...Index [ About the Role Our Machine Learning Engineering team powers personalized experiences...  ..., and Redis, hosted via AWS * Our infrastructure runs primarily in Kubernetes hosted in... 
    Full time

    Attentive

    San Francisco, CA
    5 days ago
  • $131.4k - $235.95k

     ...software tools for making buildings, machines, and even the latest movies, we influence...  ...the world. As a Senior Machine Learning Engineer focused on Machine Learning Ops (...  .... You will build and operate the infrastructure that takes models from development into... 
    For contractors
    Remote work

    Autodesk

    San Francisco, CA
    1 day ago
  • $200k

     ...building the next-generation intelligence infrastructure and interfaces to capture, extract, and...  ...security and privacy protection. To learn more about Plaud, please visit and follow...  ...throughput, ultra-low-latency inference engines for large language models or... 
    Full time
    Work at office
    Worldwide

    Plaud

    San Francisco, CA
    3 days ago
  • $150k - $220k

     ...Founding Machine Learning Engineer San Francisco Compensation ~ Estimated base salary $150K – $220K • Offers Equity • Offers Bonus We invest in our team's success with comprehensive benefits Generous Compensation Above-market salary and equity package... 
    H1b
    Work at office
    Visa sponsorship
    Sleeping nights

    Composite.ai

    San Francisco, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Machine Learning Infrastructure Engineer. Be the first to apply!