Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior / Staff ML Training Optimization Engineer

$141k - $249k

Waabi

Job Description

Job Description

Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world-class team, we're unlocking the next era of autonomous transportation with technology that's powering commercial autonomous trucks and robotaxis. Waabi is backed by and partners with world leaders in AI, automotive, logistics, and deep tech.

With offices in Toronto, San Francisco, Dallas, and Pittsburgh, Waabi is growing quickly and looking for diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit:

You will...

  • Build standardized distributed training frameworks for research and production, drive our training towards new levels of stability and efficiency.
  • Comprehensively profile model runtime and memory to pinpoint performance bottlenecks.
  • Identify and evaluate emerging technologies that can be adopted into Waabi’s training and inference frameworks. Examples include designing new CUDA kernels, quantization-aware training and inference, and compilation/deployment techniques.
  • Work with researchers and ML engineers on best-practices for optimal resource usage.
  • Create and improve tooling and dashboards to ensure broad adoption of your work.

Qualifications:

  • MS/PhD or Bachelors degree with a minimum of 4 years of industry experience in Computer Science, Robotics and/or similar technical field(s) of study.
  • Solid coding proficiency in a variety of coding languages including Python, C++ or Rust.
  • Experience in deep learning frameworks such as PyTorch or Jax.
  • Skilled in profiling CPU and GPU code using tools such as PyTorch Profiler and NVIDIA Nsight.
  • Open-minded and collaborative team player with willingness to help others.
  • Passionate about self-driving technologies, solving hard problems, and creating innovative solutions.

Bonus/nice to have:

  • Experience in identifying when custom CUDA kernels are needed, and implementing them.
  • Experience in Bazel in a monorepo environment, and integrating third party packages into dev environments.
  • Experience with Kubernetes-based training platforms.

The US yearly salary range for this role is: $141,000 - $249,000 in addition to competitive perks & benefits. Waabi’s yearly salary ranges are determined based on several factors in accordance with the Company’s compensation practices. The salary base range is reflective of the minimum and maximum target for new hire salaries for the position across all US locations. Note: The Company provides additional compensation for employees in this role, including equity incentive awards and an annual performance bonus.

Perks/Benefits:

Waabi provides a competitive benefits package that includes:

  • Competitive compensation and equity awards.
  • Health and Wellness benefits encompassing Medical, Dental and Vision coverage.
  • Unlimited Vacation.
  • Flexible hours and Work from Home support.
  • Daily drinks, snacks and catered meals (when in office).
  • Regularly scheduled team building activities and social events both on-site, off-site & virtually.
  • World-class facility that includes a gym, games room (ping pong table, video game consoles, board games, etc), multiple collaborative working spaces and a gorgeous patio!(when in office)
  • As we grow, this list continues to evolve! 

Waabi is an equal opportunity employer that celebrates diversity and is committed to creating a supportive, inclusive, and accessible environment for all employees. If reasonable accommodation is needed to participate in the job application or interview process please let our recruiting team know.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Senior / Staff ML Training Optimization Engineer in San Francisco, CA vacancy
  • $250k - $350k

     ...paired with applied ML research, design,...  ...model and systems optimization, and applied research...  ...About the RoleAs a Staff Machine Learning Research Engineer, you will operate across...  .... This could mean training and fine-tuning...  ...direction, mentor senior and staff-track engineers... 
    Senior
    Training
    Full time

    Scale AI

    San Francisco, CA
    1 day ago
  • $190.3k - $261.5k

     ...Solution Architect is a senior technical leader...  ...infrastructure.Guide the optimization of AI-related compute...  ...and mentorship to AI engineers, agentics engineers, and...  ...enterprise architecture, AI/ML engineering, or a...  ...relevant education or training. Your recruiter can share... 
    Senior
    Training
    Full time
    Local area
    Worldwide
    Flexible hours

    Dolby

    San Francisco, CA
    5 days ago
  • $216k - $270k

     ...remains one of the hardest engineering challenges.As a Senior Frontier Agent Engineer (...  ...software.Unlike traditional ML roles that focus on a...  ...language models, or model optimization.Familiarity with multimodal...  ...and relevant education or training. Scale employees in eligible... 
    Senior
    Training
    Full time

    Scale AI

    San Francisco, CA
    3 days ago
  • $300 per month

     ...Crusoe, our Production Engineering team ensures the reliability...  ...of Crusoe’s AI-optimized cloud platform. We’re looking for a Senior Production Engineer with...  ...to optimize large-scale training and inference clustersAutomate...  ...language models (LLMs) or AI/ML infrastructureSRE... 
    Senior
    Training
    Temporary work

    Crusoe

    San Francisco, CA
    2 days ago
  • $174k - $252k

     ...), Agentic development etc), applied ML or Core ML development, or ML platform...  ...role.Experience with RL, post-training, preference optimization or feedback driven model / harness improvement...  ...related areas.Google's software engineers develop the next-generation technologies... 
    Senior
    Training

    Google

    San Francisco, CA
    4 days ago
  • $105.4k - $207.8k

     ...Cyber Zscaler Network Security Engineer / Senior Consultant, Strategy, Growth...  ...the design, deployment, and optimization of Zscaler capabilities...  ...and leveraging Zscaler's AI/ML-based threat intelligence for...  ...skill sets; experience and training; licensure and certifications... 
    Senior
    Training
    Work experience placement
    Local area

    Deloitte

    San Francisco, CA
    2 days ago
  • $148.5k - $223.9k

     ...Salesforce.Salesforce is seeking a senior engineering candidate to join the Site...  ...enhance observability, and optimize systems to reduce Time to...  ....Understanding of AI/ML concepts applied to operations...  ...compensation, promotion, benefits, training, assessment of job... 
    Senior
    Training
    Full time
    Worldwide
    Weekend work

    Salesforce

    San Francisco, CA
    5 days ago
  • Senior AI Engineer, MLOps & Distributed SystemsThe OpportunityJoin the team...  ...production.You’ll work closely with ML Scientists, Data Scientists,...  ...scientist or own model training strategy; your impact will...  ...personalization, send-time optimization, and related experiences.Lead... 
    Senior
    Training
    Full time
    Internship
    Work at office
    Local area
    Remote work
    Worldwide
    3 days per week

    Hinge Health

    San Francisco, CA
    2 days ago
  • $250k

     ...platform designed for AI training, experimentation, and inference...  ...company is looking for a Senior / Staff Site Reliability Engineer to support and scale large...  ...closely with platform, ML, and infrastructure teams...  ...workloads Support and optimize Slurm-based GPU cluster environments... 
    Senior
    Training
    Full time
    Remote work
    San Francisco, CA
    more than 2 months ago
  • $272k - $336k

     ...Waymo Systems Engineering Role Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver...  ...factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more... 
    Senior
    Training
    Odd job
    Full time
    Remote work

    Latent Logic

    San Francisco, CA
    4 days ago
  • $204k - $300k

     ...related to computer science and electrical engineering, such as AI/ML, algorithms, digital signal...  ...and IoT.What You Will AccomplishAs a senior research leader in the Multimodal Experiences...  ...parity, and relevant education or training. Your recruiter can share more about... 
    Senior
    Training
    Full time
    Local area
    Worldwide
    Flexible hours

    Dolby

    San Francisco, CA
    3 days ago
  • $117k - $161k

     ...mission. If you are too, let's talk.The Senior Systems Engineer OpportunityAs a Senior Systems...  ...DoingInfrastructure Management: Administer and optimize our core productivity suite, including...  ...productivity tools through effective training and support.Global Support: Act as a... 
    Senior
    Training
    Permanent employment
    Local area
    Worldwide
    Flexible hours

    Okta

    San Francisco, CA
    4 days ago
  • $140k - $200k

     ...Sr. Data Infrastructure / Quality Engineering role will play a crucial part in architecting...  ...streams into robust, reproducible training datasets for our AI pipelines....  ...datasetsPartner with SW and ML engineers to build and optimize sensor data ingestion, model/data/label... 
    Senior
    Training
    Work experience placement
    Local area

    Ouster

    San Francisco, CA
    5 days ago
  • $196k - $245k

     ...before, during, and after playing games.As a Senior Engineer on the Safety Experience team, you'll...  ...Product, Design, Policy, Data Science, ML, Legal, and T&S Operations to create...  ..., experience, and relevant education or training. Please note that the compensation details... 
    Senior
    Training
    Full time

    Discord

    San Francisco, CA
    5 days ago
  • $15k

     ...frontier of applying AI/ML to investment...  ...lunches, and more.As a Senior Cluster Site Reliability Engineer (SRE), you will help...  ...experience to our technical staff. You will leverage...  ...up strategies. Help optimize operations across...  ...or machine learning training systems (Kubeflow,... 
    Senior
    Training
    Work at office
    Local area
    Remote work

    The Voleon Group

    Berkeley, CA
    4 days ago
  • $148.5k - $223.9k

     ...has immediate opportunities for senior software developers who want...  ...Code review, mentoring junior engineers, and providing technical guidance...  ...:Experience with Big-Data/ML and S3 Hands-on experience with...  ...compensation, promotion, benefits, training, assessment of job performance... 
    Senior
    Training
    Full time
    Immediate start

    Salesforce

    San Francisco, CA
    4 days ago
  • $166k - $225k

     ...insights to improve their business. Founded by engineers — and customer obsessed — we leap at...  ...: Build the next generation query optimizer and execution engine that's fast, tuning...  ...experience, relevant certifications and training, and specific work location. Based on the... 
    Senior
    Training
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    2 days ago
  • $220k - $260k

     ...for the home.The Role - Senior Perception...  ...systems, with several at staff scope: owning a system...  ...grasp of linear algebra, optimization, statistics, and algorithms...  ...in practice: TensorRT engines, batching, fp16, and...  ...bottleneck is, from cloud training infrastructure down to... 
    Senior
    Training
    Local area
    Night shift

    Atomic

    San Francisco, CA
    5 days ago
  • $170k - $240k

     ...them reliable. As a Perception Engineer, you will own the full stack...  ...cutting-edge camera hardware, to training production-grade deep learning...  ...will: Design, train, and optimize deep learning models for detection...  .... Own the end-to-end ML lifecycle: data collection strategy... 
    Senior
    Training
    Flexible hours

    Alumni Ventures

    San Francisco, CA
    2 days ago
  • $262k - $364k

    Senior Staff Tech Lead, YouTube Shorts Discovery Share Senior...  ...project strategy, ML design, and working with...  ...’s degree or PhD in Engineering, Computer Science, or...  ...knowledge distillation for training more compact models....  ...architectures, and optimize ML infrastructure to drive... 
    Senior
    Training

    Google LLC

    San Bruno, CA
    2 days ago
  • $165k - $200k

     ...come build with us at Crusoe.About This RoleAs a Senior Systems Engineer, you’ll play a key role in building and optimizing Crusoe’s global technology infrastructure....  ...and broader infrastructure needsMentoring and training Service Desk team members, developing documentation... 
    Senior
    Training
    Temporary work

    Crusoe

    San Francisco, CA
    5 days ago
  • $208k - $245k

     ...do We are seeking a Perception Engineer to develop the systems that...  ...of expertise, you may: Design, train, and deploy machine learning models...  ...real-world system behavior. Optimize perception models and systems...  ...with AI Research, Robotics, ML Infrastructure, Software, Hardware... 
    Senior
    Training
    Full time
    Work at office
    Worldwide
    Flexible hours

    Pronto

    San Francisco, CA
    2 days ago
  • $125k - $142.5k

     ...for anyoneBy cutting clicks, optimizing diagnostic time, and unlocking...  ...information, please visit .Senior Integrations EngineerScale what...  ...for a Senior Integrations Engineer with strong DICOM experience...  ...experience, relevant education and training. Your recruiter can share... 
    Senior
    Training
    Full time
    Flexible hours
    Shift work

    Sirona Medical

    San Francisco, CA
    1 day ago
  • $15k

     ...worked at the frontier of applying AI/ML to investment management. We have...  ...catered lunches, and more.As a Senior Member of the Optimization Research Staff, you will work at the forefront of...  ...at the company.Years of academic training has prepared you for this moment.... 
    Senior
    Training
    Work at office
    Local area
    Remote work
    Relocation
    Work visa

    The Voleon Group

    Berkeley, CA
    4 days ago
  •  ...planners, designers, engineers, scientists, digital innovators...  ...an experienced Senior Electrical Engineer to...  ...skills enhancement training centric to AECOM's Sustainable...  ...and supporting junior staff. The Engineer will be...  ...energy use for optimizing systems selection.Ability... 
    Senior
    Training
    Work at office
    Local area
    Worldwide
    Flexible hours

    AECOM

    San Francisco, CA
    5 days ago
  • $194k - $291k

     ...platform, teams can analyze, test, and optimize user experiences faster than ever....  ...backgrounds to thrive.About the RoleAs a Senior Sales Engineer, Enterprise at Amplitude, you'll be the...  ...offer mentorship programs, management training, and wellness initiatives. We give... 
    Senior
    Training
    Work at office
    Home office

    Amplitude

    San Francisco, CA
    5 days ago
  • $180k - $250k

     ...and economical commerce. We're training robot AGI to power a...  ...obsessed team of the world's best engineers and operators. If you are obsessed...  ...Role We are looking for a Senior Software Engineer to join our...  ...Collaborate with robotics, ML, and product teams to define requirements... 
    Senior
    Training
    Local area
    Flexible hours

    Nimble Robotics

    San Francisco, CA
    a month ago
  • $109.34k - $164.01k

     ...reliability Advanced Materials and Joining - Engineering polymer and metal joining solutions for optimally performing circuits Film & Smart Surface Solutions...  ...documentation, batch validation, and operator training. Ability to lead process engineering related Capital... 
    Senior
    Training
    Local area
    Worldwide

    Element Solutions

    San Francisco, CA
    4 days ago
  •  ...Data, and Product to determine where new ML capabilities can meaningfully change...  ...distillation, compilation, and hardware-aware optimization.Lead step-change initiatives across...  ..., simplify fragmented systems, mentor senior engineers, and align technical and product... 
    Senior
    Work at office
    Local area

    Atlassian

    San Francisco, CA
    4 days ago
  •  ...entity. Responsibilities As a senior Machine Learning Systems Engineer on the Search Platform team, you...  ...search. Own end-to-end delivery of ML components from experimentation through...  ...to identify and execute cost optimization opportunities across vector search... 
    Senior
    Work at office
    Local area

    Atlassian

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior / Staff ML Training Optimization Engineer. Be the first to apply!