Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer: ML Optimization

Full-time

The Generalist

About the Role

We internally call this team MBMB (More Big More Better). You will own optimizations on both the training and on-robot inference stacks. We are still in a regime of step-function, not incremental, gains.

You’ll be responsible for:

  • Making GPUs go brrrrr

  • Implementing ML, hardware, and software changes that lead to step-function gains

  • Optimizing both the inference and training stacks

You might thrive in this role if you:

  • Are proficient and stay current with the latest ML techniques for training and inference optimizations in transformer and diffusion based architectures

  • Will chase ML optimizations anywhere: From the CUDA kernels, to ML architecture, to frontend or backend network bottlenecks, CPU bottlenecks, NVLink and comms, to torch, numpy, and Python inefficiencies.


About Generalist

At Generalist, we are on a mission to make general-purpose robots a reality. We believe the industries and homes of the future will depend on humans and machines working together in new ways. Robots can help us build more and get more done.

We build embodied foundation models, starting with a focus on dexterity. This requires advancing the frontiers of data, models, and hardware, to enable robots to intelligently interact with the physical world.

The company embraces both large-scale AI and robotics as core to its DNA. Our team of researchers, roboticists, and company builders come from OpenAI, Boston Dynamics, Google DeepMind, and other frontier labs—with a track record of shipping AI breakthroughs. Before Generalist, we pioneered large embodied multimodal models and vision-language-action models (PaLM-E, RT-2 , Gemini Robotics ), launched and scaled ChatGPT and GPT-4 to hundreds of millions of users, engineered the foundations of autonomous driving, built next-generation robots ( Atlas , Spot , Stretch ) and pushed the limits of what they can do (from parkour to manipulation , and testing robustness ).

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

Vacancy posted 18 hours ago
Similar jobs that could be interesting for youBased on the Software Engineer: ML Optimization in San Francisco, CA vacancy
  • $137.1k - $201.6k

     ...satisfaction and retention—and we’re pioneering new ways to optimize and personalize these decisions at scale using...  ...the Role We're seeking a Machine Learning Engineer to lead the development of state-of-the-art ML systems that personalize and optimize credits and refund... 
    Suggested
    Hourly pay
    Work at office
    Local area
    Remote work
    Flexible hours

    Doordash Usa

    San Francisco, CA
    18 hours ago
  • $166k - $244k

     ...5 years of experience with software development in one or more programming...  ...following: Machine Learning Optimization (e.g., quantization,...  ...or specialization in another ML field. 3 years of experience...  ...in Computer Science, Computer Engineering, or a related technical field... 
    Suggested
    Full time
    Temporary work

    Google

    San Francisco, CA
    3 days ago
  • $202k - $237k

     ...computing and make it accessible to software developers of all skill levels...  ...data scientist can scale an ML application from their laptop...  ...seeking a Backend Software Engineer to join our team focused on building...  ...enhance user experience and optimize workflows. Compensation... 
    Suggested
    Full time
    Work at office
    Flexible hours

    Anyscale

    San Francisco, CA
    18 hours ago
  • $125k - $195k

     ...design all the hardware and software needed to make chips and we make...  ...users are internal process engineers. We build tools for managing...  ...manufacturing process driven by AI and ML orchestration. About the...  ...fab processes and yield optimization goals. Required... 
    Suggested
    Full time
    Work at office
    Visa sponsorship
    Night shift

    Fab2

    San Francisco, CA
    18 hours ago
  • $266k

     ...pods away. We iterate fast, and engineer for reliable long-term impact...  ...’re looking for a Backend Software Engineer to help architect and...  ...transforming it into formats optimized for use by downstream systems...  ...over timeCuriosity about AI/ML and excitement to work alongside... 
    Suggested
    Internship
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    4 days ago
  •  ..., will be as an Infrastructure / Backend Engineer on our founding team. You're the right...  ...powered agents in production Deploying and optimizing AI-heavy services with high availability...  ...Experience deploying and productionizing ML or AI-heavy workloads Expertise in... 
    Full time

    Vooma

    San Francisco, CA
    18 hours ago
  • $126k

     ...organization. About the team: The ML Data Engineering team powers metadata extraction,...  ...Role Overview: We’re seeking a Software Engineer II with deep experience building...  ...Python. In this role, you’ll design and optimize large-scale data and service pipelines... 
    Full time
    Local area
    Worldwide
    Home office
    Flexible hours

    Scribd, Inc.

    San Francisco, CA
    18 hours ago
  • $180k - $220k

     ...the AI era. We’re looking for a backend engineer to join our small team and help lead the...  ..., performance, and innovation around optimal team communication. Who you are An...  ...GraphQL APIs, with emphasis on integrating AI/ML inference endpoints and ensuring... 
    Work at office
    Local area
    Immediate start
    Flexible hours

    Glu Mobile Inc.

    San Francisco, CA
    4 days ago
  •  ...on it. MISSION We are looking for a Software Engineer specializing in Computational Geometry to design, build, and optimize the core geometric engines driving our...  ...Machine Learning: Hands-on experience developing ML models or LLM agents for spatial reasoning,... 
    Full time
    Contract work
    Local area
    Shift work

    Foundational Industries

    San Francisco, CA
    18 hours ago
  • $115k - $140k

     ...is the critical hardware & software necessary to augment any off-...  ...the Job As a   Software Engineer - Perception   at Lodestar, you...  ...deployment Design, develop ML algorithms from the ground up...  ...in addition to build on and optimizing our existing models for edge... 
    Permanent employment
    Full time
    Flexible hours

    Lodestar Corporation

    San Francisco, CA
    18 hours ago
  •  ...Conviction. Join us and help build the platform engineers turn to to ship AI products. THE...  ..., runtime tuning, and server-level optimizations. Build large-scale, real-time infrastructure...  ...developer-oriented tools Interest in ML/AI infrastructure and willingness to... 
    Full time
    Flexible hours

    Baseten

    San Francisco, CA
    18 hours ago
  •  ...Kernels team at OpenAI builds the low-level software that accelerates our most ambitious AI...  ...performance kernels, distributed system optimizations, and runtime improvements to make large-...  ...compiler-focused role, rather bridging ML algorithms with system performance -... 
    Full time

    OpenAI

    San Francisco, CA
    18 hours ago
  •  ...and cutting-edge science to automate and optimize TV advertising to drive business...  ...their business.   We are seeking a Sr. Software Engineer to build out our simulation and AI capabilities...  ...how we build, test, and deploy ML systems. What you’ll do: Design... 
    Full time
    Work at office
    Remote work
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    18 hours ago
  • $144k - $270k

     ...Impact at LILA We are seeking a Senior Software Engineer to join our Applied AI group and help...  .... In this role, you will design and optimize the backend systems, data pipelines, and...  ...unstructured, and vectorized data for AI/ML workloads. Database & Knowledge Systems... 
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    San Francisco, CA
    18 hours ago
  • $175k - $250k

     ...role Swayable is seeking a Senior Engineer blending Python software development expertise with scientific...  ...in architecting, maintaining, and optimizing distributed, parallel computing systems...  ...the constantly evolving toolset for ML and AI Ops. You are knowledgeable... 
    Full time

    Swayable

    San Francisco, CA
    11 hours ago
  •  ...and help build the platform engineers turn to to ship AI products....  ...reliability, and ease of use. As a Software Engineer on the Inference...  ...to make new inference optimizations broadly available to customers...  ...open-source infrastructure or ML systems BENEFITS ~ Competitive... 
    Full time
    Flexible hours

    Baseten

    San Francisco, CA
    18 hours ago
  •  ...a small, fast-moving team of engineers focused on delivering a world...  ...Role We’re looking for a software engineer to help us serve OpenAI...  .... You'll build and optimize the systems that let users generate...  ...Have worked with GPU-based ML workloads and understand the... 
    Full time

    OpenAI

    San Francisco, CA
    18 hours ago
  • $220k - $275k

     ...playing games. We are looking for a Senior Software Engineer specializing in Machine Learning to join our Revenue ML team at Discord. This team partners with our revenue...  ...ML models that enhance ad relevance, optimize performance, and drive revenue. This is a unique... 
    Full time
    Shift work

    Discord

    San Francisco, CA
    18 hours ago
  •  ...massive data and cutting-edge science to automate and optimize TV advertising to drive business outcomes. Our...  ...grow their business.   As a Sr. Machine Learning Engineer at tvScientific, you'll build the ML and AI systems behind our Connected TV ad-buying platform... 
    Full time
    Work at office
    Remote work
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    18 hours ago
  •  ...cost are spent, then turn that understanding into performance optimizations and models that project performance and capacity needs for...  ...benchmarking, analysis, and optimization. Enjoy collaborating with engineering and research teams to improve real production systems.... 
    Full time

    OpenAI

    San Francisco, CA
    18 hours ago
  •  ...We're looking for a strong generalist software engineer to help us ship the next version of our...  ...bottleneck Collaborate closely with ML, hardware, and clinical teams to ship end...  ...them ~ Pragmatic instincts about when to optimize, when to ship, and when to rewrite ~ Strong... 
    Permanent employment
    Full time
    Remote work

    Remedy Robotics

    San Francisco, CA
    18 hours ago
  •  ...bus stop enforcement to transportation optimization technologies and beyond, our innovative...  ...What the job involves As a Senior Software Engineer on the Platform - Cloud Events team, you...  ...validated and assessed by the powerful ML models that run in the Cloud. In this role... 
    Full time
    Work at office
    3 days per week

    Hayden Ai

    San Francisco, CA
    18 hours ago
  •  ...are easy for researchers to use and maximally utilized Optimizing and improving ML data loading transport and storage in highly distributed...  ...scaled ChatGPT and GPT-4 to hundreds of millions of users, engineered the foundations of autonomous driving, built next-... 
    Full time

    The Generalist

    San Francisco, CA
    18 hours ago
  • $177k - $245k

     ...there were no similarly great tools to help ML practitioners build better models....  ...practitioners and our business. As a Senior Software Engineer, you will lead initiatives in pricing,...  ..., integrating with billing vendors for optimal user experience. Collaborate with... 
    Remote job
    Full time
    Temporary work
    Work at office
    Home office
    Flexible hours

    Weights & Biases

    San Francisco, CA
    18 hours ago
  •  ...reliable, and unblocked. You will work across engineering and infrastructure problems as they...  ...with experience in some layer of ML infrastructure. - Have worked on RL, inference...  ...stacks. - Background in performance optimization, scaling, or production-critical infrastructure... 
    Full time

    OpenAI

    San Francisco, CA
    18 hours ago
  •  ...work sits at the intersection of production ML systems, developer platforms, model...  ...the Role We’re looking for a backend engineer who can quickly understand OpenAI’s models...  ...runtime abstractions for a stateful, cloud-optimized agentic platform. Partner closely with... 
    Full time
    Internship

    OpenAI

    San Francisco, CA
    18 hours ago
  • $150k - $220k

     ...Startups. We’re looking for a passionate Software Engineer, Frontend (Mid-level to Senior) to...  ...TypeScript, browser APIs, and performance optimization ~ Experience with web application and...  ...or interest in working with AI/ML teams to build intelligent workflows.... 
    Full time
    Immediate start
    Home office
    Flexible hours

    Zip

    San Francisco, CA
    18 hours ago
  •  ...conversational deployments, engineered for the accuracy, performance...  ...Role Overview We're hiring a Software Engineer to own the serving...  ...sits at the intersection of ML systems and cloud infrastructure...  ...to the API surface. Model optimization from a single-node to... 
    Full time

    Unusual Ventures

    San Francisco, CA
    18 hours ago
  •  ...library that empowers all our engineers and designers. By delivering...  ...accessibility, and code quality. You’ll optimize our frontend for speed (...  ...who share our passion for software craftsmanship and getting...  ...experience : Exposure to AI or ML products, especially building... 
    Full time
    Flexible hours

    Sierra Limited

    San Francisco, CA
    18 hours ago
  •  ...Background: Specter is creating a software-defined "control plane" for...  ...become the perception engine for a company's physical footprint...  ...containerization, inference optimization, and deployment to edge...  ...Qualifications: Experience taking ML models from research code to... 
    Full time
    Shift work

    S.e. Specter

    San Francisco, CA
    18 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer: ML Optimization. Be the first to apply!