Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer: ML Optimization

Full-time

The Generalist

About the Role

We internally call this team MBMB (More Big More Better). You will own optimizations on both the training and on-robot inference stacks. We are still in a regime of step-function, not incremental, gains.

You’ll be responsible for:

  • Making GPUs go brrrrr

  • Implementing ML, hardware, and software changes that lead to step-function gains

  • Optimizing both the inference and training stacks

You might thrive in this role if you:

  • Are proficient and stay current with the latest ML techniques for training and inference optimizations in transformer and diffusion based architectures

  • Will chase ML optimizations anywhere: From the CUDA kernels, to ML architecture, to frontend or backend network bottlenecks, CPU bottlenecks, NVLink and comms, to torch, numpy, and Python inefficiencies.


About Generalist

At Generalist, we are on a mission to make general-purpose robots a reality. We believe the industries and homes of the future will depend on humans and machines working together in new ways. Robots can help us build more and get more done.

We build embodied foundation models, starting with a focus on dexterity. This requires advancing the frontiers of data, models, and hardware, to enable robots to intelligently interact with the physical world.

The company embraces both large-scale AI and robotics as core to its DNA. Our team of researchers, roboticists, and company builders come from OpenAI, Boston Dynamics, Google DeepMind, and other frontier labs—with a track record of shipping AI breakthroughs. Before Generalist, we pioneered large embodied multimodal models and vision-language-action models (PaLM-E, RT-2 , Gemini Robotics ), launched and scaled ChatGPT and GPT-4 to hundreds of millions of users, engineered the foundations of autonomous driving, built next-generation robots ( Atlas , Spot , Stretch ) and pushed the limits of what they can do (from parkour to manipulation , and testing robustness ).

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

Vacancy posted 10 hours ago
Similar jobs that could be interesting for youBased on the Software Engineer: ML Optimization in San Francisco, CA vacancy
  • $137.1k - $201.6k

     ...satisfaction and retention—and we’re pioneering new ways to optimize and personalize these decisions at scale using...  ...the Role We're seeking a Machine Learning Engineer to lead the development of state-of-the-art ML systems that personalize and optimize credits and refund... 
    Suggested
    Hourly pay
    Work at office
    Local area
    Remote work
    Flexible hours

    Doordash Usa

    San Francisco, CA
    10 hours ago
  • $166k - $244k

     ...5 years of experience with software development in one or more programming...  ...following: Machine Learning Optimization (e.g., quantization,...  ...or specialization in another ML field. 3 years of experience...  ...in Computer Science, Computer Engineering, or a related technical field... 
    Suggested
    Full time
    Temporary work

    Google

    San Francisco, CA
    3 days ago
  • $202k - $237k

     ...computing and make it accessible to software developers of all skill levels...  ...data scientist can scale an ML application from their laptop...  ...seeking a Backend Software Engineer to join our team focused on building...  ...enhance user experience and optimize workflows. Compensation... 
    Suggested
    Full time
    Work at office
    Flexible hours

    Anyscale

    San Francisco, CA
    10 hours ago
  • $125k - $195k

     ...design all the hardware and software needed to make chips and we make...  ...users are internal process engineers. We build tools for managing...  ...manufacturing process driven by AI and ML orchestration. About the...  ...fab processes and yield optimization goals. Required... 
    Suggested
    Full time
    Work at office
    Visa sponsorship
    Night shift

    Fab2

    San Francisco, CA
    10 hours ago
  • $266k

     ...pods away. We iterate fast, and engineer for reliable long-term impact...  ...’re looking for a Backend Software Engineer to help architect and...  ...transforming it into formats optimized for use by downstream systems...  ...over timeCuriosity about AI/ML and excitement to work alongside... 
    Suggested
    Internship
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    4 days ago
  •  ..., will be as an Infrastructure / Backend Engineer on our founding team. You're the right...  ...powered agents in production Deploying and optimizing AI-heavy services with high availability...  ...Experience deploying and productionizing ML or AI-heavy workloads Expertise in... 
    Full time

    Vooma

    San Francisco, CA
    10 hours ago
  • $126k

     ...organization. About the team: The ML Data Engineering team powers metadata extraction,...  ...Role Overview: We’re seeking a Software Engineer II with deep experience building...  ...Python. In this role, you’ll design and optimize large-scale data and service pipelines... 
    Full time
    Local area
    Worldwide
    Home office
    Flexible hours

    Scribd, Inc.

    San Francisco, CA
    10 hours ago
  • $180k - $220k

     ...the AI era. We’re looking for a backend engineer to join our small team and help lead the...  ..., performance, and innovation around optimal team communication. Who you are An...  ...GraphQL APIs, with emphasis on integrating AI/ML inference endpoints and ensuring... 
    Work at office
    Local area
    Immediate start
    Flexible hours

    Glu Mobile Inc.

    San Francisco, CA
    4 days ago
  •  ...Conviction. Join us and help build the platform engineers turn to to ship AI products. THE...  ..., runtime tuning, and server-level optimizations. Build large-scale, real-time infrastructure...  ...developer-oriented tools Interest in ML/AI infrastructure and willingness to... 
    Full time
    Flexible hours

    Baseten

    San Francisco, CA
    10 hours ago
  •  ...on it. MISSION We are looking for a Software Engineer specializing in Computational Geometry to design, build, and optimize the core geometric engines driving our...  ...Machine Learning: Hands-on experience developing ML models or LLM agents for spatial reasoning,... 
    Full time
    Contract work
    Local area
    Shift work

    Foundational Industries

    San Francisco, CA
    10 hours ago
  • $115k - $140k

     ...is the critical hardware & software necessary to augment any off-...  ...the Job As a   Software Engineer - Perception   at Lodestar, you...  ...deployment Design, develop ML algorithms from the ground up...  ...in addition to build on and optimizing our existing models for edge... 
    Permanent employment
    Full time
    Flexible hours

    Lodestar Corporation

    San Francisco, CA
    10 hours ago
  • $220k - $275k

     ...playing games. We are looking for a Senior Software Engineer specializing in Machine Learning to join our Revenue ML team at Discord. This team partners with our revenue...  ...ML models that enhance ad relevance, optimize performance, and drive revenue. This is a unique... 
    Full time
    Shift work

    Discord

    San Francisco, CA
    10 hours ago
  •  ...massive data and cutting-edge science to automate and optimize TV advertising to drive business outcomes. Our...  ...grow their business.   As a Sr. Machine Learning Engineer at tvScientific, you'll build the ML and AI systems behind our Connected TV ad-buying platform... 
    Full time
    Work at office
    Remote work
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    10 hours ago
  •  ...cost are spent, then turn that understanding into performance optimizations and models that project performance and capacity needs for...  ...benchmarking, analysis, and optimization. Enjoy collaborating with engineering and research teams to improve real production systems.... 
    Full time

    OpenAI

    San Francisco, CA
    10 hours ago
  •  ...We're looking for a strong generalist software engineer to help us ship the next version of our...  ...bottleneck Collaborate closely with ML, hardware, and clinical teams to ship end...  ...them ~ Pragmatic instincts about when to optimize, when to ship, and when to rewrite ~ Strong... 
    Permanent employment
    Full time
    Remote work

    Remedy Robotics

    San Francisco, CA
    10 hours ago
  •  ...bus stop enforcement to transportation optimization technologies and beyond, our innovative...  ...What the job involves As a Senior Software Engineer on the Platform - Cloud Events team, you...  ...validated and assessed by the powerful ML models that run in the Cloud. In this role... 
    Full time
    Work at office
    3 days per week

    Hayden Ai

    San Francisco, CA
    10 hours ago
  •  ...are easy for researchers to use and maximally utilized Optimizing and improving ML data loading transport and storage in highly distributed...  ...scaled ChatGPT and GPT-4 to hundreds of millions of users, engineered the foundations of autonomous driving, built next-... 
    Full time

    The Generalist

    San Francisco, CA
    10 hours ago
  • $177k - $245k

     ...there were no similarly great tools to help ML practitioners build better models....  ...practitioners and our business. As a Senior Software Engineer, you will lead initiatives in pricing,...  ..., integrating with billing vendors for optimal user experience. Collaborate with... 
    Remote job
    Full time
    Temporary work
    Work at office
    Home office
    Flexible hours

    Weights & Biases

    San Francisco, CA
    10 hours ago
  •  ...a small, fast-moving team of engineers focused on delivering a world...  ...Role We’re looking for a software engineer to help us serve OpenAI...  .... You'll build and optimize the systems that let users generate...  ...Have worked with GPU-based ML workloads and understand the... 
    Full time

    OpenAI

    San Francisco, CA
    10 hours ago
  •  ...and cutting-edge science to automate and optimize TV advertising to drive business...  ...their business.   We are seeking a Software Engineer to build out our simulation and AI capabilities...  ...accelerate how we build, test, and deploy ML systems. What you’ll do:... 
    Full time
    Work at office
    Remote work
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    10 hours ago
  •  ...and help build the platform engineers turn to to ship AI products....  ...reliability, and ease of use. As a Software Engineer on the Inference...  ...to make new inference optimizations broadly available to customers...  ...open-source infrastructure or ML systems BENEFITS ~ Competitive... 
    Full time
    Flexible hours

    Baseten

    San Francisco, CA
    10 hours ago
  • $181k - $220k

     ...home here. We are looking for a Senior Software Engineer to help build agentic systems that would...  ...applications. Prototype, test, and optimize AI-powered applications, including retrieval...  ...at least 2 years working directly on AI/ML-powered applications. ~ Strong fluency... 
    Full time
    Worldwide

    Aircall

    San Francisco, CA
    10 hours ago
  • $144k - $240k

     ...this a reality — and we need engineers who want to solve problems no...  ...hiring Sr Principal / Principal Software Engineers to design the agents...  ...AI to automated lab workflows, ML pipelines, and multi-domain...  ..., Vector DBs, and others) for optimal performance and scalability.... 
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    San Francisco, CA
    10 hours ago
  •  ...or as self-hosted and on-premises software, with unmatched accuracy, low...  ...Opportunity: We are seeking a Software Engineer to join Deepgram for Restaurants...  ...of our backend with our ML models and client devices Monitor and optimize the performance of our backend systems... 
    Full time
    Home office
    Flexible hours

    Deepgram

    San Francisco, CA
    10 hours ago
  •  ...Conviction. Join us and help build the platform engineers turn to to ship AI products. THE...  ...that powers modern AI workloads, optimizing every microsecond of computation to enable...  ...implement high-performance GPU kernels for key ML operations, including matrix... 
    Full time
    Flexible hours

    Baseten

    San Francisco, CA
    10 hours ago
  • $220k - $247.5k

     ...games. We are looking for a Senior Machine Learning Engineer to join our Revenue ML team at Discord. This role sits at the intersection of Discord...  ...targeting, audience segmentation, and campaign optimization. Familiarity with loyalty, rewards, or incentive pro... 
    Full time
    Seasonal work

    Discord

    San Francisco, CA
    10 hours ago
  • $175k - $250k

     ...role Swayable is seeking a Senior Engineer blending Python software development expertise with scientific...  ...in architecting, maintaining, and optimizing distributed, parallel computing systems...  ...the constantly evolving toolset for ML and AI Ops. You are knowledgeable... 
    Full time

    Swayable

    San Francisco, CA
    3 hours ago
  •  ...Kernels team at OpenAI builds the low-level software that accelerates our most ambitious AI...  ...performance kernels, distributed system optimizations, and runtime improvements to make large-...  ...compiler-focused role, rather bridging ML algorithms with system performance -... 
    Full time

    OpenAI

    San Francisco, CA
    10 hours ago
  • $144k - $270k

     ...Impact at LILA We are seeking a Senior Software Engineer to join our Applied AI group and help...  .... In this role, you will design and optimize the backend systems, data pipelines, and...  ...unstructured, and vectorized data for AI/ML workloads. Database & Knowledge Systems... 
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    San Francisco, CA
    10 hours ago
  • $130k - $400k

     ...and candidates.    Title of Role: Software Engineer – Marketplace (Backend Systems)...  ...design, data modeling, and performance optimization skills ~ Experience with Python, Go,...  ...search systems Experience supporting AI/ML-powered products or model inference infrastructure... 
    Full time
    Work at office
    Relocation package

    Recruiting From Scratch

    San Francisco, CA
    10 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer: ML Optimization. Be the first to apply!