Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer: ML Optimization

Full-time

The Generalist

About the Role

We internally call this team MBMB (More Big More Better). You will own optimizations on both the training and on-robot inference stacks. We are still in a regime of step-function, not incremental, gains.

You’ll be responsible for:

  • Making GPUs go brrrrr

  • Implementing ML, hardware, and software changes that lead to step-function gains

  • Optimizing both the inference and training stacks

You might thrive in this role if you:

  • Are proficient and stay current with the latest ML techniques for training and inference optimizations in transformer and diffusion based architectures

  • Will chase ML optimizations anywhere: From the CUDA kernels, to ML architecture, to frontend or backend network bottlenecks, CPU bottlenecks, NVLink and comms, to torch, numpy, and Python inefficiencies.


About Generalist

At Generalist, we are on a mission to make general-purpose robots a reality. We believe the industries and homes of the future will depend on humans and machines working together in new ways. Robots can help us build more and get more done.

We build embodied foundation models, starting with a focus on dexterity. This requires advancing the frontiers of data, models, and hardware, to enable robots to intelligently interact with the physical world.

The company embraces both large-scale AI and robotics as core to its DNA. Our team of researchers, roboticists, and company builders come from OpenAI, Boston Dynamics, Google DeepMind, and other frontier labs—with a track record of shipping AI breakthroughs. Before Generalist, we pioneered large embodied multimodal models and vision-language-action models (PaLM-E, RT-2 , Gemini Robotics ), launched and scaled ChatGPT and GPT-4 to hundreds of millions of users, engineered the foundations of autonomous driving, built next-generation robots ( Atlas , Spot , Stretch ) and pushed the limits of what they can do (from parkour to manipulation , and testing robustness ).

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineer: ML Optimization in San Francisco, CA vacancy
  • $137.1k - $201.6k

     ...satisfaction and retention—and we’re pioneering new ways to optimize and personalize these decisions at scale using...  ...the Role We're seeking a Machine Learning Engineer to lead the development of state-of-the-art ML systems that personalize and optimize credits and refund... 
    Suggested
    Hourly pay
    Work at office
    Local area
    Remote work
    Flexible hours

    Doordash Usa

    San Francisco, CA
    1 day ago
  • $166k - $244k

     ...5 years of experience with software development in one or more programming...  ...following: Machine Learning Optimization (e.g., quantization,...  ...or specialization in another ML field. 3 years of experience...  ...in Computer Science, Computer Engineering, or a related technical field... 
    Suggested
    Full time
    Temporary work

    Google

    San Francisco, CA
    3 days ago
  • $202k - $237k

     ...computing and make it accessible to software developers of all skill levels...  ...data scientist can scale an ML application from their laptop...  ...seeking a Backend Software Engineer to join our team focused on building...  ...enhance user experience and optimize workflows. Compensation... 
    Suggested
    Full time
    Work at office
    Flexible hours

    Anyscale

    San Francisco, CA
    1 day ago
  • $125k - $195k

     ...design all the hardware and software needed to make chips and we make...  ...users are internal process engineers. We build tools for managing...  ...manufacturing process driven by AI and ML orchestration. About the...  ...fab processes and yield optimization goals. Required... 
    Suggested
    Full time
    Work at office
    Visa sponsorship
    Night shift

    Fab2

    San Francisco, CA
    1 day ago
  •  ..., will be as an Infrastructure / Backend Engineer on our founding team. You're the right...  ...powered agents in production Deploying and optimizing AI-heavy services with high availability...  ...Experience deploying and productionizing ML or AI-heavy workloads Expertise in... 
    Suggested
    Full time

    Vooma

    San Francisco, CA
    1 day ago
  • $266k

     ...pods away. We iterate fast, and engineer for reliable long-term impact...  ...’re looking for a Backend Software Engineer to help architect and...  ...transforming it into formats optimized for use by downstream systems...  ...over timeCuriosity about AI/ML and excitement to work alongside... 
    Internship
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    4 days ago
  • $126k

     ...organization. About the team: The ML Data Engineering team powers metadata extraction,...  ...Role Overview: We’re seeking a Software Engineer II with deep experience building...  ...Python. In this role, you’ll design and optimize large-scale data and service pipelines... 
    Full time
    Local area
    Worldwide
    Home office
    Flexible hours

    Scribd, Inc.

    San Francisco, CA
    1 day ago
  • $180k - $220k

     ...the AI era. We’re looking for a backend engineer to join our small team and help lead the...  ..., performance, and innovation around optimal team communication. Who you are An...  ...GraphQL APIs, with emphasis on integrating AI/ML inference endpoints and ensuring... 
    Work at office
    Local area
    Immediate start
    Flexible hours

    Glu Mobile Inc.

    San Francisco, CA
    4 days ago
  •  ...and help build the platform engineers turn to to ship AI products....  ...reliability, and ease of use. As a Software Engineer on the Inference...  ...to make new inference optimizations broadly available to customers...  ...open-source infrastructure or ML systems BENEFITS ~ Competitive... 
    Full time
    Flexible hours

    Baseten

    San Francisco, CA
    1 day ago
  •  ...and cutting-edge science to automate and optimize TV advertising to drive business...  ...their business.   We are seeking a Software Engineer to build out our simulation and AI capabilities...  ...accelerate how we build, test, and deploy ML systems. What you’ll do:... 
    Full time
    Work at office
    Remote work
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    1 day ago
  •  ...a small, fast-moving team of engineers focused on delivering a world...  ...Role We’re looking for a software engineer to help us serve OpenAI...  .... You'll build and optimize the systems that let users generate...  ...Have worked with GPU-based ML workloads and understand the... 
    Full time

    OpenAI

    San Francisco, CA
    1 day ago
  • $183k - $223.2k

     ...What the candidate will do As a Senior Engineer you will drive the development of high-impact solutions...  ...at scale. While your primary focus will be on optimizing logistics operations and network effects through core ML, you will also guide the team in integrating GenAI... 
    Full time
    Temporary work
    Visa sponsorship

    Uber Freight

    San Francisco, CA
    1 day ago
  • $115k - $140k

     ...is the critical hardware & software necessary to augment any off-...  ...the Job As a   Software Engineer - Perception   at Lodestar, you...  ...deployment Design, develop ML algorithms from the ground up...  ...in addition to build on and optimizing our existing models for edge... 
    Permanent employment
    Full time
    Flexible hours

    Lodestar Corporation

    San Francisco, CA
    1 day ago
  •  ...on it. MISSION We are looking for a Software Engineer specializing in Computational Geometry to design, build, and optimize the core geometric engines driving our...  ...Machine Learning: Hands-on experience developing ML models or LLM agents for spatial reasoning,... 
    Full time
    Contract work
    Local area
    Shift work

    Foundational Industries

    San Francisco, CA
    1 day ago
  •  ...Conviction. Join us and help build the platform engineers turn to to ship AI products. THE...  ..., runtime tuning, and server-level optimizations. Build large-scale, real-time infrastructure...  ...developer-oriented tools Interest in ML/AI infrastructure and willingness to... 
    Full time
    Flexible hours

    Baseten

    San Francisco, CA
    1 day ago
  • $144k - $270k

     ...Impact at LILA We are seeking a Senior Software Engineer to join our Applied AI group and help...  .... In this role, you will design and optimize the backend systems, data pipelines, and...  ...unstructured, and vectorized data for AI/ML workloads. Database & Knowledge Systems... 
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    San Francisco, CA
    1 day ago
  •  ...Kernels team at OpenAI builds the low-level software that accelerates our most ambitious AI...  ...performance kernels, distributed system optimizations, and runtime improvements to make large-...  ...compiler-focused role, rather bridging ML algorithms with system performance -... 
    Full time

    OpenAI

    San Francisco, CA
    1 day ago
  •  ...About Flow Flow Engineering is an AI-native requirements platform for...  ...is seeking AI-focused senior software engineers to build AI-powered...  ...models and related tooling, optimizing for reliability, latency, cost...  ...years of experience in applied ML, LLMs, or adjacent fields,... 
    Full time
    Flexible hours

    Flow Engineering

    San Francisco, CA
    1 day ago
  •  ...Conviction. Join us and help build the platform engineers turn to to ship AI products. THE...  ...that powers modern AI workloads, optimizing every microsecond of computation to enable...  ...implement high-performance GPU kernels for key ML operations, including matrix... 
    Full time
    Flexible hours

    Baseten

    San Francisco, CA
    1 day ago
  •  ...or as self-hosted and on-premises software, with unmatched accuracy, low...  ...Opportunity: We are seeking a Software Engineer to join Deepgram for Restaurants...  ...of our backend with our ML models and client devices Monitor and optimize the performance of our backend systems... 
    Full time
    Home office
    Flexible hours

    Deepgram

    San Francisco, CA
    1 day ago
  • $144k - $240k

     ...this a reality — and we need engineers who want to solve problems no...  ...hiring Sr Principal / Principal Software Engineers to design the agents...  ...AI to automated lab workflows, ML pipelines, and multi-domain...  ..., Vector DBs, and others) for optimal performance and scalability.... 
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    San Francisco, CA
    1 day ago
  • $181k - $220k

     ...home here. We are looking for a Senior Software Engineer to help build agentic systems that would...  ...applications. Prototype, test, and optimize AI-powered applications, including retrieval...  ...at least 2 years working directly on AI/ML-powered applications. ~ Strong fluency... 
    Full time
    Worldwide

    Aircall

    San Francisco, CA
    1 day ago
  • $220k - $247.5k

     ...games. We are looking for a Senior Machine Learning Engineer to join our Revenue ML team at Discord. This role sits at the intersection of Discord...  ...targeting, audience segmentation, and campaign optimization. Familiarity with loyalty, rewards, or incentive pro... 
    Full time
    Seasonal work

    Discord

    San Francisco, CA
    1 day ago
  •  ...reliable, and unblocked. You will work across engineering and infrastructure problems as they...  ...with experience in some layer of ML infrastructure. - Have worked on RL, inference...  ...stacks. - Background in performance optimization, scaling, or production-critical infrastructure... 
    Full time

    OpenAI

    San Francisco, CA
    1 day ago
  •  ...work sits at the intersection of production ML systems, developer platforms, model...  ...the Role We’re looking for a backend engineer who can quickly understand OpenAI’s models...  ...runtime abstractions for a stateful, cloud-optimized agentic platform. Partner closely with... 
    Full time
    Internship

    OpenAI

    San Francisco, CA
    1 day ago
  •  ...conversational deployments, engineered for the accuracy, performance...  ...Role Overview We're hiring a Software Engineer to own the serving...  ...sits at the intersection of ML systems and cloud infrastructure...  ...to the API surface. Model optimization from a single-node to... 
    Full time

    Unusual Ventures

    San Francisco, CA
    1 day ago
  • $150k - $220k

     ...Startups. We’re looking for a passionate Software Engineer, Frontend (Mid-level to Senior) to...  ...TypeScript, browser APIs, and performance optimization ~ Experience with web application and...  ...or interest in working with AI/ML teams to build intelligent workflows.... 
    Full time
    Immediate start
    Home office
    Flexible hours

    Zip

    San Francisco, CA
    1 day ago
  •  ...innovative thinkers. We don’t believe culture can be engineered – but when it falls into place, it’s a once-in-a-lifetime...  ...present. Position Overview We're looking for a software engineer to optimize and deploy ML models on our trucks' onboard compute, and to own... 
    Full time
    Local area

    Humble Robotics

    San Francisco, CA
    1 day ago
  • $130k - $400k

     ...and candidates.    Title of Role: Software Engineer – Marketplace (Backend Systems)...  ...design, data modeling, and performance optimization skills ~ Experience with Python, Go,...  ...search systems Experience supporting AI/ML-powered products or model inference infrastructure... 
    Full time
    Work at office
    Relocation package

    Recruiting From Scratch

    San Francisco, CA
    1 day ago
  •  ...The Lambda Infrastructure Engineering organization forges the foundation...  ...for an experienced Senior Software Engineer to join our storage...  ...to Have Experience with AI/ML workloads and the unique...  ...with performance tuning and optimization of storage systems. Familiarity... 
    Full time
    Work at office
    Local area
    Work from home
    Flexible hours

    Lambda

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer: ML Optimization. Be the first to apply!