Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer: ML Optimization

Full-time

The Generalist

About the Role

We internally call this team MBMB (More Big More Better). You will own optimizations on both the training and on-robot inference stacks. We are still in a regime of step-function, not incremental, gains.

You’ll be responsible for:

  • Making GPUs go brrrrr

  • Implementing ML, hardware, and software changes that lead to step-function gains

  • Optimizing both the inference and training stacks

You might thrive in this role if you:

  • Are proficient and stay current with the latest ML techniques for training and inference optimizations in transformer and diffusion based architectures

  • Will chase ML optimizations anywhere: From the CUDA kernels, to ML architecture, to frontend or backend network bottlenecks, CPU bottlenecks, NVLink and comms, to torch, numpy, and Python inefficiencies.


About Generalist

At Generalist, we are on a mission to make general-purpose robots a reality. We believe the industries and homes of the future will depend on humans and machines working together in new ways. Robots can help us build more and get more done.

We build embodied foundation models, starting with a focus on dexterity. This requires advancing the frontiers of data, models, and hardware, to enable robots to intelligently interact with the physical world.

The company embraces both large-scale AI and robotics as core to its DNA. Our team of researchers, roboticists, and company builders come from OpenAI, Boston Dynamics, Google DeepMind, and other frontier labs—with a track record of shipping AI breakthroughs. Before Generalist, we pioneered large embodied multimodal models and vision-language-action models (PaLM-E, RT-2 , Gemini Robotics ), launched and scaled ChatGPT and GPT-4 to hundreds of millions of users, engineered the foundations of autonomous driving, built next-generation robots ( Atlas , Spot , Stretch ) and pushed the limits of what they can do (from parkour to manipulation , and testing robustness ).

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

Vacancy posted 21 hours ago
Similar jobs that could be interesting for youBased on the Software Engineer: ML Optimization in San Francisco, CA vacancy
  •  ...with hands-on support from AMD engineers the team is scaling rapidly to...  ...learn how large AI models are optimized and deployed at scale, and collaborate closely with ML researchers and experienced systems...  ...experience) ~3+ years of software engineering experience, with a... 
    Suggested
    Full time
    Work at office
    Flexible hours

    Sciforium

    San Francisco, CA
    21 hours ago
  •  ...Minerals Mariana Minerals is a software-first, vertically integrated...  ...Senior Full Stack Software Engineer to lead critical technical initiatives...  ...collaboration with ML engineers to integrate LLMs for...  ...reliability and performance optimization for critical systems. What... 
    Suggested
    Full time

    Mariana Minerals

    San Francisco, CA
    21 hours ago
  • $202k - $237k

     ...computing and make it accessible to software developers of all skill levels...  ...data scientist can scale an ML application from their laptop...  ...seeking a Backend Software Engineer to join our team focused on building...  ...enhance user experience and optimize workflows. Compensation... 
    Suggested
    Full time
    Work at office
    Flexible hours

    Anyscale

    San Francisco, CA
    21 hours ago
  • $120k - $180k

     ...team is tackling cutting-edge engineering challenges to bring...  ...are looking for a full-stack software enginee r to turn whiteboard...  ...iterations. Collaborate daily with ML, hardware, and industrial...  ...high-quality results; debug, optimize performance, and ensure reliability... 
    Suggested
    Full time
    Visa sponsorship

    Tacit Llc

    San Francisco, CA
    21 hours ago
  • $300k - $320k

     ...group of committed researchers, engineers, policy experts, and business...  ...is looking for backend software engineers to work across our...  ...inference and safeguards to optimize the full stack. API Capabilities...  ..., SSO, RBAC) Exposure to ML/AI systems or an understanding... 
    Suggested
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    21 hours ago
  • $230k - $385k

     ...pods away. We iterate fast, and engineer for reliable long-term impact...  ...’re looking for a Backend Software Engineer to help architect and...  ...transforming it into formats optimized for use by downstream systems...  ...over timeCuriosity about AI/ML and excitement to work alongside... 
    Internship
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    4 days ago
  • $126k

     ...organization. About the team: The ML Data Engineering team powers metadata extraction,...  ...Role Overview: We’re seeking a Software Engineer II with deep experience building...  ...Python. In this role, you’ll design and optimize large-scale data and service pipelines... 
    Full time
    Local area
    Worldwide
    Home office
    Flexible hours

    Scribd, Inc.

    San Francisco, CA
    21 hours ago
  •  ..., will be as an Infrastructure / Backend Engineer on our founding team. You're the right...  ...powered agents in production Deploying and optimizing AI-heavy services with high availability...  ...Experience deploying and productionizing ML or AI-heavy workloads Expertise in... 
    Full time

    Vooma

    San Francisco, CA
    21 hours ago
  • $180k - $220k

     ...the AI era. We’re looking for a backend engineer to join our small team and help lead the...  ..., performance, and innovation around optimal team communication. Who you are An...  ...GraphQL APIs, with emphasis on integrating AI/ML inference endpoints and ensuring... 
    Work at office
    Local area
    Immediate start
    Flexible hours

    Glu Mobile Inc.

    San Francisco, CA
    4 days ago
  •  ...About Flow Flow Engineering is an AI-native requirements platform for...  ...is seeking AI-focused senior software engineers to build AI-powered...  ...models and related tooling, optimizing for reliability, latency, cost...  ...years of experience in applied ML, LLMs, or adjacent fields,... 
    Full time
    Flexible hours

    Flow Engineering

    San Francisco, CA
    21 hours ago
  •  ...are looking to recruit an exceptional Software Engineer - Software Development and Machine Learning...  ...and deployment. Monitor and optimize system performance, availability, and security...  ...practices and compliance standards in AI/ML environments. Proficiency in database... 
    Full time

    Maven Robotics

    San Francisco, CA
    21 hours ago
  •  ...Kernels team at OpenAI builds the low-level software that accelerates our most ambitious AI...  ...performance kernels, distributed system optimizations, and runtime improvements to make large-...  ...compiler-focused role, rather bridging ML algorithms with system performance -... 
    Full time

    OpenAI

    San Francisco, CA
    21 hours ago
  • $156k - $195k

     ...and private evaluations. About Data Engine Our Generative AI Data Engine...  ...assessments, and incentives - partnering with ML teams to optimize how contributors are evaluated and...  ...Requirements: ~3+ years of relevant software engineering experience ~ Track... 
    Full time
    Shift work

    Scale Ai

    San Francisco, CA
    21 hours ago
  •  ...Conviction. Join us and help build the platform engineers turn to to ship AI products. THE...  ...that powers modern AI workloads, optimizing every microsecond of computation to enable...  ...implement high-performance GPU kernels for key ML operations, including matrix... 
    Full time
    Flexible hours

    Baseten

    San Francisco, CA
    21 hours ago
  •  ...or as self-hosted and on-premises software, with unmatched accuracy, low...  ...Opportunity: We are seeking a Software Engineer to join Deepgram for Restaurants...  ...of our backend with our ML models and client devices Monitor and optimize the performance of our backend systems... 
    Full time
    Home office
    Flexible hours

    Deepgram

    San Francisco, CA
    21 hours ago
  •  ...Tech Lead to drive the design, optimization, and scaling of our inference...  .... In this role, you’ll lead engineering efforts to ensure our largest...  ...layer of large-scale ML infrastructure. Understand the...  ...performance issues across hardware and software layers. Have strong... 
    Full time

    OpenAI

    San Francisco, CA
    21 hours ago
  • $325k

     ...group of committed researchers, engineers, policy experts, and business...  ...for reliability-minded software engineers and SREs. Are curious...  ...experience with one or more ML hardware accelerators (GPUs,...  ...Understand ML-specific networking optimizations like RDMA and InfiniBand.... 
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    21 hours ago
  • $220k - $247.5k

     ...games. We are looking for a Senior Machine Learning Engineer to join our Revenue ML team at Discord. This role sits at the intersection of Discord...  ...targeting, audience segmentation, and campaign optimization. Familiarity with loyalty, rewards, or incentive pro... 
    Full time
    Seasonal work

    Discord

    San Francisco, CA
    21 hours ago
  • $320k

     ...group of committed researchers, engineers, policy experts, and business...  ...and unattended. As a Software Engineer on the Launch Engineering...  ...is a resource-constrained optimization problem at its core: validation...  ...Have Experience with ML inference or training... 
    Full time
    Work at office
    Visa sponsorship
    Flexible hours
    Shift work

    Anthropic

    San Francisco, CA
    21 hours ago
  •  ...functional group working across engineering, product, research, and...  ...re looking for an experienced Software Engineer to build measurement...  ...high-quality labels for ads optimization. We are hiring engineers who...  ...closely with Ads Delivery, Ads ML, Product, Research, Privacy,... 
    Full time
    Relocation package

    OpenAI

    San Francisco, CA
    21 hours ago
  •  ...agent assistance, and AI-powered workforce management that optimizes both human and AI capacity, Assembled helps teams deliver...  ...iteration. About you (specifically) Familiarity with ML packages and software: Experience using Python libraries like pandas, SciPy,... 
    Full time

    Assembled

    San Francisco, CA
    21 hours ago
  •  ...a highly motivated and bright engineer to join our team and devise elegant...  ...systems to support Voxel's ML development. As a part of the...  ...solving problems across the software stack. We require engineers to...  ...retail spaces. Implement and optimize computer vision techniques for... 
    Full time
    Work at office
    Flexible hours

    Voxel

    San Francisco, CA
    21 hours ago
  •  ..., AI scientists, PhDs, creatives, technologists, and engineers working together to empower people and make care make...  ...reasoning, and structured outputs. Collaborate with ML and infra engineers to scale and optimize GenAI workflows , managing latency, context windows,... 
    Hourly pay
    Full time
    Work at office
    Relocation package
    Flexible hours

    Abridge

    San Francisco, CA
    21 hours ago
  •  ...responsible for the architectural and engineering backbone of OpenAI’s...  ...models. Our work spans system software, networking, platform...  ...monitoring, and performance optimization. About the Role We’re hiring...  ...~5+ years in one or more of: ML systems, performance engineering... 
    Full time

    OpenAI

    San Francisco, CA
    21 hours ago
  • $320k - $405k

     ...group of committed researchers, engineers, policy experts, and business...  ...to macOS and Windows Optimize application performance, memory...  ...5+ years of experience as a software engineer, with strong emphasis...  ...integrating and working with AI/ML models and understanding... 
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    21 hours ago
  • $136k - $160.5k

     ...About the Role: We are seeking a Software Engineer, Control Plane to help build and scale...  ...systems that manage our global fleet of AI-optimized compute, network, and storage resources...  ...differentiated cloud solutions for AI/ML customers. Operational Excellence:... 
    Full time
    Temporary work
    Immediate start

    Crusoe

    San Francisco, CA
    21 hours ago
  •  ...work sits at the intersection of production ML systems, developer platforms, model...  ...the Role We’re looking for a backend engineer who can quickly understand OpenAI’s models...  ...runtime abstractions for a stateful, cloud-optimized agentic platform. Partner closely with... 
    Full time
    Internship

    OpenAI

    San Francisco, CA
    21 hours ago
  •  ...reliable, and unblocked. You will work across engineering and infrastructure problems as they...  ...with experience in some layer of ML infrastructure. - Have worked on RL, inference...  ...stacks. - Background in performance optimization, scaling, or production-critical infrastructure... 
    Full time

    OpenAI

    San Francisco, CA
    21 hours ago
  •  ...We are a small, fast-growing team of engineers in San Francisco powering Fortune 100 enterprises...  ...with smart batching and caching Optimize kernels, tokenization, and model graphs...  ...~3+ years in performance engineering or ML systems ~ Strong Python, plus C++ or CUDA... 
    Full time
    Work at office
    Visa sponsorship
    Relocation package

    Pulse

    San Francisco, CA
    21 hours ago
  •  ...a small, fast-moving team of engineers focused on delivering a world...  ...Role We’re looking for a software engineer to help us serve OpenAI...  .... You'll build and optimize the systems that let users generate...  ...Have worked with GPU-based ML workloads and understand the... 
    Full time

    OpenAI

    San Francisco, CA
    21 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer: ML Optimization. Be the first to apply!