Software Engineer: ML Optimization
The Generalist
About the Role
We internally call this team MBMB (More Big More Better). You will own optimizations on both the training and on-robot inference stacks. We are still in a regime of step-function, not incremental, gains.
You’ll be responsible for:
Making GPUs go brrrrr
Implementing ML, hardware, and software changes that lead to step-function gains
Optimizing both the inference and training stacks
You might thrive in this role if you:
Are proficient and stay current with the latest ML techniques for training and inference optimizations in transformer and diffusion based architectures
Will chase ML optimizations anywhere: From the CUDA kernels, to ML architecture, to frontend or backend network bottlenecks, CPU bottlenecks, NVLink and comms, to torch, numpy, and Python inefficiencies.
About Generalist
At Generalist, we are on a mission to make general-purpose robots a reality. We believe the industries and homes of the future will depend on humans and machines working together in new ways. Robots can help us build more and get more done.
We build embodied foundation models, starting with a focus on dexterity. This requires advancing the frontiers of data, models, and hardware, to enable robots to intelligently interact with the physical world.
The company embraces both large-scale AI and robotics as core to its DNA. Our team of researchers, roboticists, and company builders come from OpenAI, Boston Dynamics, Google DeepMind, and other frontier labs—with a track record of shipping AI breakthroughs. Before Generalist, we pioneered large embodied multimodal models and vision-language-action models (PaLM-E, RT-2 , Gemini Robotics ), launched and scaled ChatGPT and GPT-4 to hundreds of millions of users, engineered the foundations of autonomous driving, built next-generation robots ( Atlas , Spot , Stretch ) and pushed the limits of what they can do (from parkour to manipulation , and testing robustness ).
We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.
- ...with hands-on support from AMD engineers the team is scaling rapidly to... ...learn how large AI models are optimized and deployed at scale, and collaborate closely with ML researchers and experienced systems... ...experience) ~3+ years of software engineering experience, with a...SuggestedFull timeWork at officeFlexible hours
- ...Minerals Mariana Minerals is a software-first, vertically integrated... ...Senior Full Stack Software Engineer to lead critical technical initiatives... ...collaboration with ML engineers to integrate LLMs for... ...reliability and performance optimization for critical systems. What...SuggestedFull time
$202k - $237k
...computing and make it accessible to software developers of all skill levels... ...data scientist can scale an ML application from their laptop... ...seeking a Backend Software Engineer to join our team focused on building... ...enhance user experience and optimize workflows. Compensation...SuggestedFull timeWork at officeFlexible hours$120k - $180k
...team is tackling cutting-edge engineering challenges to bring... ...are looking for a full-stack software enginee r to turn whiteboard... ...iterations. Collaborate daily with ML, hardware, and industrial... ...high-quality results; debug, optimize performance, and ensure reliability...SuggestedFull timeVisa sponsorship$300k - $320k
...group of committed researchers, engineers, policy experts, and business... ...is looking for backend software engineers to work across our... ...inference and safeguards to optimize the full stack. API Capabilities... ..., SSO, RBAC) Exposure to ML/AI systems or an understanding...SuggestedFull timeWork at officeVisa sponsorshipFlexible hours$230k - $385k
...pods away. We iterate fast, and engineer for reliable long-term impact... ...’re looking for a Backend Software Engineer to help architect and... ...transforming it into formats optimized for use by downstream systems... ...over timeCuriosity about AI/ML and excitement to work alongside...InternshipWork at officeLocal areaFlexible hours$126k
...organization. About the team: The ML Data Engineering team powers metadata extraction,... ...Role Overview: We’re seeking a Software Engineer II with deep experience building... ...Python. In this role, you’ll design and optimize large-scale data and service pipelines...Full timeLocal areaWorldwideHome officeFlexible hours- ..., will be as an Infrastructure / Backend Engineer on our founding team. You're the right... ...powered agents in production Deploying and optimizing AI-heavy services with high availability... ...Experience deploying and productionizing ML or AI-heavy workloads Expertise in...Full time
$180k - $220k
...the AI era. We’re looking for a backend engineer to join our small team and help lead the... ..., performance, and innovation around optimal team communication. Who you are An... ...GraphQL APIs, with emphasis on integrating AI/ML inference endpoints and ensuring...Work at officeLocal areaImmediate startFlexible hours- ...About Flow Flow Engineering is an AI-native requirements platform for... ...is seeking AI-focused senior software engineers to build AI-powered... ...models and related tooling, optimizing for reliability, latency, cost... ...years of experience in applied ML, LLMs, or adjacent fields,...Full timeFlexible hours
- ...are looking to recruit an exceptional Software Engineer - Software Development and Machine Learning... ...and deployment. Monitor and optimize system performance, availability, and security... ...practices and compliance standards in AI/ML environments. Proficiency in database...Full time
- ...Kernels team at OpenAI builds the low-level software that accelerates our most ambitious AI... ...performance kernels, distributed system optimizations, and runtime improvements to make large-... ...compiler-focused role, rather bridging ML algorithms with system performance -...Full time
$156k - $195k
...and private evaluations. About Data Engine Our Generative AI Data Engine... ...assessments, and incentives - partnering with ML teams to optimize how contributors are evaluated and... ...Requirements: ~3+ years of relevant software engineering experience ~ Track...Full timeShift work- ...Conviction. Join us and help build the platform engineers turn to to ship AI products. THE... ...that powers modern AI workloads, optimizing every microsecond of computation to enable... ...implement high-performance GPU kernels for key ML operations, including matrix...Full timeFlexible hours
- ...or as self-hosted and on-premises software, with unmatched accuracy, low... ...Opportunity: We are seeking a Software Engineer to join Deepgram for Restaurants... ...of our backend with our ML models and client devices Monitor and optimize the performance of our backend systems...Full timeHome officeFlexible hours
- ...Tech Lead to drive the design, optimization, and scaling of our inference... .... In this role, you’ll lead engineering efforts to ensure our largest... ...layer of large-scale ML infrastructure. Understand the... ...performance issues across hardware and software layers. Have strong...Full time
$325k
...group of committed researchers, engineers, policy experts, and business... ...for reliability-minded software engineers and SREs. Are curious... ...experience with one or more ML hardware accelerators (GPUs,... ...Understand ML-specific networking optimizations like RDMA and InfiniBand....Full timeWork at officeVisa sponsorshipFlexible hours$220k - $247.5k
...games. We are looking for a Senior Machine Learning Engineer to join our Revenue ML team at Discord. This role sits at the intersection of Discord... ...targeting, audience segmentation, and campaign optimization. Familiarity with loyalty, rewards, or incentive pro...Full timeSeasonal work$320k
...group of committed researchers, engineers, policy experts, and business... ...and unattended. As a Software Engineer on the Launch Engineering... ...is a resource-constrained optimization problem at its core: validation... ...Have Experience with ML inference or training...Full timeWork at officeVisa sponsorshipFlexible hoursShift work- ...functional group working across engineering, product, research, and... ...re looking for an experienced Software Engineer to build measurement... ...high-quality labels for ads optimization. We are hiring engineers who... ...closely with Ads Delivery, Ads ML, Product, Research, Privacy,...Full timeRelocation package
- ...agent assistance, and AI-powered workforce management that optimizes both human and AI capacity, Assembled helps teams deliver... ...iteration. About you (specifically) Familiarity with ML packages and software: Experience using Python libraries like pandas, SciPy,...Full time
- ...a highly motivated and bright engineer to join our team and devise elegant... ...systems to support Voxel's ML development. As a part of the... ...solving problems across the software stack. We require engineers to... ...retail spaces. Implement and optimize computer vision techniques for...Full timeWork at officeFlexible hours
- ..., AI scientists, PhDs, creatives, technologists, and engineers working together to empower people and make care make... ...reasoning, and structured outputs. Collaborate with ML and infra engineers to scale and optimize GenAI workflows , managing latency, context windows,...Hourly payFull timeWork at officeRelocation packageFlexible hours
- ...responsible for the architectural and engineering backbone of OpenAI’s... ...models. Our work spans system software, networking, platform... ...monitoring, and performance optimization. About the Role We’re hiring... ...~5+ years in one or more of: ML systems, performance engineering...Full time
$320k - $405k
...group of committed researchers, engineers, policy experts, and business... ...to macOS and Windows Optimize application performance, memory... ...5+ years of experience as a software engineer, with strong emphasis... ...integrating and working with AI/ML models and understanding...Full timeWork at officeVisa sponsorshipFlexible hours$136k - $160.5k
...About the Role: We are seeking a Software Engineer, Control Plane to help build and scale... ...systems that manage our global fleet of AI-optimized compute, network, and storage resources... ...differentiated cloud solutions for AI/ML customers. Operational Excellence:...Full timeTemporary workImmediate start- ...work sits at the intersection of production ML systems, developer platforms, model... ...the Role We’re looking for a backend engineer who can quickly understand OpenAI’s models... ...runtime abstractions for a stateful, cloud-optimized agentic platform. Partner closely with...Full timeInternship
- ...reliable, and unblocked. You will work across engineering and infrastructure problems as they... ...with experience in some layer of ML infrastructure. - Have worked on RL, inference... ...stacks. - Background in performance optimization, scaling, or production-critical infrastructure...Full time
- ...We are a small, fast-growing team of engineers in San Francisco powering Fortune 100 enterprises... ...with smart batching and caching Optimize kernels, tokenization, and model graphs... ...~3+ years in performance engineering or ML systems ~ Strong Python, plus C++ or CUDA...Full timeWork at officeVisa sponsorshipRelocation package
- ...a small, fast-moving team of engineers focused on delivering a world... ...Role We’re looking for a software engineer to help us serve OpenAI... .... You'll build and optimize the systems that let users generate... ...Have worked with GPU-based ML workloads and understand the...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer: ML Optimization. Be the first to apply!
- agile software developer San Francisco, CA
- software developer internship no experience San Francisco, CA
- intermediate software engineer San Francisco, CA
- software engineer staff San Francisco, CA
- experienced software developer San Francisco, CA
- work from home software developer San Francisco, CA
- software developer no experience San Francisco, CA
- software developer fintech San Francisco, CA
- software data engineer San Francisco, CA
- financial software developer San Francisco, CA


