Software Engineer, ML Infra
$350kThinking Machines Lab
Software EngineerThe mission of Thinking Machines is to build AI that extends human will and judgment. We are training frontier models with Inkling, developing Tinker to let people make models their own, and crafting interfaces that broaden human-AI communication. We believe the future worth building is human, and we're hiring people who want to build it.We're hiring a Software Engineer to sit at the day-to-day interface between research and infrastructure. This is a generalist role with broad scope: you'll be one of the people always in the room for infra decisions on the ML systems side, with a clear enough view of upcoming compute needs to see support burden coming before it arrives.You'll also be one of the people who babysits hero runs — the ones at 2am when a 4k-GPU job hits a weird Xid and someone needs to decide, quickly and correctly, whether to drain the node, restart the job, or escalate to NVIDIA before the run loses checkpoints. That kind of judgment, built across the kernel, the network, the scheduler, and the application layer, is the core of the job.What You'll DoDebug across the full stack — kernel, NCCL, scheduler, application, and telemetry — often in the same afternoon, to find root causes that don't show up in any single layerProvide embedded, hands-on support during hero runs and major incidents, staying with a problem until it's genuinely resolvedServe as the front door for researchers when something's broken and it isn't obvious who owns itLead postmortems and build the tooling that prevents the next incident — acting as a force multiplier, not just a responderMentor other engineers into this kind of cross-stack breadthSkills & QualificationsMinimum QualificationsCredible, hands-on competence in 4 or more of the following: Linux kernel, networking, GPUs / CUDA, distributed systems runtimes, storage, compilers / language runtimes, observability internals — at this level, this required range is the qualifying signalComfort operating without a clearly defined owner, and the judgment to know when to dig in yourself versus when to escalatePreferred QualificationsTrack record of being the person other engineers escalate to, across 2+ companiesShipped meaningful contributions in 3+ distinct technical stacksTrack record of leading major incidents where the root cause was non-obviousResearcher-facing comfort: can talk to a researcher about their workload without making them feel dumb, and can tell them no when the right answer is noExperience operating at the scale of frontier training or inference clusters, and appetite for owning the hardest, least-defined problems in that stackLogisticsLocation: This role is based in San Francisco, CA.Compensation: Depending on background, skills and experience, the expected annual salary range for this position is $350,000 – $475,000 USD, plus equity.Visa sponsorship: We sponsor visas. While we can't guarantee success for every candidate or role, if you're the right fit, we're committed to working through the visa process together.Benefits: Thinking Machines offers generous health, dental, and vision benefits, unlimited PTO, paid parental leave, and relocation support as needed.
$202k
Senior Software Engineer - ML Infra About the Role & Team Engineering at Uber means building for real-world impact under real-world constraints. As a Senior Software Engineer (ML Data & Backend) , you will architect mission-critical systems that power the foundation of...SuggestedFull timeWork at officeRemote work$260k - $300k
...like to hear from you. About this role As a Staff Backend/Infra Engineer at Amigo, you'll build the core services behind our agent... ...low-latency system design Experience with production AI or ML systems Benefits (available to Full-Time Employees) Health...SuggestedFull timeFlexible hours$227.2k - $324.5k
About the Role:As a Staff Software Engineer on the ML Infrastructure team, you will collaborate closely with the Machine Learning and Product teams... ...& optimizing latency, cost, and efficiency of our infra. Lead large scale cross functional refactorings if necessaryMentor...SuggestedFull timeTemporary workLocal areaFlexible hours$350k
...when infrastructure problems have unclear ownership. Lead postmortems and build tooling to prevent recurring incidents. Mentor engineers in cross-stack infrastructure debugging and operations. Requirements Demonstrated hands-on competence in at least four of...SuggestedFull timeVisa sponsorshipRelocation package- Dynamo AI is looking for a Senior Software Engineer to design, develop, and maintain secure and scalable infrastructure and applications. This role involves deploying advanced machine learning models in diverse environments while applying industry best practices. The ideal...Suggested
- ...Catasta, etc. Responsibilities: Scale infra for post-training of multimodal LLMs (CPT... ...generalist web‑agent Work closely with product engineers to translate cutting‑edge AI capabilities... ...What we’re looking for: Experience with ML infrastructure (GPU clusters) and...Work at officeRelocationVisa sponsorship
- We're looking for a Senior Backend Engineer to own the services and APIs that power the data... ...petabyte scale. Partner with the platform and infra teams on scalability, reliability, and the... ...systems (Kafka, Spark, Flink, Ray) and ML orchestration tools (Airflow, Dagster, Prefect...
$150k - $200k
...away the busy work, we care deeply about giving our customers more time for their life’s work.About the Role:As a Software Engineer on Collections Infra, you’ll help scale the infrastructure behind Notion’s database block. Databases power views, boards, charts, forms,...Local area- Foundry Robotics is hiring a Senior Software Engineer (IC) to build the backend systems and infrastructure powering the factory of the future. You will design and implement cloud-based backend systems, on‑prem factory services, and data flows across embedded to cloud environments...
- Handshake is seeking a Senior Software Engineer for its Coding Pod in San Francisco. You will lead the design and development of data infrastructure powering frontier AI coding models, bridging ML research and production systems. You'll own end-to-end platform investments...
- ...Software EngineerCodeRabbit is an innovative research and development... ...significantly outperforms individual engineers. We combine language models... ...alongside AI researchers, infra specialists, frontend engineers... ...systemsCollaborate with ML engineers to integrate models...
$117.2k - $313.7k
...of Salesforce.Salesforce has immediate opportunities for Lead software engineers who want their lines of code to have significant and measurable... ....Preferred Skills: Design patterns & Experience with Big-Data/ML and S3 Hands-on experience with Streaming technologies like...Full timeImmediate startRemote work$230k - $390k
...for Google Workspace. What you’ll doAs a Software Engineer, Infrastructure at Sierra, you will be... ...distributed databases, retrieval systems, and ML models.Develop and maintain core data... ...-paced startup environment or platform/infra-focused team.Our valuesTrust: We build...Full timeFlexible hours- ...measurement, and operation of AI & ML experiences.Our tools are... ...complications.As a Senior ML System Engineer on the AI & ML Platform team,... ...that empowers all Atlassian software engineers, ML engineers, and... ...Machine Learning and AI infra/platform/systemComprehensive ML...
- ...Software EngineerAt OpenAI, we're dedicated to advancing artificial intelligence, and we... ...mission. That's why we're seeking a software engineer to help us build out our trust and... ...models, or are excited to learn about modern ML infra.Our tech stack includes:Terraform,...
- ...Software EngineerVoxel's perception system is the technical core of everything we ship... ...team.We're hiring a strong software engineer to own the ML Infrastructure that powers how Voxel trains... ...quickly and safely.Understand the infra needs of applied ML/CV engineers and design...Work at officeFlexible hours
$75k - $100k
...Emergent, we’re reimagining how software gets built. Our vision is to... ...breakthroughs in AI, systems engineering, and product design. Our team... ...with distributed systems, cloud infra, and high-performance services... ...compilers, developer tools, or ML systems Even if you don’t meet...Full timeWorldwide- ...with construction veterans and world-class engineers to solve physical-world problems that... ...with a full stack team (from Frontend, to ML and Robotics) to design technical solutions... ...interfaces)Experience dealing with infra at the edge: low latency SLAs in dynamic...Work at officeFlexible hours
- ...applied AI lab building a search engine unlike the world has ever seen. We build massive-scale infra to crawl the entire web, train... ...want to build massive-scale ML systems that will define the way... ...scales for our agent fleetAutomate software maintenance and improvements...H1b
- LanceDB Inc. is seeking a Senior Solutions Engineer to blend AI/ML infrastructure expertise with strong communication skills, serving as a trusted advisor to customers and partners. You will bridge cutting-edge AI engineering with real-world business use cases in production...
- Simula is seeking a Founding Engineer to blend backend, ML, and traditional system design in a fast-moving startup environment in San Francisco, CA. You will be one of the earliest engineers shaping the engineering culture and building core infrastructure as the company...
$150k
Tzafon is seeking a skilled engineer to enhance their machine intelligence systems in San Francisco. As part of the team, you'll be responsible... ...machine learning frameworks, a solid track record of shipping ML systems, and strong opinions on evaluation methodologies. The...$266k
...just a few pods away. We iterate fast, and engineer for reliable long-term impact. We're... ...About the RoleWe’re looking for a Backend Software Engineer to help architect and scale the... ...that evolve over timeCuriosity about AI/ML and excitement to work alongside world-class...InternshipWork at officeLocal areaFlexible hours$140k - $260k
Substack is building a new economic engine for culture, giving the brightest, most interesting... ...learn.Requirements:At least 7+ years of software engineering experience.Independent and... ...for writing.Experience working with ML technology would be beneficial.Experience...Full time$180k - $220k
...and get work done in the AI era. We’re looking for a backend engineer to join our small team and help lead the effort to prepare the product... ...RESTful and GraphQL APIs, with emphasis on integrating AI/ML inference endpoints and ensuring predictable SLAs ~ Familiarity...Work at officeLocal areaImmediate startFlexible hours$57 - $61 per hour
Join to apply for the Software Engineer, AI Safety, Mid-Level role at Jobright.ai 2 days ago Be among the first 25 applicants Join to apply... ...learning models, or are excited to learn about modern ML infra. Preferred: • Our infrastructure is built on Terraform, Kubernetes...Full timeSummer workInternshipH1b$179.8k - $258.5k
Senior Software Engineer - Identity SecurityEnterprises are undergoing two simultaneous transformations: moving critical infrastructure to the... ...security productsFamiliarity with machine learning systems or ML-adjacent infrastructureExposure to AWS, Kafka, containerized services...Work at office- Founding Engineer, Backend & Infrastructure About Backbone Care should be paid for the moment... ...BS/MS in Math & CS from Stanford and led ML infrastructure at Sequoia-backed Kumo AI,... ...systems that navigate complex medical software and payer portals Design reliable systems...
- NomadicML is seeking a Backend / Infrastructure Engineer who thrives at the intersection of cloud systems, SDK design, and large-scale inference... ...to distributed GPU inference pipelines—collaborating with ML researchers to productionize their models and expose...Worldwide
$122k - $240.5k
...on 12/31/2026.The Team:Deloitte’s Cyber Engineering is a new team that is spearheading the buildout... ...below:Hands-on experience in full stack software development across frontend and backend... ...customization.Basic understanding of AI/ML frameworks such as TensorFlow or PyTorch....Local area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer, ML Infra. Be the first to apply!
- cybersecurity software engineer San Francisco, CA
- graduate software engineer San Francisco, CA
- software developer fintech San Francisco, CA
- new graduate software engineer San Francisco, CA
- senior robotics software engineer San Francisco, CA
- software engineer visa sponsorship San Francisco, CA
- software qa engineer San Francisco, CA
- network software engineer San Francisco, CA
- software engineer remote San Francisco, CA
- part time software developer San Francisco, CA



