Senior ML Systems Engineer (LLM Infra & AI Ops, Equity)
Trm-Labs
TRM Labs, an AI-powered intelligence company, seeks a Senior or Staff ML Systems Engineer – LLM to scale AI infrastructure and production-grade ML tooling. You will build modular stacks, embed models into real-time workflows, and evaluate state-of-the-art AI tools to ensure reliability and governance. You will lead automation, model versioning, and compliance across environments while collaborating with engineering and data science to accelerate delivery and impact. #J-18808-Ljbffr Trm-Labs
- Senior ML Systems Engineer, Frameworks & Tooling at Cohere Our mission... ...enterprises who are building AI systems to power... ...for large-scale LLM training. Design distributed... ...closely with infra teams to ensure Slurm... ...custom kernels/fused ops. Experience with multi...SeniorFull timeWork at officeRemote workFlexible hours
$200k
Founding DevOps / Systems / ML Ops Engineer - Physical AI Startup Location: San Francisco, CA (you could work from home up to 2x/week) The company’s... ...round closes, which would translate to more favorable equity, including founder shares which are stock grants rather...Employment EquityWork from home- A cutting-edge AI technology company based in San Francisco is seeking a specialist to... ...role requires expertise in deploying GPU systems for high-throughput inference and model performance... ...provided, along with competitive salary and equity packages. #J-18808-Ljbffr Reflection AIEmployment EquitySenior
- A leading AI technology company in San Francisco is looking for a Senior Software Engineer to build scalable infrastructure for large‑scale... ...design distributed training systems and optimize GPU utilization... ...over 5 years of experience in ML infrastructure and a strong background...Senior
$216.2k - $270.25k
...is seeking a Software Engineer to join their ML Infrastructure team... ...scalable serving of LLM workloads, work closely... ...experience in backend systems and proficiency in... ...salary range of $216,200—$270,250 USD, plus equity and comprehensive benefits. #J-18808-Ljbffr Scale AIEmployment EquitySenior$150k - $250k
Garuda Ventures is looking for a Senior Software Engineer (IC) to develop cloud and on-prem systems that will power future factories. In this role, you will design backend... ...salary range of $150,000—$250,000 USD along with equity and comprehensive benefits. #J-18808-Ljbffr...Employment EquitySenior- Arcadia is looking for a Senior Software Engineer (AI Agents) in San Francisco. In this pivotal role, you will build core systems for an intelligent automation platform used in operations... ...will include designing production-grade LLM systems, collaborating closely with the...Employment EquitySenior
$204k - $259k
...The Perception team builds the system which learns the spatial-... ...diverse set of sensors, enabling engineers like you to (1) develop methods... ...large-scale model development (LLM, VLM, or similar foundation... ...discretionary annual bonus program, equity incentive plan, and generous...Employment EquitySenior- At Dynamo AI, we believe that LLMs must be developed with safety,... ...world responsibility in mind. Our ML team comes from a culture of... ...research for their next generation of LLM products. Join us if you:... ...practices promote fairness, equity, and transparency for all candidates...Employment EquityLocal areaShift work
$298k - $368k
...The Perception team builds the system which learns the spatial-... ...diverse set of sensors, enabling engineers like you to (1) develop methods... ...hardware. You will Design VLM/LLM model architecture and drive... ...discretionary annual bonus program, equity incentive plan, and generous...Employment EquitySeniorFull timeRemote work$181.69k - $213.75k
...in venture capital, private equity and private credit. Trusted... ...of tomorrow. As a Senior Site Reliability Engineer, you’ll work to: Build and... ...alerting, and incident response systems. Collaborate with application... ...GraphQL API design principles. AI Fluency: You use AI tools...Employment EquitySeniorFull timeWork at office$135.2k - $306.4k
...Job Description The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level,... ...operating next-generation AI systems on Oracle Cloud... ...~ Deep understanding of LLM application patterns, including... ...May be eligible for bonus, equity, and compensation deferral...Employment EquitySeniorTemporary workFlexible hours- Google is looking for a Senior Software Engineer for its AI/ML division focused on YouTube. The ideal candidate will have a strong software development... ...position is $166,000-$244,000, complemented by bonuses and equity, reflecting Google’s competitive compensation for...Employment EquitySenior
$200k
Skyrocket Ventures seeks a founding DevOps / Systems / ML Ops Engineer in San Francisco, CA. Hybrid work from home up to 2x/... ...video pipeline operations. Salary up to $200k plus equity, in a small, fast-growing physical AI startup environment. You will spend roughly 50%...Employment EquityWork from home$200k - $280k
A leading voice AI startup is seeking a Founding Senior Machine Learning Engineer to fine-tune and deploy human-like voice agents,... ...,000 per year, with significant equity and benefits including full medical... ...-world experience in deploying ML models and work well in a fast-...Employment EquitySenior- An innovative AI company in San Francisco is seeking a Senior Machine Learning Engineer for Voice AI to optimize voice model inference and... ...will have over 5 years of ML engineering experience, strong... ...offers competitive compensation, equity, and the opportunity to be part...Employment EquitySenior
- A leading AI technology firm in New York seeks a Senior/Staff Machine Learning Engineer to design and deploy production-ready AI agents... ...lifecycle, develop reliable systems, and collaborate with cross-functional... ...competitive compensation, equity options, and comprehensive...Employment EquitySenior
- Acceler8 Talent in San Francisco is seeking a Senior Machine Learning Engineer to develop cutting-edge AI systems for interactive AI experiences. The role involves... ...offers a hybrid work model, competitive salary, equity, and a comprehensive benefits package. #J-18808...Employment EquitySenior
$300k
Harnham is looking for a Senior Machine Learning Engineer to join a well-funded startup... ...advanced machine learning systems for media generation, including... ...design, train, and deploy ML models, optimize generative... ...of up to $300,000 plus equity. #J-18808-Ljbffr HarnhamEmployment EquitySeniorRemote job- A tech startup focused on AI workloads is seeking a Member of Technical Staff to design and optimize inference systems. The role involves managing KV cache allocation... ...should have strong software engineering skills and experience with ML inference systems, particularly...Senior
- A leading AI research firm located in San Francisco is seeking a Senior ML Systems Engineer to build and maintain the training framework for large-scale language models. The role involves designing distributed training solutions and improving training throughput across...SeniorFlexible hours
- Mercor is seeking a PyTorch Expert to guide teams in enhancing AI model performance. This remote contract role requires 40 hours a week and involves working with MLOps and ML systems engineering tasks. The ideal candidate should have 2+ years of experience in ML infrastructure...SeniorRemote jobContract work
- Pinterest in San Francisco is seeking a Systems / Platform Engineer to join the tvScientific AI infrastructure team, focusing on sub‑millisecond decisioning, low... ...training/serving stack. You’ll work with SRE, data infra, and software engineering to harden the foundation and...Employment Equity
$170.11k - $237k
Anyscale is seeking experienced Software Engineers and Research Engineers to enhance its LLM offerings. The role involves... ...a strong focus on algorithms and system design. The target salary for the... ...$170,112 and $237,000, along with equity and comprehensive benefits including...Employment EquitySeniorFlexible hours$267k - $401k
...world‑class team of engineers and scientists who... ...machine learning and/or AI. Translate product... ...into scalable ML solutions with clear... .... Employ robust ML Ops practices: CI/CD, model... ...scale, distributed system design and AI/ML... ...to diversity, equity, and inclusion through...Employment EquitySeniorFull timeFlexible hours$270k - $310k
Zero RFI in San Francisco is seeking a Senior ML Engineer to lead the machine learning function,... ...will be responsible for architecting ML systems, mentoring engineers, and ensuring seamless... ...of $270,000 - $310,000 with equity and full benefits. #J-18808-Ljbffr Zero...Employment EquitySenior$180k - $240k
...one of its clients a Senior Machine Learning Engineer - this is a fully... ...plus benefits plus equity. Since 2017, we’ve... ...on a mission to use AI to resolve as many conversations... ...small but mighty ML team building... ...Python, and can ship LLM-powered systems that handle real,...Employment EquitySeniorRemote workFlexible hours- Waymo is seeking a Senior Machine Learning Infrastructure Engineer to lead the development of AI/ML infrastructure for advanced simulations. Candidates should have significant experience in software engineering and ML infrastructure, focusing on large models. This role...Senior
- DoorDash USA in San Francisco is searching for a senior engineer to lead the design and architecture of its Generative AI infrastructure. You will oversee the model... ...engineering, particularly in Python and distributed systems, along with technical leadership experience....SeniorFlexible hours
$200k - $260k
About The Role Together AI is building the best... ...We're looking for a Senior ML Engineer to drive the model serving... ...engines like TRT‑LLM and SGLang to optimize... ...and speech‑to‑speech systems. Collaborate with model... ...compensation, startup equity, health insurance and...Employment EquitySeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Systems Engineer (LLM Infra & AI Ops, Equity). Be the first to apply!
- graduate machine learning engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- data scientist machine learning engineer San Francisco, CA
- machine learning engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- machine learning software engineer San Francisco, CA
- senior ml engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- computer vision machine learning engineer San Francisco, CA
- ground systems engineer San Francisco, CA

