Engineering Manager, AI Inference Scale LLMs with Equity
Pantera Capital
A leading investment firm in San Francisco seeks an Inference Engineering Manager to lead its AI inference team. The ideal candidate will have over 5 years of engineering experience, including 2+ years in a leadership capacity, and deep expertise in ML systems, particularly with inference frameworks like PyTorch and TensorFlow. This role involves architecting and scaling reliable inference infrastructure and developing APIs to support internal and external customers. A competitive compensation package is offered, including equity. #J-18808-Ljbffr
Vacancy posted 5 hours ago
Similar jobs that could be interesting for youBased on the Engineering Manager, AI Inference Scale LLMs with Equity in San Francisco, CA vacancy
$300k - $385k
...Full time Department AI Compensation $300K – $385K • Offers Equity U.S. Benefits Full-time... ...We are looking for an Inference Engineering Manager to lead our AI Inference... ...to build and scale the infrastructure that... ...serving millions of users with state-of-the-art AI capabilities...Employment EquityFull timeLocal areaPantera Capital
San Francisco, CA1 day ago- ...AI Chopping Block, Inc. is seeking an Engineering Manager to lead and grow its Model Inference team in San Francisco. This pivotal role involves architecting high-performance inference systems and collaborating with various teams to impact healthcare delivery. Ideal candidates...Suggested
AI Chopping Block, Inc.
San Francisco, CA5 hours ago $300k - $430k
...leading conversational AI platform... ...Index Ventures, along with many others. We’re... ...routing layer that manages inference across multiple providers... ...ML Infrastructure Engineer to own the... ...post-training at scale Implement and integrate... ...– $430K + Offers Equity #J-18808-Ljbffr...Employment EquityWork at officeDecagon
San Francisco, CA5 hours ago$240k - $280k
...Runway Financial is seeking a leader for our engineering team during a critical growth phase. In this role, you'll build a high-performing... .... This position offers a competitive salary in the range of $240,000 - $280,000 plus equity and benefits. #J-18808-Ljbffr...Employment EquityRunway Financial
San Francisco, CA5 hours ago$260.1k - $360k
...integrates directly with business data,... ...governance. AI is redefining... ..., and platform engineering. While some of... ...problems involve LLMs and AI evaluation... ...leading and managing engineering teams... ...performance at scale Strong... ...the form(s) of equity and/or commission...Employment EquityRetool
San Francisco, CA5 hours ago- ...Infrastructure and Platform Engineer. In this role, you will... ...the architecture and scaling of our GPU compute... ...availability and low-latency inference. This is a founding... ...infrastructure stack, with promising growth and significant... ...competitive salary and equity, along with full health...Employment Equity
U-Run
San Francisco, CA4 hours ago $425k
...and steerable AI systems. We want... ...committed researchers, engineers, policy experts... ...and scaling teams focus on... ...resources, be it inference or training. As... ...an Engineering Manager on these teams... ...Become familiar with the team’s technical... ..., optional equity donation matching...Employment EquityContract workFor contractorsFor subcontractorWork at officeRelocationVisa sponsorshipWork visaFlexible hoursMenlo Ventures
San Francisco, CA5 hours ago$250k
...looking for a talented ML/AI Research Engineer to join their San... ...responsible for designing and managing the infrastructure... ...governance of large-scale AI systems. The ideal... ...cloud infrastructure, with a minimum of 4 years experience... ...$250k along with equity opportunities. #J-1880...Employment EquityAlldus International Consulting Ltd
San Francisco, CA5 hours ago$270k - $350k
...Scientist for their AI Scaling team in San Francisco... ...post-training inference. Responsibilities include... ..., and collaborating with product and engineering teams. Ideal applicants... ...in generative AI, LLMs, and demonstrated... ...000 USD, along with equity and benefits. #J-188...Employment EquityMenlo Ventures
San Francisco, CA5 hours ago$264k - $300k
...About The Role AI Teammates are agents... ...as your team works with them. Currently live... ...for a Senior Engineering Manager to lead the AI Teammates... ...rolling out new LLMs), proactive and... ...Experience building and scaling platform teams... ...conduct a yearly pay equity audit. For this...Employment EquityWork at officeWork from homeWorldwideShift workDecisive Point
San Francisco, CA1 day ago- ...Role Our generative AI-powered products... ...medicine—and the inference systems that power... ...re looking for an Engineering Manager to lead and grow our... ..., partner closely with ML Research and... ...focused on building and scaling infrastructure for... ...Compensation and Equity : Competitive...Employment EquityHourly payFull timeFlexible hours
AI Chopping Block, Inc.
San Francisco, CA1 day ago $405k
...and steerable AI systems. We want... ...committed researchers, engineers, policy experts... ...shed. The Inference Routing team... ...warehouse-scale computer running... ...shoulder-to-shoulder with teams that... ...of engineering management experience, ideally... ..., optional equity donation matching...Employment EquityWork at officeVisa sponsorshipFlexible hoursShift workAnthropic
San Francisco, CA4 days ago$240k - $320k
...Francisco is seeking a Principal Software Engineer to develop an innovative voice... ...designing crucial features, handling LLM inference at scale, and personalizing speech models. The ideal... ...in Typescript, React, and Python, along with a user-focused design intuition. Enjoy...Menlo Ventures
San Francisco, CA4 hours ago$190k - $270k
...AI Chopping Block, Inc. in San Francisco is looking for an AI Infrastructure Engineer to ensure the highest quality service and keep production... ...field, and expertise with Ansible, Terraform, and Kubernetes... ...90,000 to $270,000, startup equity, and health insurance, contributing...Employment EquityAI Chopping Block, Inc.
San Francisco, CA6 hours ago$405k
...Engineering Manager - Privacy Infrastructure San Francisco... ..., and steerable AI systems. We want... ...This is a role with extraordinary scope... ...for AI training and inference, foundational data... .... Your job is to scale the team and its charter... ..., optional equity donation matching,...Employment EquityWork at officeVisa sponsorshipFlexible hoursAnthropic
San Francisco, CA2 days ago$170k - $220k
...Infrastructure & LLMs Location: San... ...00 base + 1–3% equity Work Authorization... ...strong engineer to join a lean,... ...next-generation inference infrastructure... ...problems like: Scaling multi-GPU inference... ...Experimenting with LLM distillation... ...orchestration, or AI infra Strong...Employment EquityFull timeTemporary workImmediate startVisa sponsorshipWork visaAmadeus Search
San Francisco, CA1 day ago- ...A leading AI advancement firm in San Francisco is looking for an Engineering Manager to drive the development of systems critical to their... ...environment, balancing speed with quality and directly impacting... ...benefits package, including equity ownership and relocation support...Employment EquityRelocation package
Mercor Inc
San Francisco, CA1 day ago $405k
...and steerable AI systems. We want... ...committed researchers, engineers, policy experts... ...front of every inference call Anthropic... ...continues to scale, the efficiency... ..., connection management), rate limiting... ...deeply with Inference, Compute... ...benefits, optional equity donation...Employment EquityTemporary workWork at officeVisa sponsorshipFlexible hoursAnthropic
San Francisco, CA3 days ago$144k - $165k
...vertically integrated AI infrastructure... ...re solving that — with an energy-first approach... ...believe in the scale of our ambition... ...Customer Support Engineering Manager, you'll play a crucial... ...Generative AI and LLMs, Generative AI... ...compensation and equity packages Restricted...Employment EquityFull timeTemporary workEpoch Biodesign
San Francisco, CA4 hours ago- ...mission‑critical inference for the world... ...most dynamic AI companies,... ...the platform engineers turn to to... ...partner closely with Sales and... ...adopt AI at scale, and who enjoy... ...modalities – LLMs, embeddings,... ...” or project manager for POCs. Pulling... ...including meaningful equity. 100%...Employment EquityFlexible hours
BaseTen
San Francisco, CA5 hours ago $248k - $279k
...gaming platform in San Francisco is seeking an Engineering Manager excited to build data infrastructure at scale. You will lead teams that process petabytes... ...ranging from $248,000 to $279,000 plus equity and benefits, with potential relocation assistance for those willing...Employment EquityRelocation package- ...San Francisco seeks a Senior Engineering Manager to lead and scale an engineering team working on an innovative AI product. You will define the... ...vision, work closely with product leaders, and ensure... ...offers a competitive salary and equity in a fast-growing startup. #J...Employment Equity
scribehow.com
San Francisco, CA5 hours ago $160k - $250k
...Senior Backend Engineer, Inference Platform San... ...Role Together AI is building the... ...the latest LLMs, multimodal models... ...models at scale. If you get... ...work hands-on with tens of thousands... ...compensation, equity, and benefits.... ...threading, memory management, networking, and...Employment EquityFull timeLocal areaTogether AI
San Francisco, CA3 days ago$230k - $350k
...is the modern AI platform for marketing... ...strategies with... ...of advances in LLMs and agentic AI... ...looking for an engineering leader to lead... ...strong incident management hygiene.People... ...training and inference at scale for large enterprise... ...offer meaningful equity compensation...Employment EquityRemote workHigh Touch LLC
San Francisco, CA1 day ago$216.2k - $270.25k
...shaping the future of AI at Scale. At Scale AI,... ...vehicles. With our recent Series... ...evaluations. About Data Engine Our Generative... ...’s most advanced LLMs and generative models... ...developers to manage agent lifecycles.... ...include base salary, equity, and benefits. The...Employment EquityFull timeFlexible hoursScale AI
San Francisco, CA5 hours ago- ...was founded in 2018 with the mission of... ...in healthcare. Our AI-powered platform was... ...technologists, and engineers working together to... ...teams are in hyper‑scale mode, growing rapidly... ...for an engineering manager to drive improvements... .... Compensation and Equity : Competitive...Employment EquityHourly payFull timeLocal areaFlexible hours
Abridge AI
San Francisco, CA5 hours ago - ...A leading AI acceleration company in San Francisco is seeking a GPU Kernel Engineer to optimize performance for machine learning models. You will be responsible for designing... ...offers competitive compensation, including equity, and comprehensive benefits including medical...Employment Equity
BaseTen
San Francisco, CA5 hours ago $216k - $270k
...Compensation $216,000 - $270,000 USD + equity Posted April 13, 2026 Visa Sponsorship... ...Not mentioned Required Skills Applied AI Machine Learning LLMs About the Role Staff-level applied AI engineer building AI-powered products at Scale. Apply for this Position #J-18808-...Employment EquityRelocationVisa sponsorshipRepovive, Inc.
San Francisco, CA5 hours ago$320k
...Sr. Software Engineer, Cloud Inference San Francisco... ...and steerable AI systems. We... ...Inference team scales and optimizes... ...execution, capacity management, and day-to-... ...providers with different hardware... ...ensure our LLMs meet rigorous... ...benefits, optional equity donation...Employment EquityWork at officeVisa sponsorshipFlexible hoursAnthropic
San Francisco, CA2 days ago$190.9k - $232.8k
...staff software engineer for GenAI inference, you will lead... ..., and robust scaling. Your work will... ...integration with frameworks and... ...for large-scale LLMs inference... ...scheduling, memory management, and dynamic... ...performance bonus, equity, and the... ...the data and AI company. More...Employment EquityLocal areaWorldwideDatabricks
San Francisco, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Engineering Manager, AI Inference Scale LLMs with Equity. Be the first to apply!
Related searches
- private equity associate San Francisco, CA
- private equity intern San Francisco, CA
- private equity accountant San Francisco, CA
- equity sales San Francisco, CA
- equity fund manager San Francisco, CA
- equity research associate San Francisco, CA
- equity portfolio manager San Francisco, CA
- equity specialist San Francisco, CA
- investment intern (private equity) San Francisco, CA
- hedge fund private equity tax manager San Francisco, CA