Engineering Manager, Inference
$425kMenlo Ventures
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About The Role Anthropic’s performance and scaling teams focus on making the most efficient and impactful use of our compute resources, be it inference or training. As an Engineering Manager on these teams you will be responsible for ensuring you and your team are identifying and removing bottlenecks, building robust and durable solutions, and maximizing the efficiency of our systems. You also will help bring clarity, focus, and context to your teams in a fast paced, dynamic environment. Responsibilities Provide front-line leadership of engineering efforts to improve model performance and scale our inference and training systems Become familiar with the team’s technical stack enough to make targeted contributions as an individual contributor Manage day-to-day execution of the team's work Prioritize the team’s work and manage projects in a highly dynamic, fast paced environment Coach and support your reports in understanding, and pursuing, their professional growth Maintain a deep understanding of the team's technical work and its implications for AI safety You May Be a Good Fit If You Have 1+ years of management experience in a technical environment, particularly performance or distributed systems Have a background in machine learning, AI, or a similar related technical field Are deeply interested in the potential transformative effects of advanced AI systems and are committed to ensuring their safe development Excel at building strong relationships with stakeholders at all levels Are a quick learner, capable of understanding and contributing to discussions on complex technical topics Have experience managing teams through periods of rapid growth and change Are a quick study: this team sits at the intersection of a large number of different complex technical systems that you’ll need to understand (at a high level of abstraction) to be effective Strong Candidates May Also Have Experience With High performance, large-scale ML systems GPU/Accelerator programming ML framework internals OS internals Language modeling with transformers Annual Salary $425,000—$560,000 USD Logistics Education requirements: We require at least a Bachelor's degree in a related field or equivalent experience. Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices. Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this. We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team. Your safety matters to us. To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit anthropic.com/careers directly for confirmed position openings. How We're Different: We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long‑term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest‑impact work at any given time. As such, we greatly value communication skills. The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT‑3, Circuit‑Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences. Come work with us! Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues. Guidance on Candidates' AI Usage: Learn about our policy for using AI in our application process. #J-18808-Ljbffr
- ...BaseTen Labs, Inc. seeks an Engineering Manager (Player & Coach) to lead a team focused on LLM inference workloads. You will mentor engineers, ensuring high-quality delivery and aligning project goals with company objectives. Applicants should have a strong background...SuggestedFlexible hours
- ...traditional 9-to-5. Opportunity Deepgram is looking for an Engineering Manager to lead the design and implementation of Deepgram’s internal... ...scaled databases Deep experience with machine learning training, inference, or both Benefits & Perks* Holistic health Medical, dental,...SuggestedHome officeFlexible hours
- ...THE ROLE As an Engineering Manager (Player & Coach), you will lead and mentor a team of Forward Deployed Engineers focused on building, scaling, and optimizing LLM inference workloads for Baseten customers. Applying both hands-on technical ownership and managerial leadership...SuggestedTemporary workFlexible hours
- ...Series A, led by Felicis. About the role Working directly with our founders, you'll lead a team of exceptional engineers building our platform for real-time inference at scale. This role is a unique opportunity to shape technical architecture and engineering culture at a...SuggestedWork at officeFlexible hours
- ...Are you passionate about leading talented engineering teams and solving real-world problems... ...insurtech startup looking for an Engineering Manager who’s ready to guide a high-impact team... ...interviewing at Eames Consulting by 2x Inferred from the description for this job...SuggestedFull timeRemote workFlexible hours
- ...run batch jobs, and serve low-latency inference. Companies like Suno, Lovable, and Substack... ...to production without the burden of managing infrastructure. We're a fast-growing team... ...olympiad medalists, and experienced engineering and product leaders with decades of experience...
- ...Highgate is a leading real estate investment and hospitality management company with over $15 billion of assets under management and... ...including king, queen, double/double and twin. Overview: The Engineering Manager is responsible for the day-to-day operations of the...Local areaImmediate startWorldwide
- ...Chalk in New York is looking for a Technical Lead Engineer to spearhead their innovative data platform. This role involves leading a talented engineering team to devise and implement the technical roadmap, ensuring the platform addresses real-world machine learning challenges...
- ...turning breakthrough research in low-latency large-language-model inference into purpose-built silicon. After proving the concept in... ...needs a hands-on executive to lead the charge. As VP Hardware Engineering, you will own the entire chip program from architecture to post...Remote workFlexible hours
- ...Anysphere in New York, NY is looking for a Software Engineer to join the Model Routing & Inference team. In this role, you will create the inference platform that drives AI interactions across the product. The ideal candidate will have extensive experience in building...
$176.17k - $251.67k
...Machine Learning Engineering Manager - LLM Serving (Remote - US) We are currently looking for a Machine Learning Engineering Manager - LLM... ...models, supporting batch, offline evaluation, and real‑time inference. Oversee the development and management of the Model Registry...Remote workFlexible hours- ...Engineering Excellence Manager ISS Facility Services — Building the Future of Engineering Operations At ISS Facility Services , we believe people make places. We are seeking a dynamic and operationally driven Engineering Excellence Manager to lead mission-...For contractorsFor subcontractor
- ...Hotel PMS Solutions Provider and landed on Deloitte’s Technology Fast 500 again in 2024 – but we’re just getting started. As an Engineering Manager at Cloudbeds, you will lead a remote team of Software Engineers to deliver frequent and high-impact value to our customers in...Work at officeLocal areaRemote workWork from homeHome officeWeekend work
$195k - $200k
...of relevant work experience. Demonstrated advanced experience with domain area programming language. Track record of being an Engineering Manager for product teams to drive the desired result from complex requirement What makes you stand out: Candidates should have...Full timeWork experience placementRemote workWork visaFlexible hours- ...meaningful virtual support to patients across an expansive array of specialties, in all 50 states. OpenLoop is looking for an Engineering Manager to join our team. The ideal candidate will have a strong technical background, proven leadership experience, and a passion...Flexible hours
- ...The company is backed by tier 1 venture firms and previous data company founders. WHAT WILL YOU WORK ON? We’re looking for an Engineering Manager to lead the core product engineering team. You’ll manage a small team of full-stack engineers while staying hands‑on with the...Remote work
- ...Canada, LATAM). What you'll do Lead a team building and scaling end-to-end production systems Set technical direction and raise the engineering bar Hire, develop, and retain exceptional talent Balance high standards with empathy - foster both speed and quality Own outcomes...ApprenticeshipLocal areaRemote work
$180.5k - $220k
...Direct message the job poster from Pulumi Senior Technical Recruiter at Pulumi Corporation We are looking for an Engineering Manager who is excited to bring Pulumi’s cloud programming model to the world. You will be part of realizing a vision where every developer can...Full timeLocal areaRemote workFlexible hours- ...will Deliver Moneytree Link solutions and integration projects, managing both internal and external resources. Document requirements,... ...overall quality. Qualifications 3+ years of experience in an Engineering Manager role using client & server mobile technology and/or APIs...Full timeRemote workOverseas
$230k - $270k
...with product, risk, legal, and data teams to deliver reliable and transparent margin experiences for millions of users! As an Engineering Manager , you will lead a team responsible for designing and operating critical margin infrastructure, including lending systems,...Work at officeFlexible hoursShift work$293k - $385k
...their jobs better and more efficiently. Our teams span product engineering, backend infrastructure, and safety, working together to... ...About the Role We are looking for an experienced engineering manager to lead our API Experience team. This team is responsible for...Work at officeWorldwideRelocation package- ...free with world‑class coaches who specialize in creativity, management, and more. Our operating principles — including negative maintenance... .... Hear from our employees directly on our Glassdoor page! Engineering Manager @ Clay As a Software Engineering Manager, you will...
$140k - $300k
...About Us Phare Health is now part of R1 and its AI innovation engine, R37 Lab, bringing Phare’s frontier clinical reasoning technology... ...years of experience hiring and leading teams as an engineering manager; with expertise in recruiting exceptional talent to build high-...Local area- ...Engineering Manager Are you a hands-on engineering leader who thrives on building high-performing teams? Do you get energized by turning product vision into predictable, high-quality delivery? Ready to shape engineering culture at a profitable, growing company where your...Full timeFor contractorsImmediate startRemote workFlexible hours
$241.5k - $284k
...innovate. We built and operate our own mortgage servicing business managing $110+ billion in loans to deeply understand the complexity... ...structured and programmable and positions us for the AI era. Engineering at Valon means powering a software ecosystem to disrupt the mortgage...Work at officeLocal areaRemote workFlexible hours- ...We are seeking an Engineering Manager who combines strong technical depth with hands-on development and people leadership. You will lead a cross-functional engineering team responsible for building and evolving critical platform capabilities within the Accommodations Management...Immediate start
$240k - $300k
...the tools, resources, and support you need to grow your career. Engineering Engineering at Brex is about building systems that scale with... ...aligned. Own the operational excellence of your team, managing sprint capacity, removing blockers, and ensuring high‑velocity...Work at officeRemote workWork from home3 days per week$180k - $230k
...deliver improved outcomes to our patients at a lower cost through early diagnosis and longitudinal care management of chronic conditions. We're looking for an Engineering Manager to join our team. Our managers take on a player/coach role, balancing technical leadership,...Work experience placementWork at officeRemote workWork from home- ...Labs has raised over $175M to drive the next generation of onchain innovation. Role and Responsibilities We’re looking for an Engineering Manager to lead our Platform Ecosystems team. In this high-impact role, you will lead the team responsible for providing a...Full timeWork experience placementRemote work
$200k - $240k
...growth phase and upcoming funding milestone. Base pay range $200,000.00/yr - $240,000.00/yr THE ROLE As Senior Director of Data Engineering, you will be the most senior data leader in the organization, owning the strategy, reliability, and scalability of the company’s...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Engineering Manager, Inference. Be the first to apply!



