Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Engineering Manager, Inference

$425k

Menlo Ventures

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About The Role Anthropic’s performance and scaling teams focus on making the most efficient and impactful use of our compute resources, be it inference or training. As an Engineering Manager on these teams you will be responsible for ensuring you and your team are identifying and removing bottlenecks, building robust and durable solutions, and maximizing the efficiency of our systems. You also will help bring clarity, focus, and context to your teams in a fast paced, dynamic environment. Responsibilities Provide front-line leadership of engineering efforts to improve model performance and scale our inference and training systems Become familiar with the team’s technical stack enough to make targeted contributions as an individual contributor Manage day-to-day execution of the team's work Prioritize the team’s work and manage projects in a highly dynamic, fast paced environment Coach and support your reports in understanding, and pursuing, their professional growth Maintain a deep understanding of the team's technical work and its implications for AI safety You May Be a Good Fit If You Have 1+ years of management experience in a technical environment, particularly performance or distributed systems Have a background in machine learning, AI, or a similar related technical field Are deeply interested in the potential transformative effects of advanced AI systems and are committed to ensuring their safe development Excel at building strong relationships with stakeholders at all levels Are a quick learner, capable of understanding and contributing to discussions on complex technical topics Have experience managing teams through periods of rapid growth and change Are a quick study: this team sits at the intersection of a large number of different complex technical systems that you’ll need to understand (at a high level of abstraction) to be effective Strong Candidates May Also Have Experience With High performance, large-scale ML systems GPU/Accelerator programming ML framework internals OS internals Language modeling with transformers Annual Salary $425,000—$560,000 USD Logistics Education requirements: We require at least a Bachelor's degree in a related field or equivalent experience. Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices. Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this. We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team. Your safety matters to us. To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit anthropic.com/careers directly for confirmed position openings. How We're Different: We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long‑term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest‑impact work at any given time. As such, we greatly value communication skills. The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT‑3, Circuit‑Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences. Come work with us! Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues. Guidance on Candidates' AI Usage: Learn about our policy for using AI in our application process. #J-18808-Ljbffr

Vacancy posted 20 hours ago
Similar jobs that could be interesting for youBased on the Engineering Manager, Inference in New York, NY vacancy
  •  ...BaseTen Labs, Inc. seeks an Engineering Manager (Player & Coach) to lead a team focused on LLM inference workloads. You will mentor engineers, ensuring high-quality delivery and aligning project goals with company objectives. Applicants should have a strong background... 
    Suggested
    Flexible hours

    BaseTen Labs, Inc.

    New York, NY
    21 hours ago
  •  ...traditional 9-to-5. Opportunity Deepgram is looking for an Engineering Manager to lead the design and implementation of Deepgram’s internal...  ...scaled databases Deep experience with machine learning training, inference, or both Benefits & Perks* Holistic health Medical, dental,... 
    Suggested
    Home office
    Flexible hours

    Deepgram

    New York, NY
    4 days ago
  •  ...THE ROLE As an Engineering Manager (Player & Coach), you will lead and mentor a team of Forward Deployed Engineers focused on building, scaling, and optimizing LLM inference workloads for Baseten customers. Applying both hands-on technical ownership and managerial leadership... 
    Suggested
    Temporary work
    Flexible hours

    BaseTen Labs, Inc.

    New York, NY
    20 hours ago
  •  ...Series A, led by Felicis. About the role Working directly with our founders, you'll lead a team of exceptional engineers building our platform for real-time inference at scale. This role is a unique opportunity to shape technical architecture and engineering culture at a... 
    Suggested
    Work at office
    Flexible hours

    CHALK INC

    New York, NY
    20 hours ago
  •  ...Are you passionate about leading talented engineering teams and solving real-world problems...  ...insurtech startup looking for an Engineering Manager who’s ready to guide a high-impact team...  ...interviewing at Eames Consulting by 2x Inferred from the description for this job... 
    Suggested
    Full time
    Remote work
    Flexible hours

    EAMES CONSULTING, LLC

    New York, NY
    4 days ago
  •  ...run batch jobs, and serve low-latency inference. Companies like Suno, Lovable, and Substack...  ...to production without the burden of managing infrastructure. We're a fast-growing team...  ...olympiad medalists, and experienced engineering and product leaders with decades of experience... 

    Modal

    New York, NY
    21 hours ago
  •  ...Highgate is a leading real estate investment and hospitality management company with over $15 billion of assets under management and...  ...including king, queen, double/double and twin. Overview: The Engineering Manager is responsible for the day-to-day operations of the... 
    Local area
    Immediate start
    Worldwide

    ROW NYC

    New York, NY
    20 hours ago
  •  ...Chalk in New York is looking for a Technical Lead Engineer to spearhead their innovative data platform. This role involves leading a talented engineering team to devise and implement the technical roadmap, ensuring the platform addresses real-world machine learning challenges... 

    CHALK INC

    New York, NY
    21 hours ago
  •  ...turning breakthrough research in low-latency large-language-model inference into purpose-built silicon. After proving the concept in...  ...needs a hands-on executive to lead the charge. As VP Hardware Engineering, you will own the entire chip program from architecture to post... 
    Remote work
    Flexible hours

    Blue Signal Search

    New York, NY
    1 day ago
  •  ...Anysphere in New York, NY is looking for a Software Engineer to join the Model Routing & Inference team. In this role, you will create the inference platform that drives AI interactions across the product. The ideal candidate will have extensive experience in building... 

    Anysphere

    New York, NY
    1 day ago
  • $176.17k - $251.67k

     ...Machine Learning Engineering Manager - LLM Serving (Remote - US) We are currently looking for a Machine Learning Engineering Manager - LLM...  ...models, supporting batch, offline evaluation, and real‑time inference. Oversee the development and management of the Model Registry... 
    Remote work
    Flexible hours

    Jobgether

    New York, NY
    4 days ago
  •  ...Engineering Excellence Manager ISS Facility Services — Building the Future of Engineering Operations At ISS Facility Services , we believe people make places. We are seeking a dynamic and operationally driven Engineering Excellence Manager to lead mission-... 
    For contractors
    For subcontractor

    ISS Facility Services - North America

    New York, NY
    4 days ago
  •  ...Hotel PMS Solutions Provider and landed on Deloitte’s Technology Fast 500 again in 2024 – but we’re just getting started. As an Engineering Manager at Cloudbeds, you will lead a remote team of Software Engineers to deliver frequent and high-impact value to our customers in... 
    Work at office
    Local area
    Remote work
    Work from home
    Home office
    Weekend work

    Cloudbeds

    New York, NY
    4 days ago
  • $195k - $200k

     ...of relevant work experience. Demonstrated advanced experience with domain area programming language. Track record of being an Engineering Manager for product teams to drive the desired result from complex requirement What makes you stand out: Candidates should have... 
    Full time
    Work experience placement
    Remote work
    Work visa
    Flexible hours

    PrizePicks

    New York, NY
    4 days ago
  •  ...meaningful virtual support to patients across an expansive array of specialties, in all 50 states. OpenLoop is looking for an Engineering Manager to join our team. The ideal candidate will have a strong technical background, proven leadership experience, and a passion... 
    Flexible hours

    OpenLoop Health

    New York, NY
    4 days ago
  •  ...The company is backed by tier 1 venture firms and previous data company founders. WHAT WILL YOU WORK ON? We’re looking for an Engineering Manager to lead the core product engineering team. You’ll manage a small team of full-stack engineers while staying hands‑on with the... 
    Remote work

    Hiretruss

    New York, NY
    4 days ago
  •  ...Canada, LATAM). What you'll do Lead a team building and scaling end-to-end production systems Set technical direction and raise the engineering bar Hire, develop, and retain exceptional talent Balance high standards with empathy - foster both speed and quality Own outcomes... 
    Apprenticeship
    Local area
    Remote work

    ALEPH

    New York, NY
    4 days ago
  • $180.5k - $220k

     ...Direct message the job poster from Pulumi Senior Technical Recruiter at Pulumi Corporation We are looking for an Engineering Manager who is excited to bring Pulumi’s cloud programming model to the world. You will be part of realizing a vision where every developer can... 
    Full time
    Local area
    Remote work
    Flexible hours

    Pulumi Corporation

    New York, NY
    4 days ago
  •  ...will Deliver Moneytree Link solutions and integration projects, managing both internal and external resources. Document requirements,...  ...overall quality. Qualifications 3+ years of experience in an Engineering Manager role using client & server mobile technology and/or APIs... 
    Full time
    Remote work
    Overseas

    Carnot

    New York, NY
    4 days ago
  • $230k - $270k

     ...with product, risk, legal, and data teams to deliver reliable and transparent margin experiences for millions of users! As an Engineering Manager , you will lead a team responsible for designing and operating critical margin infrastructure, including lending systems,... 
    Work at office
    Flexible hours
    Shift work

    Robin Hood

    New York, NY
    1 day ago
  • $293k - $385k

     ...their jobs better and more efficiently. Our teams span product engineering, backend infrastructure, and safety, working together to...  ...About the Role We are looking for an experienced engineering manager to lead our API Experience team. This team is responsible for... 
    Work at office
    Worldwide
    Relocation package

    Slope

    New York, NY
    20 hours ago
  •  ...free with world‑class coaches who specialize in creativity, management, and more. Our operating principles — including negative maintenance...  .... Hear from our employees directly on our Glassdoor page! Engineering Manager @ Clay As a Software Engineering Manager, you will... 

    Clay Labs

    New York, NY
    20 hours ago
  • $140k - $300k

     ...About Us Phare Health is now part of R1 and its AI innovation engine, R37 Lab, bringing Phare’s frontier clinical reasoning technology...  ...years of experience hiring and leading teams as an engineering manager; with expertise in recruiting exceptional talent to build high-... 
    Local area

    Phare Health and R1 RCM

    New York, NY
    21 hours ago
  •  ...Engineering Manager Are you a hands-on engineering leader who thrives on building high-performing teams? Do you get energized by turning product vision into predictable, high-quality delivery? Ready to shape engineering culture at a profitable, growing company where your... 
    Full time
    For contractors
    Immediate start
    Remote work
    Flexible hours

    Platphorm, LLC

    New York, NY
    4 days ago
  • $241.5k - $284k

     ...innovate. We built and operate our own mortgage servicing business managing $110+ billion in loans to deeply understand the complexity...  ...structured and programmable and positions us for the AI era. Engineering at Valon means powering a software ecosystem to disrupt the mortgage... 
    Work at office
    Local area
    Remote work
    Flexible hours

    Valon

    New York, NY
    4 days ago
  •  ...We are seeking an Engineering Manager who combines strong technical depth with hands-on development and people leadership. You will lead a cross-functional engineering team responsible for building and evolving critical platform capabilities within the Accommodations Management... 
    Immediate start

    Talent Software Services

    New York, NY
    3 days ago
  • $240k - $300k

     ...the tools, resources, and support you need to grow your career. Engineering Engineering at Brex is about building systems that scale with...  ...aligned. Own the operational excellence of your team, managing sprint capacity, removing blockers, and ensuring high‑velocity... 
    Work at office
    Remote work
    Work from home
    3 days per week

    I did my part and supported the Regular Toilet

    New York, NY
    1 day ago
  • $180k - $230k

     ...deliver improved outcomes to our patients at a lower cost through early diagnosis and longitudinal care management of chronic conditions. We're looking for an Engineering Manager to join our team. Our managers take on a player/coach role, balancing technical leadership,... 
    Work experience placement
    Work at office
    Remote work
    Work from home

    Clover Health

    New York, NY
    4 days ago
  •  ...Labs has raised over $175M to drive the next generation of onchain innovation. Role and Responsibilities We’re looking for an Engineering Manager to lead our Platform Ecosystems team. In this high-impact role, you will lead the team responsible for providing a... 
    Full time
    Work experience placement
    Remote work

    Framework Ventures

    New York, NY
    4 days ago
  • $200k - $240k

     ...growth phase and upcoming funding milestone. Base pay range $200,000.00/yr - $240,000.00/yr THE ROLE As Senior Director of Data Engineering, you will be the most senior data leader in the organization, owning the strategy, reliability, and scalability of the company’s... 
    Remote work

    Harnham

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Engineering Manager, Inference. Be the first to apply!