Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Engineering Manager, GPU (ML Accelerator)

Anthropic

About Anthropic

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

About the role:

Anthropic’s performance and scaling teams focus on making the most efficient and impactful use of our compute resources, be it inference or training. As an Engineering Manager on these teams you will be responsible for ensuring you and your team are identifying and removing bottlenecks, building robust and durable solutions, and maximizing the efficiency of our systems. You also will help bring clarity, focus, and context to your teams in a fast paced, dynamic environment.

 

Responsibilities:

  • Provide front-line leadership of engineering efforts to improve model performance and scale our inference and training systems
  • Become familiar with the team’s technical stack enough to make targeted contributions as an individual contributor
  • Manage day-to-day execution of the team's work
  • Prioritize the team’s work and manage projects in a highly dynamic, fast paced environment
  • Coach and support your reports in understanding, and pursuing, their professional growth
  • Maintain a deep understanding of the team's technical work and its implications for AI safety

 

You may be a good fit if you:

  • Have 1+ years of management experience in a technical environment, particularly performance or distributed systems
  • Have a background in machine learning, AI, or a similar related technical field
  • Are deeply interested in the potential transformative effects of advanced AI systems and are committed to ensuring their safe development
  • Excel at building strong relationships with stakeholders at all levels
  • Are a quick learner, capable of understanding and contributing to discussions on complex technical topics
  • Have experience managing teams through periods of rapid growth and change
  • Are a quick study: this team sits at the intersection of a large number of different complex technical systems that you’ll need to understand (at a high level of abstraction) to be effective

 

Strong candidates may also have experience with: 

  • High performance, large-scale ML systems
  • GPU/Accelerator programming
  • ML framework internals
  • OS internals
  • Language modeling with transformers

The annual compensation range for this role is listed below. 

For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.

Annual Salary:

$500,000—$850,000 USD

Logistics

Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience

Required field of study:  A field relevant to the role as demonstrated through coursework, training, or professional experience

Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position

Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.

Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.

For roles performing work in California: We will consider for employment all qualified applicants, including those with arrest or conviction records or criminal histories, in a manner consistent with the requirements of applicable state and local laws, including the San Francisco Fair Chance Ordinance, the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act.

We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.

Your safety matters to us. To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit directly for confirmed position openings.

How we're different

We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.

The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.

Come work with us!

Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues. Guidance on Candidates' AI Usage: Learn about our policy for using AI in our application process.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Engineering Manager, GPU (ML Accelerator) in New York, NY vacancy
  •  ...Head of Engineering (GPU Infrastructure / HPC) Investment Profile Greylock-backed company...  ...to own the core platform powering GPU-accelerated simulation at scale. You’ll lead engineering...  .... Strong candidates may come from ML training or inference infrastructure,... 
    Suggested
    Full time
    Relocation

    Greylock Partners

    New York, NY
    4 days ago
  • $194k - $349k

     ...proactively and continuously accelerate execution, build expertise,...  ..., work queues, and memory management. Every engineering team that builds sensor...  ...sensor platform: an on-sensor ML inference runtime designed...  ...accelerated inference across GPU, NPU, and Apple Neural... 
    Suggested
    Permanent employment
    Work experience placement
    Work at office
    Local area
    New York, NY
    18 days ago
  •  ..., optimize their operations, accelerate revenue growth, and enhance citizen...  ...knowledge, applied AI engineering, and trusted AI governance. We...  ...are a Responsible AI Senior Manager who makes trustworthy AI real...  ...of experience in software, AI/ML engineering, or data science,... 
    Suggested
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    New York, NY
    2 days ago
  •  ...technical leadership role for an engineer who loves building production...  ...and views AI as a massive accelerator for both personal and team...  ...-grade ELT/ETL pipelines and managed complex data transformations...  ...methodically diagnosing discrepancies.ML/AI Fuel: You have experience... 
    Suggested
    Hourly pay
    Work at office
    Work from home
    Flexible hours

    Cedar Inc.

    New York, NY
    2 days ago
  • $183.1k - $340k

    Engineering Manager — CoCounsel TaxWe're building the next generation of AI-powered software for tax and accounting professionals, and we're looking...  ...reliably.Background managing mixed teams of backend and AI/ML engineers.Exposure to tax, accounting, or other regulated... 
    Suggested
    Full time
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    New York, NY
    1 day ago
  • $165k - $242k

     ...deep technical expertise to accelerate breakthroughs and turn compute...  ...CoreWeave’s IaaS organization as the Engineering Manager for the Launch & Sandboxes...  ...run code in isolated, GPU-enabled containers, and Launch...  ...focus: you'll stay close to how ML practitioners use the product... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours
    Shift work

    CoreWeave

    New York, NY
    3 days ago
  • $184k - $287.5k

    NVIDIA is seeking an exceptional Manager, Deep Learning Inference Software, to lead a world-class engineering team advancing the state of...  ...generative AI — all accelerated on NVIDIA GPUs. The Deep Learning...  ...deep learning inference and GPU-accelerated software.Drive the... 
    Full time
    Remote work
    Worldwide

    Nvidia

    New York, NY
    4 days ago
  • $182k - $242k

     ...performance with deep technical expertise to accelerate breakthroughs and turn compute into...  ...25. Learn more at .About the RoleAs an Engineering Manager, Storage, you will lead high-performing...  ...object storage development to maximize GPU utilization across AI cloud... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    4 days ago
  • $272k - $431.25k

    NVIDIA is looking for a hardworking Senior Engineering Manager to effectively manage the team working on platform software based on open...  ...small and dynamic team that explores innovative ways to make GPU-accelerated applications easier to develop, deploy, and monitor.Work... 
    Full time
    Remote work

    Nvidia

    New York, NY
    9 hours ago
  •  ...automation.The WorkWe are seeking a Data Engineering, Management & Governance Manager to own the...  ...Databricks, Azure Synapse, BigQuery) with AI/ML pipelines and analytics workflows to...  ..., and reference architectures that accelerate delivery across future client engagements... 
    Live in
    Work at office
    Local area

    Accenture

    New York, NY
    2 days ago
  • $343.4k - $392k

    Senior Staff Full-Stack Engineer (Sr. Director - IC) As a Senior...  ...machine learning experts, product managers and people leaders. Our...  ...TypeScript and SPA frameworks) Full ML development lifecycle using...  ...interactive AI tooling to accelerate productivity, utilizing... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    2 days ago
  • $194.6k - $285.7k

     ..., self-service token factories while managing capacity, policy, reliability, and lifecycle...  ...decisions in collaboration with engineering, architecture, security, and business...  ...in AI infrastructure topics such as GPU clusters, accelerator scheduling, workload placement, high-... 
    Full time
    Temporary work
    Local area
    Flexible hours

    CISCO Systems

    New York, NY
    3 days ago
  • $132.5k - $366.3k

    We are:Accenture Song accelerates growth and value for our clients through sustained customer...  ...- Sales practice: AI Forward Deployed Engineers who embed directly with clients to design...  ...and deployment — plus hands-on modern AI/ML tooling.Preferred Qualifications:Ability... 
    Live in
    Work at office
    Local area

    Accenture

    New York, NY
    2 days ago
  • $244.7k - $279.2k

     ...Director AI Engineering (Remote Eligible) At Capital One, we are creating...  ..., our applications of AI & ML are bringing humanity and simplicity...  ...models at scale. We run the GPU clusters and distributed...  ...scientists, technical program managers, and product managers to deliver... 
    Full time
    Part time
    Local area
    Remote work

    Capital One

    New York, NY
    17 hours ago
  • $230k - $250k

     ...Principal Forward Deployed Engineer – AI New York, NY - hybrid, 3 days per week onsite $230,000 - $250,000 base salary + annual bonus...  ...~ Demonstrated experience building and deploying production AI/ML systems at enterprise scale. ~ Strong expertise in Generative... 
    3 days per week

    Harnham

    New York, NY
    9 days ago
  • $152.29k - $250.2k

     ...the Head of AI Platform Engineering - Execution Plane, you...  ...layer including management of agentic AI workloads...  ...distributed systems, AI/ML platforms, data platforms...  ...planning, and GPU/CPU optimization where...  ...work opportunities to accelerate technology and innovation... 
    Full time
    H1b
    Local area
    Visa sponsorship
    Work visa
    Flexible hours

    Guardian Life Insurance

    New York, NY
    2 days ago
  •  ...The Principal AI Engineer sits at the intersection of software engineering, data science, platform architecture, and AI governance. You will be the technical owner of how AI/ML engineering is designed, built, governed, and shipped across a portfolio of products serving... 
    Full time
    Work at office
    Remote work

    KPI Partners

    New York, NY
    1 day ago
  • $164k - $295k

     ...mindset as a force multiplier to proactively and continuously accelerate execution, build expertise, uncover insights, and solve...  ...cybersecurity starts with you. About the Role: We are seeking an Engineer Manager to be part of the GDI (Getting Data In) group under NG-SIEM... 
    Permanent employment
    Work experience placement
    Work at office
    Local area
    2 days per week
    3 days per week
    New York, NY
    a month ago
  • $192.5k - $357.5k

     ...demonstrated how these technologies accelerate R&D, leveraging data and...  ...a Principal Machine Learning Engineer to join our Foundation Models...  ...architectures and context management for long-horizon scientific tasks...  ...data sources.Scalable ML Systems & Productionization:... 
    Full time
    Local area
    Worldwide
    Relocation package

    Genentech

    New York, NY
    4 days ago
  • $172.8k - $359k

     ...generative AI, agentic AI, and cloud engineering. We always support and enable...  ...Deployed Engineer Senior Manager, you will be joining a...  ...reusable engineering patterns, accelerators, and forward-deployed talent...  ...Experience working with popular ML packages such as scikit-learn... 
    Immediate start
    Remote work

    EY (Ernst & Young)

    New York, NY
    9 hours ago
  • $282.1k - $414.8k

     ...causal question.We are hiring a Principal Machine Learning Engineer to lead the Causal ML pod and establish the technical foundation for company-...  ...faster learning: Develop and validate early indicators that accelerate decisions before long-term outcomes mature, paired with... 
    Hourly pay
    Work at office
    Local area
    Immediate start
    Remote work
    Flexible hours

    Doordash

    New York, NY
    2 days ago
  • $185.5k - $232k

     ...platforms, processes, and capabilities to accelerate all aspects of drug development and...  ...efficiently. About the Position As the Engineering Manager for Infrastructure at Formation Bio,...  ...applications, internal tools, ML pipelines, and AI model training workloads... 
    Work at office
    Local area
    Relocation
    3 days per week

    Formation Bio

    New York, NY
    12 hours ago
  • $405k

     ...group of committed researchers, engineers, policy experts, and business...  ...'ll lead a strong group of ML platform, infrastructure, and...  ...Engineering management experience leading teams on critical...  ...Familiarity with heterogeneous accelerator fleets and how hardware differences... 
    Work at office
    Local area
    Visa sponsorship
    Flexible hours
    Shift work

    Anthropic

    New York, NY
    12 hours ago
  • $141.2k - $278.3k

     ...within Deloitte Consulting that manages a portfolio of emerging...  ...horizons. Our mission is to accelerate the next generation of technology...  ...experienced Quantum Product & Engineering Manager to help build and...  ...teams in quantum computing, AI/ML, or a related technical domain... 
    Local area

    Deloitte

    New York, NY
    1 day ago
  • $225k - $250k

     ...connects to outpatient EHR and practice management systems and supports these workflows...  ...there. About The Role As Duet’s VP of Engineering, you’ll be the architect and primary builder...  ...data experience will meaningfully accelerate your impact. Experience turning internal... 
    Local area
    Immediate start

    Duet

    New York, NY
    1 day ago
  • $160k - $250k

     ...mindset as a force multiplier to proactively and continuously accelerate execution, build expertise, uncover insights, and solve...  ...of the threats detected in their environments.This is a Sr. Engineering Manager role in the CTIO team. In this role you will build and lead... 
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work

    CrowdStrike

    New York, NY
    3 days ago
  • $200k - $250k

     ...financial advisory and asset management firms.  Our people and culture...  ...) is seeking a Head of Data Engineering to lead the ground-up modernization...  ..., on-demand asset and accelerates the firm’s ability to adopt AI...  ...delivering data foundations for AI/ML and governed self-service... 
    Full time
    Local area

    Icbpjb

    New York, NY
    9 days ago
  • $142k - $250k

     ...something extraordinary.BNY is seeking Engineers who amplify team impact through technical...  ...around you by raising engineering standards, accelerating delivery, applying sound technical...  ...enabled capabilities, including GenAI or ML‑driven services, to enhance developer productivity... 
    Full time
    Temporary work
    Worldwide
    Flexible hours

    The Bank of New York Mellon

    New York, NY
    2 days ago
  • $250k - $300k

     ...Job Description Job Description Head of Engineering Company: Confidential — venture-backed technology company Location: New York...  ...enterprise-grade architecture for a scaling platform ~ Shipped AI/ML systems to production with robust evaluation and observability... 
    Full time
    H1b
    Work at office
    Worldwide
    Visa sponsorship

    Transparent Search Group

    New York, NY
    a month ago
  •  ...About the Role   Uncountable is looking for an Engineering Manager to lead our Implementations Software Engineering team. In this role...  ...customer engagement—contributing to Uncountable’s mission of accelerating innovation across industries like chemicals, coatings,... 
    Full time

    Uncountable

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Engineering Manager, GPU (ML Accelerator). Be the first to apply!