Engineering Manager, GPU (ML Accelerator)
Anthropic
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role:
Anthropic’s performance and scaling teams focus on making the most efficient and impactful use of our compute resources, be it inference or training. As an Engineering Manager on these teams you will be responsible for ensuring you and your team are identifying and removing bottlenecks, building robust and durable solutions, and maximizing the efficiency of our systems. You also will help bring clarity, focus, and context to your teams in a fast paced, dynamic environment.
Responsibilities:
- Provide front-line leadership of engineering efforts to improve model performance and scale our inference and training systems
- Become familiar with the team’s technical stack enough to make targeted contributions as an individual contributor
- Manage day-to-day execution of the team's work
- Prioritize the team’s work and manage projects in a highly dynamic, fast paced environment
- Coach and support your reports in understanding, and pursuing, their professional growth
- Maintain a deep understanding of the team's technical work and its implications for AI safety
You may be a good fit if you:
- Have 1+ years of management experience in a technical environment, particularly performance or distributed systems
- Have a background in machine learning, AI, or a similar related technical field
- Are deeply interested in the potential transformative effects of advanced AI systems and are committed to ensuring their safe development
- Excel at building strong relationships with stakeholders at all levels
- Are a quick learner, capable of understanding and contributing to discussions on complex technical topics
- Have experience managing teams through periods of rapid growth and change
- Are a quick study: this team sits at the intersection of a large number of different complex technical systems that you’ll need to understand (at a high level of abstraction) to be effective
Strong candidates may also have experience with:
- High performance, large-scale ML systems
- GPU/Accelerator programming
- ML framework internals
- OS internals
- Language modeling with transformers
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary:
$500,000—$850,000 USD
Logistics
Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.
For roles performing work in California: We will consider for employment all qualified applicants, including those with arrest or conviction records or criminal histories, in a manner consistent with the requirements of applicable state and local laws, including the San Francisco Fair Chance Ordinance, the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act.
We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.
Your safety matters to us. To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit directly for confirmed position openings.How we're different
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
Come work with us!
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues. Guidance on Candidates' AI Usage: Learn about our policy for using AI in our application process.
- ...Head of Engineering (GPU Infrastructure / HPC) Investment Profile Greylock-backed company... ...to own the core platform powering GPU-accelerated simulation at scale. You’ll lead engineering... .... Strong candidates may come from ML training or inference infrastructure,...SuggestedFull timeRelocation
$194k - $349k
...proactively and continuously accelerate execution, build expertise,... ..., work queues, and memory management. Every engineering team that builds sensor... ...sensor platform: an on-sensor ML inference runtime designed... ...accelerated inference across GPU, NPU, and Apple Neural...SuggestedPermanent employmentWork experience placementWork at officeLocal area- ..., optimize their operations, accelerate revenue growth, and enhance citizen... ...knowledge, applied AI engineering, and trusted AI governance. We... ...are a Responsible AI Senior Manager who makes trustworthy AI real... ...of experience in software, AI/ML engineering, or data science,...SuggestedWork experience placementLive inWork at officeLocal area
- ...technical leadership role for an engineer who loves building production... ...and views AI as a massive accelerator for both personal and team... ...-grade ELT/ETL pipelines and managed complex data transformations... ...methodically diagnosing discrepancies.ML/AI Fuel: You have experience...SuggestedHourly payWork at officeWork from homeFlexible hours
$183.1k - $340k
Engineering Manager — CoCounsel TaxWe're building the next generation of AI-powered software for tax and accounting professionals, and we're looking... ...reliably.Background managing mixed teams of backend and AI/ML engineers.Exposure to tax, accounting, or other regulated...SuggestedFull timeWork at officeLocal areaFlexible hours$165k - $242k
...deep technical expertise to accelerate breakthroughs and turn compute... ...CoreWeave’s IaaS organization as the Engineering Manager for the Launch & Sandboxes... ...run code in isolated, GPU-enabled containers, and Launch... ...focus: you'll stay close to how ML practitioners use the product...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursShift work$184k - $287.5k
NVIDIA is seeking an exceptional Manager, Deep Learning Inference Software, to lead a world-class engineering team advancing the state of... ...generative AI — all accelerated on NVIDIA GPUs. The Deep Learning... ...deep learning inference and GPU-accelerated software.Drive the...Full timeRemote workWorldwide$182k - $242k
...performance with deep technical expertise to accelerate breakthroughs and turn compute into... ...25. Learn more at .About the RoleAs an Engineering Manager, Storage, you will lead high-performing... ...object storage development to maximize GPU utilization across AI cloud...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$272k - $431.25k
NVIDIA is looking for a hardworking Senior Engineering Manager to effectively manage the team working on platform software based on open... ...small and dynamic team that explores innovative ways to make GPU-accelerated applications easier to develop, deploy, and monitor.Work...Full timeRemote work- ...automation.The WorkWe are seeking a Data Engineering, Management & Governance Manager to own the... ...Databricks, Azure Synapse, BigQuery) with AI/ML pipelines and analytics workflows to... ..., and reference architectures that accelerate delivery across future client engagements...Live inWork at officeLocal area
$343.4k - $392k
Senior Staff Full-Stack Engineer (Sr. Director - IC) As a Senior... ...machine learning experts, product managers and people leaders. Our... ...TypeScript and SPA frameworks) Full ML development lifecycle using... ...interactive AI tooling to accelerate productivity, utilizing...Full timePart timeLocal area$194.6k - $285.7k
..., self-service token factories while managing capacity, policy, reliability, and lifecycle... ...decisions in collaboration with engineering, architecture, security, and business... ...in AI infrastructure topics such as GPU clusters, accelerator scheduling, workload placement, high-...Full timeTemporary workLocal areaFlexible hours$132.5k - $366.3k
We are:Accenture Song accelerates growth and value for our clients through sustained customer... ...- Sales practice: AI Forward Deployed Engineers who embed directly with clients to design... ...and deployment — plus hands-on modern AI/ML tooling.Preferred Qualifications:Ability...Live inWork at officeLocal area$244.7k - $279.2k
...Director AI Engineering (Remote Eligible) At Capital One, we are creating... ..., our applications of AI & ML are bringing humanity and simplicity... ...models at scale. We run the GPU clusters and distributed... ...scientists, technical program managers, and product managers to deliver...Full timePart timeLocal areaRemote work$230k - $250k
...Principal Forward Deployed Engineer – AI New York, NY - hybrid, 3 days per week onsite $230,000 - $250,000 base salary + annual bonus... ...~ Demonstrated experience building and deploying production AI/ML systems at enterprise scale. ~ Strong expertise in Generative...3 days per week$152.29k - $250.2k
...the Head of AI Platform Engineering - Execution Plane, you... ...layer including management of agentic AI workloads... ...distributed systems, AI/ML platforms, data platforms... ...planning, and GPU/CPU optimization where... ...work opportunities to accelerate technology and innovation...Full timeH1bLocal areaVisa sponsorshipWork visaFlexible hours- ...The Principal AI Engineer sits at the intersection of software engineering, data science, platform architecture, and AI governance. You will be the technical owner of how AI/ML engineering is designed, built, governed, and shipped across a portfolio of products serving...Full timeWork at officeRemote work
$164k - $295k
...mindset as a force multiplier to proactively and continuously accelerate execution, build expertise, uncover insights, and solve... ...cybersecurity starts with you. About the Role: We are seeking an Engineer Manager to be part of the GDI (Getting Data In) group under NG-SIEM...Permanent employmentWork experience placementWork at officeLocal area2 days per week3 days per week$192.5k - $357.5k
...demonstrated how these technologies accelerate R&D, leveraging data and... ...a Principal Machine Learning Engineer to join our Foundation Models... ...architectures and context management for long-horizon scientific tasks... ...data sources.Scalable ML Systems & Productionization:...Full timeLocal areaWorldwideRelocation package$172.8k - $359k
...generative AI, agentic AI, and cloud engineering. We always support and enable... ...Deployed Engineer Senior Manager, you will be joining a... ...reusable engineering patterns, accelerators, and forward-deployed talent... ...Experience working with popular ML packages such as scikit-learn...Immediate startRemote work$282.1k - $414.8k
...causal question.We are hiring a Principal Machine Learning Engineer to lead the Causal ML pod and establish the technical foundation for company-... ...faster learning: Develop and validate early indicators that accelerate decisions before long-term outcomes mature, paired with...Hourly payWork at officeLocal areaImmediate startRemote workFlexible hours$185.5k - $232k
...platforms, processes, and capabilities to accelerate all aspects of drug development and... ...efficiently. About the Position As the Engineering Manager for Infrastructure at Formation Bio,... ...applications, internal tools, ML pipelines, and AI model training workloads...Work at officeLocal areaRelocation3 days per week$405k
...group of committed researchers, engineers, policy experts, and business... ...'ll lead a strong group of ML platform, infrastructure, and... ...Engineering management experience leading teams on critical... ...Familiarity with heterogeneous accelerator fleets and how hardware differences...Work at officeLocal areaVisa sponsorshipFlexible hoursShift work$141.2k - $278.3k
...within Deloitte Consulting that manages a portfolio of emerging... ...horizons. Our mission is to accelerate the next generation of technology... ...experienced Quantum Product & Engineering Manager to help build and... ...teams in quantum computing, AI/ML, or a related technical domain...Local area$225k - $250k
...connects to outpatient EHR and practice management systems and supports these workflows... ...there. About The Role As Duet’s VP of Engineering, you’ll be the architect and primary builder... ...data experience will meaningfully accelerate your impact. Experience turning internal...Local areaImmediate start$160k - $250k
...mindset as a force multiplier to proactively and continuously accelerate execution, build expertise, uncover insights, and solve... ...of the threats detected in their environments.This is a Sr. Engineering Manager role in the CTIO team. In this role you will build and lead...Full timeWork experience placementWork at officeLocal areaRemote work$200k - $250k
...financial advisory and asset management firms. Our people and culture... ...) is seeking a Head of Data Engineering to lead the ground-up modernization... ..., on-demand asset and accelerates the firm’s ability to adopt AI... ...delivering data foundations for AI/ML and governed self-service...Full timeLocal area$142k - $250k
...something extraordinary.BNY is seeking Engineers who amplify team impact through technical... ...around you by raising engineering standards, accelerating delivery, applying sound technical... ...enabled capabilities, including GenAI or ML‑driven services, to enhance developer productivity...Full timeTemporary workWorldwideFlexible hours$250k - $300k
...Job Description Job Description Head of Engineering Company: Confidential — venture-backed technology company Location: New York... ...enterprise-grade architecture for a scaling platform ~ Shipped AI/ML systems to production with robust evaluation and observability...Full timeH1bWork at officeWorldwideVisa sponsorship- ...About the Role Uncountable is looking for an Engineering Manager to lead our Implementations Software Engineering team. In this role... ...customer engagement—contributing to Uncountable’s mission of accelerating innovation across industries like chemicals, coatings,...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Engineering Manager, GPU (ML Accelerator). Be the first to apply!
- machine learning scientist New York, NY
- machine learning part time New York, NY
- machine learning New York, NY
- artificial intelligence - machine learning intern New York, NY
- machine learning research scientist New York, NY
- machine learning researcher New York, NY
- machine learning intern New York, NY
- internship machine learning New York, NY
- data engineer machine learning New York, NY
- machine learning remote New York, NY







