Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Technical Program Manager, External Evaluators

$290k - $365k

Anthropic

About Anthropic

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

About the role

Anthropic gives independent external evaluators access to our models, our people, and our safety practices so that they can assess risks, processes, and policies. We're hiring a Technical Program Manager to establish and deepen our partnerships with these external reviewers and embedded evaluators to support a thriving frontier evaluation ecosystem.

You'll be the main point of contact for our existing partners, deepening our support so that they can work effectively and produce high-quality, rigorous, independent publications. You'll separately broaden the portfolio of organizations we are working with, managing the funnel from first conversation through contracting, onboarding, and day-to-day access, culminating in published reports. You'll evolve our current time-intensive manual processes into a system that can support many evaluators at once, working with teams across Safety, Research, Security, Legal, People Services, IT, Policy, and Communications. Within six months, you should be able to take a new evaluator from contract negotiation to first published report with minimal involvement from senior leaders.

You'll need the technical depth to work out with researchers and engineers what access, tooling, and evidence an evaluation requires, and the judgment to resolve most questions quickly and escalate the few that need it, while balancing evaluators' need for access with Anthropic's requirements to protect its customers, its security, and its confidential information. We're looking for a generalist who can ship quickly and iteratively, and who earns trust on both sides.

Key responsibilities

  • Own the external evaluator program end to end, including our relationships with evaluator organizations and the pipeline of future partners
  • Take each evaluator from first conversation through scoping, contracting, onboarding, access, and review to a published report
  • Define the stages and tiers of working with evaluators, and develop information access policies that meet evaluators' needs while protecting security and confidential information
  • Drive evaluators' access and information requests to fast, well-documented decisions in partnership with Research, Security, Legal, and IT
  • Drive the technical design of evaluator access with Security, IT, and infrastructure teams, including permissions, environments, and monitoring, and close gaps between policy and technical controls without slowing evaluators down
  • Run the review process for evaluator reports against agreed timelines and redaction criteria, while protecting evaluators' ability to publish their own conclusions
  • Scope evaluations with researchers and engineers, turning evaluators' questions about training, monitoring, and alignment into concrete requirements for model access, data, tooling, and compute, and planning capacity for each new evaluator
  • Turn evaluators' technical findings into research and engineering work with owners and dates, and drive accountability for how Anthropic responds
  • Keep the company informed with regular updates on how the program is going, and clear guidance on how to work with evaluators
  • Collect feedback from evaluators and internal teams, run retrospectives, and iterate on policies and practices
  • Use Claude and work with engineering teams to build the tooling the program runs on, such as access provisioning, request tracking, and report review
  • Support a thriving ecosystem of evaluators by sharing what we learn about running independent evaluation well

Minimum qualifications

  • Experience leading complex technical programs with engineering or research teams, from ambiguous goals through delivery
  • Experience managing relationships with external organizations, including scoping work, navigating contracting, setting expectations, and resolving disagreements
  • Strong program management skills, including program planning, milestone and dependency tracking, and risk management across many concurrent workstreams
  • Technical fluency in how frontier AI models are trained, evaluated, and monitored, sufficient to define technical requirements, identify technical risks, and challenge tradeoffs with researchers and engineers
  • Sound judgment and discretion with confidential and sensitive information

The annual compensation range for this role is listed below. 

For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.

Annual Salary:

$290,000—$365,000 USD

Logistics

Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience

Required field of study:  A field relevant to the role as demonstrated through coursework, training, or professional experience

Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position

Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.

Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.

For roles performing work in California: We will consider for employment all qualified applicants, including those with arrest or conviction records or criminal histories, in a manner consistent with the requirements of applicable state and local laws, including the San Francisco Fair Chance Ordinance, the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act.

We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed.  Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.

Your safety matters to us. To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit directly for confirmed position openings.

How we're different

We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.

The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.

Come work with us!

Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues. Guidance on Candidates' AI Usage: Learn about  our policy for using AI in our application process.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Technical Program Manager, External Evaluators in New York, NY vacancy
  • $290k - $365k

     ...systems. About the role Anthropic gives [independent external evaluators]( access to our models, our people, and our safety practices...  ...assess risks, processes, and policies. We're hiring a Technical Program Manager to establish and deepen our partnerships with these... 
    Suggested
    Full time
    Contract work
    Work at office
    Local area
    Visa sponsorship
    Flexible hours

    Anthropic

    New York, NY
    3 days ago
  •  ...seeking a highly motivated and experienced Technical Program Manager Note: Candidate must be local to...  ...across platforms, delivery teams and external partners. The Technical Program...  ...leadership and internal partners to evaluate and develop insights on opportunities... 
    Suggested
    Long term contract
    Local area

    BCforward

    New York, NY
    2 days ago
  •  ...About the Position We are looking for a highly-driven Technical Program Manager who can provide organization and coordination support for...  ...developers, business teams, operations, support-as well as with external financial entities, to make sure each project is delivered... 
    Suggested
    Second job
    Immediate start
    Flexible hours

    Jane Street

    New York, NY
    4 days ago
  • Own and execute adoption and enablement programs for the Axon Fusus platform across internal and external audiences. Deliver high-quality instructor-led training to internal teams and external law enforcement customers, including scenario-based sessions. Develop and maintain... 
    Suggested
    Remote job

    Axon

    New York, NY
    23 hours ago
  •  ...company has empowered teams to manage work seamlessly and scale...  ...We're looking for a Senior Technical Program Manager I to join our expanding...  ...enterprise initiatives and external partner engagements,...  ...with engineering teams and evaluate technical dependencies and risks... 
    Suggested
    Remote job

    Smartsheet

    New York, NY
    1 day ago
  • Maxana is seeking a Senior Technical Program Manager to coordinate complex programs for a Major Silicon Valley Client. The role emphasizes machine...  ...across product, engineering, design, finance, legal, and external partners. Remote-first in the US, with a standard M-F... 
    Remote job

    Maxana

    New York, NY
    23 hours ago
  • $65 - $85 per hour

    Future Opening: Senior Technical Program Manager Full Time • Fully Remote - US Maxana seeks to hire a Senior Technical Program Manager to work...  ..., Finance, Legal, Compliance, Community Support, and external partners. A strong history of technical work with machine... 
    Hourly pay
    Full time
    Remote work
    Monday to Friday
    Shift work

    Maxana

    New York, NY
    23 hours ago
  •  ...Development, oversees grant programs and initiatives to invest...  ..., Fiber Deployment, the Technical Program Manager (PM) is responsible for ensuring...  ...with internal and external stakeholders and regulatory...  ...experience into formal systems for evaluating and reporting on... 
    Work at office
    Local area

    Empire State

    New York, NY
    21 days ago
  • $157k - $210k

     ...superior infrastructure performance with deep technical expertise to accelerate breakthroughs...  .... We're looking for a Technical Program Manager to join the CIO organization and drive...  ...technical teams, business system owners, and external vendors, including resolving... 
    Full time
    Temporary work
    Casual work
    Work at office
    Immediate start
    Flexible hours

    CoreWeave

    New York, NY
    5 days ago
  •  ...Development, oversees grant programs and initiatives to invest...  ...Cellular Coverage, the Technical Program Manager (PM) is responsible for executing...  ...with internal and external stakeholders and regulatory...  ...experience into formal systems for evaluating and reporting on... 
    Work at office
    Local area

    Empire State

    New York, NY
    20 days ago
  • $117.58k - $154.32k

     ...Description Hi, we're Oscar. We're hiring Technical Program Managers to join our Technical Program...  ...marketing technology. Experience with external vendors, platform migrations, or...  ...products or workflow automation, including evaluation and operational readiness.   This... 
    Full time
    Work experience placement
    Work at office
    Flexible hours

    Oscar Health

    New York, NY
    2 days ago
  • $182k - $242k

     ...infrastructure performance with deep technical expertise to accelerate...  ...cross-functional reach. You will not manage people — you will manage programs, processes, and accountability across...  ...turn-up). ~ Comfortable managing external vendors and partners to schedule, quality... 
    Full time
    Temporary work
    For contractors
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    3 days ago
  •  ...Principal Technical Program Manager Airspace Link is a leading aviation technology company enabling the safe integration of drones into communities...  ..., operational systems, sensor infrastructure, and external technology partners. Partner closely with technical teams... 
    Remote work

    Airspace Link

    New York, NY
    4 days ago
  • $117.58k - $154.32k

     ...Description Job Description Hi, we're Oscar. We're hiring a Technical Program Manager, Data to join our Technical PMO team. Oscar is the...  ...definitions across domains. Experience coordinating external vendors and helping business and analytics teams adopt new... 
    Full time
    Work experience placement
    Work at office
    Flexible hours

    Oscar Health

    New York, NY
    20 days ago
  •  ...Job Description Job Description Role- Technical Program Manager (Mobile & Digital Platforms) Location US Remote (East Coast) Job...  ...mitigations, and escalation paths Track and manage internal and external dependencies (third-party vendors, APIs, partner teams,... 
    Remote work

    Apolis

    New York, NY
    21 days ago
  • $170k - $190k

     ...across many internal teams and external partners, each with their own...  ...constraints. Strong program leadership is the connective...  ...products or platform for Compass.Manage the full life cycle of key programs...  ...manage, and deliver multiple technical programs that may span... 
    Minimum wage
    Flexible hours

    Compass

    New York, NY
    2 days ago
  • $163.6k - $221.3k

     ...vendors, and offsite advertisers. As a Sr. Technical Program Manager on GPS, you will drive programs that...  ...that govern how internal and external users interact with advertiser accounts...  ...release schedules- Experience building and evaluating system-level technical design-... 
    Worldwide
    Flexible hours

    Amazon

    New York, NY
    23 hours ago
  •  ...out the door. Build the entire security program from scratch. Most leaders inherit...  ..., tell us where you would. You've run technical program management for a security or infrastructure org, holding engineers and external partners to deadlines they signed up for.... 

    Fluidstack

    New York, NY
    12 hours ago
  • $140.4k - $166.1k

    ABOUT THE ROLEWe’re looking for a Technical Program Manager (TPM) to drive complex, cross-functional cybersecurity programs across our enterprise...  ...backgroundExperience managing vendor relationships and external delivery partnersHow we work: We value clarity over ceremony... 
    Local area

    Peloton Cycle

    New York, NY
    3 days ago
  • $139.9k - $189.2k

    We're seeking a Technical Program Manager to join the Data Infrastructure and Generative Intelligence (DIGI) team within Advertising Finance....  ...collection of business and systems requirements from internal and external customers, writing specifications, driving project... 
    Remote work
    Flexible hours
    Shift work

    Amazon

    New York, NY
    2 days ago
  • $163k - $236k

     ...safety risks into measurable technical goals, driving strategic...  ...modeling, infrastructure, evaluation, governance, and public policy...  ....Implement robust program management frameworks (OKRs, stand-ups...  ...for executive leadership and external partners.Manage program budgets... 

    Google

    New York, NY
    2 days ago
  • $120k - $140k

    The Technical Program Manager leads the program management strategy and execution and drives continuous...  ...the Digital Technology team within External Relations.This is a full-time...  ...visibility and streamline project workflows.Evaluate and incorporate modern digital tools,... 
    Full time
    Local area

    Simons Foundation

    New York, NY
    23 hours ago
  • $182k - $242k

     ...superior infrastructure performance with deep technical expertise to accelerate breakthroughs...  .... We are seeking a Staff Technical Program Manager to define and lead how maintenance and...  ...recovery planning.Experience coordinating external providers or vendors and aligning their... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    4 days ago
  • $200k - $270k

     ...system of record to making and managing AI agents to automating away...  ...at Notion to help run the programs and operating rhythms that...  ...as well as cross-functional, externally facing efforts with partners...  ...outcomeForge strong partnerships with technical and business leaders across... 
    Local area

    Notion Labs

    New York, NY
    1 day ago
  • $163.6k - $221.3k

    We are looking for a Technical Program Manager to join the PV Ads - Ad Tech Ops team, a newly formed...  ...internal (PVA Engineering, Product) and external (partner) teams through structured...  ...release schedules- Experience building and evaluating system-level technical design-... 
    Flexible hours

    Amazon

    New York, NY
    1 day ago
  • Axon is seeking an experienced training professional to own and execute adoption and enablement programs for the Fusus platform across internal teams and external law enforcement customers. You will deliver high-quality instructor-led training, including scenario-based... 

    Axon

    New York, NY
    23 hours ago
  • $130k - $200k

     ...Job Description Job Description Senior Technical Program Manager, Global Supply Chain – LiDAR & Optical Circuit Switches (OCS) About us...  ...functional programs that span engineering, operations and external partners. Nice to Have • Automotive and industrial supply... 
    Contract work
    Work at office

    Voyant Photonics

    New York, NY
    29 days ago
  • $163k - $236k

     ...product launches to design and manage an end-to-end operational...  ...engineering teams.Direct and oversee external creative agencies,...  ...operational readiness reviews and technical compliance rubrics to guarantee...  .... 5 years of experience in program management.Experience delivering... 
    Permanent employment
    Temporary work

    Google

    New York, NY
    4 days ago
  • $138k - $197k

    Partner with internal and external stakeholders to maximize the value of Google’s global energy...  ...qualifications:Bachelor's degree in a technical field or equivalent practical experience.2 years of experience in program management.2 years of experience in wholesale... 
    Contract work

    Google

    New York, NY
    23 hours ago
  • $240k - $333k

     ...to-end delivery of complex technical bets and high-uncertainty initiatives...  ..., resolving disagreements, evaluating technical trade-offs, and...  ...and mentor high-performing Program Managers, cultivate the Technical...  ...management, and our external user ecosystems to uncover... 
    Work at office

    Google

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Technical Program Manager, External Evaluators. Be the first to apply!