Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Technical Program Manager - Embedded Evaluations and Investigations

$250k - $350k

Transluce

Salary range:

$250,000 - $350,000/year + benefits + bonus

Description:

Transluce is a fast-moving nonprofit research lab building the public tech stack for AI evaluation and oversight. We partner with frontier AI developers, governments, and civil society organizations to evaluate how AI systems behave, from misaligned agent swarms to child safety and mental health.

About the role:

As a Technical Program Manager, you will scope, organize, and direct the work of our technical staff across our external engagements. These include embedded evaluations on site at frontier labs, rapid-response incident analysis, and evaluation services for partners such as the EU AI Office and Common Sense Media. You will own each engagement end to end, from the first scoping conversation to the final dissemination.

As an early member of a highly collaborative team, you will learn and grow quickly, and work closely with our technical and governance teams to protect researcher time and turn one-off engagements into repeatable playbooks.

Core responsibilities:

  • Define the scope of each engagement, set key milestones, and negotiate terms, with support from our operations team.
  • Organize the technical team's work, manage dependencies, and keep everyone aligned through frequent touchpoints.
  • Act as a sounding board on key strategic and methodological questions, reflecting the needs of the engagement and other considerations, such as relevant regulatory guidance.
  • Own the day-to-day partner relationship, building trust and resolving issues while protecting Transluce’s core interests and the technical team's time.
  • Engage directly with evaluation results and technical analysis to understand the work, identify issues, and help drive the engagement forward.
  • Present deliverables to partners and summarize results for broader audiences, including blog posts, papers, and government and media briefings.

Minimum qualifications:

  • Understanding of AI evaluations and the ability to engage with technical teams on their design and results.
  • Track record of managing cross-functional teams, for example in a tech company, consulting firm, or fast-paced startup.
  • Experience engaging external partners such as frontier AI companies, government actors, or civil society organizations.
  • Ability to work through ambiguity and deliver against complex, evolving goals on short timelines, building workflows where none exist.
  • Ability to translate technical research for a range of audiences.
  • Exceptional communication and relationship skills, low ego, openness to giving and receiving feedback.

Preferred qualifications (not required):

  • Experience managing evaluations at scale or in a production context.
  • Proficiency in Python and data analysis tools (e.g., pandas, SQL), and familiarity with common ML and evaluation frameworks (e.g., PyTorch, Hugging Face, Inspect).
  • Experience building and applying software tools, for example in a forward-deployed engineering role.
  • Knowledge of frontier AI risk management practices or relevant regulatory guidance.

We are hiring at all levels of experience and would encourage those enthusiastic about the role who do not meet all of the qualifications to apply. This role involves regular travel. We are located in San Francisco and excited to work together in person. We are open to sponsoring international visas.

#J-18808-Ljbffr

Vacancy posted 4 hours ago
Similar jobs that could be interesting for youBased on the Technical Program Manager - Embedded Evaluations and Investigations in San Francisco, CA vacancy
  • $169k - $245k

     ...us! Were looking for an experienced Technical Program Manager to build and run the program...  ...portfolio. Reporting into the CIO PMO and embedded within the team driving this work youll...  ...what gets delivered but also how Figma evaluates builds releases and operates internal... 
    Suggested
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    San Francisco, CA
    8 days ago
  • $133k - $223k

     ...system of record to making and managing AI agents to automating away...  ...the Role:We're hiring a Technical Program Manager to lead the systems,...  ...standards: a defined task, a way to evaluate output quality, explicit...  ..., or equivalent time embedded on an IT audit teamExperience... 
    Suggested
    Local area

    Notion Labs

    San Francisco, CA
    5 days ago
  • $290k - $365k

     ...growing fast, and our SOX program needs to keep up. Many of...  ...billed. We’re hiring a Technical Program Manager to own the technology side...  ...Build processes to evaluate new products, systems, and...  ...for auditor requests Investigate control failures down to root... 
    Suggested
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    2 days ago
  • $231.3k - $256.5k

     ...hardware, professional and managed services, vendor-...  ...research. We build the programs and products that help...  ...for a Vendor Security Technical Program Manager who...  ...understand the business need, investigate the actual data and...  ...on security addenda. Evaluate proposed terms and... 
    Suggested
    Work at office
    Local area
    Remote work
    Flexible hours

    OpenAI

    San Francisco, CA
    1 day ago
  • $128k - $160k

     ...the fastest-growing and most technically demanding in enterprise AI....  ...to support them.As Program Manager, Technical Enablement, you...  ...Program ManagementServe as the embedded enablement partner to FAE leadership...  ...ensure a fair and thorough evaluation of all applicants.About Us:... 
    Suggested
    Full time

    Scale AI

    San Francisco, CA
    5 days ago
  •  ...What the job involves The Principal Technical Program Manager will lead the development and...  ...-of-concepts (PoCs) and the rigorous evaluation of next-generation components, shaping...  ...risk ~ Strong technical foundation in embedded systems, hardware/software integration... 

    Hayden AI Technologies, Inc.

    San Francisco, CA
    4 days ago
  • $165k - $210k

    The RoleAt Candid Health, we’re searching for a Platform Technical Program Manager (TPM) to drive operational strategy alongside engineering and product leadership. As a dedicated partner embedded within our Platform Engineering team, you will own the team's long-term roadmap... 
    Temporary work
    Work at office
    Remote work

    Candid Health

    San Francisco, CA
    5 days ago
  • $148.7k - $201.2k

     ...responsibilitiesWe are looking for an experienced Senior Technical Program Manager to lead customer retention across Amazon Music tiers and content...  ...coordinating release schedules- Experience building and evaluating system-level technical design- Experience developing and... 
    Local area
    Flexible hours

    Amazon

    San Francisco, CA
    4 days ago
  • $180.2k - $225.2k

     ...infrastructure, we need someone who can hold the full program together.The Senior Technical Program Manager for Credit and Lending will own end-to-end delivery...  ...management systems.How you workProduct-first. You evaluate everything through: what is the user problem, what... 

    Mercury

    San Francisco, CA
    5 days ago
  •  ...Technical Program Manager San Francisco, California About HumanSignal Real-world data is the competitive edge in AI. HumanSignal...  ...datasets from scratch, recruit and manage the domain experts who evaluate model output, and run everything through our own platform,... 
    Worldwide

    HumanSignal

    San Francisco, CA
    2 days ago
  • $125k - $250k

     ...some of the earliest and most influential research in AI evaluation like FinanceBench, Lynx, SimpleSafetyTests, CopyrightCatcher...  ..., Gokul Rajaram, and more. Responsibilities As a Technical Program Manager at Patronus AI, you will run the production line that turns... 
    Work at office
    Immediate start

    Patronus AI, Inc.

    San Francisco, CA
    2 days ago
  •  ...are what get people building. Give non-technical builders the same visibility engineers...  ...systems that make agentic work observable and evaluated are what turn agents into something the...  ...the rollout, onboarding, and training programs that take a team from first demo to... 
    Local area

    Fluidstack

    San Francisco, CA
    5 days ago
  •  ...where the hardest problems stop being technical and start being cross-cutting. Work arrives...  .... You would be our first Technical Program Manager, and you would own that layer. Not by...  ..., especially the reliability and evaluation problems that come with non-deterministic... 
    Work at office
    Flexible hours

    BackOps AI

    San Francisco, CA
    4 days ago
  •  ...startups. We’ve raised $16M from top VCs and were YC W25. About the role We’re looking for a Technical Program Manager to own complex, time-sensitive data and evaluation programs for frontier AI labs, data vendors, and internal teams. You’ll turn ambiguous technical... 
    Full time
    Work at office
    Remote work
    Relocation
    Visa sponsorship

    Human Union Data, Inc.

    San Francisco, CA
    2 days ago
  • $150k - $175k

     ...class team, and strong financial backing. We are hiring a Technical Program Manager to improve how product and engineering plan, coordinate, and...  ...and launch readiness across product and engineering. Evaluate developer workflow tools through structured pilots. Track... 
    Work at office
    Visa sponsorship

    Hooglee

    San Francisco, CA
    9 hours ago
  • $120k - $160k

     ...and sources of truth (Linear, program reviews) that keep work...  ...execution framework for high-stakes technical roadmaps, giving teams the...  ...slowing down. Orchestration: Manage the technical roadmap from...  ...that keep delivery healthy - evaluation, onboarding, quality - and keep... 

    Charta Health

    San Francisco, CA
    3 days ago
  •  ...Services enables the future of how clients manage their money by delivering innovative...  ...products and services. As a Senior Technical Program Manager supporting Schwab’s Site Reliability...  ...restore, and change failure rates, to evaluate results, identify delivery risks, and... 
    Work at office

    Charles Schwab

    San Francisco, CA
    2 days ago
  • $60 - $75 per hour

     ...Century Group is partnering with a client that is seeking a Technical Program Manager to assist their team. Exact compensation may vary based on...  ...-making for technology expansion, including vendor evaluations and onboarding processes. Requirements: A minimum... 
    Hourly pay

    Century Group

    San Francisco, CA
    2 days ago
  •  ...Technical Program Manager III Our client is a unified analytics platform that helps organizations accelerate innovation by simplifying data...  ...Support, Product, Finance, and Leadership stakeholders. Investigate capacity constraints, service bottlenecks, and resource... 
    Hourly pay
    Full time
    Temporary work

    Ursus Inc

    San Francisco, CA
    4 days ago
  • $290k - $365k

     ...build beneficial AI systems. About the Role As a Technical Program Manager on the Compute team, you will help drive the planning, coordination...  ...is the foundation on which every model training run, evaluation, and inference workload depends. You'll join a small,... 
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    San Francisco, CA
    9 hours ago
  • $151.2k - $189k

     ...governments, and enterprises deploy them. We are hiring a Technical Program Manager to own day-to-day partnerships with frontier model developers...  ...major model developers to generate adversarial data, run evaluations, and publish benchmarks across jailbreaks, prompt... 
    Full time

    Scale AI

    San Francisco, CA
    1 day ago
  • $171k - $231.4k

    We are seeking an ambitious Technical Program Manager to join our Metrics and Data Platform team at Amazon Music. The Metrics and Data Platform...  ...coordinating release schedules- Experience building and evaluating system-level technical design- Experience developing and executing... 
    Local area
    Flexible hours

    Amazon

    San Francisco, CA
    4 days ago
  • $146.4k - $235.38k

     .... With intelligent agreement management, Docusign unleashes business-...  ...). What you'll do Our Program Management team under the Commerce...  ...to market. The Senior Technical Program Manager will be responsible...  ...and development Evaluate existing processes and procedures... 
    Contract work
    Work experience placement
    Work at office
    Local area
    Remote work
    2 days per week

    DocuSign

    San Francisco, CA
    4 days ago
  • $85 - $98 per hour

     ...Overview Our client is seeking a highly motivated and technically skilled Technical Program Manager (TPM) to lead and oversee data annotation programs...  ...Collaborate with external customers and research partners on evaluation workshops, pilots, and feedback sessions to drive... 
    Hourly pay
    Contract work
    3 days per week

    Insight Global

    San Francisco, CA
    9 hours ago
  • $130k - $225k

     ...About the Role Lead complex data and evaluation programs for AI research teams and internal partners. You will turn evolving technical needs into reliable delivery processes...  ...difficulty, and reward distributions. Manage external vendors and improve delivery pipelines... 
    Full time
    Visa sponsorship

    Clera

    San Francisco, CA
    3 days ago
  •  ...Rad AI Product Manager Opportunity At Rad AI, we're on a mission...  .... In this role you'll own program delivery for Rad AI Reporting...  ...-lives end to end and being technical enough to roll up your sleeves...  ...(SQL, light Python/shell) to investigate issues. Clinical workflow... 
    Full time
    Work at office
    Remote work

    Rad AI

    San Francisco, CA
    3 days ago
  • $198k - $235.5k

     ...ServiceNow, Zendesk, GitHub, and many more. You'll be deeply embedded where people get things done. You'll ship agentic...  ...every company. About the Role: Glean is seeking a Sr. Technical Program Manager (TPM) to lead complex, cross-functional initiatives that shape... 
    Work at office
    Home office
    Flexible hours

    Glean.info

    San Francisco, CA
    2 days ago
  •  ...to keep the Internet moving forward youll fit right in. Technical Program Manager Performance and Infrastructure Engineering PMO...  ...resilience tests. Tracking & Reporting: Track remediation evaluate program impact and maintain roadmaps dashboards and runbooks... 
    Full time
    Local area
    Flexible hours

    Cloudflare

    San Francisco, CA
    7 days ago
  • $257k - $335k

     ...Innovation Labs is a product design and engineering team embedded in the People organization. We build AI-powered products that...  .... About the Role Were looking for an experienced Technical Program Manager to lead execution across a portfolio of complex cross-functional... 
    Full time
    Work at office

    OpenAI

    San Francisco, CA
    15 days ago
  • $163.64k - $336.9k

     ...how we use AI in our recruiting process here.As a Sr. Staff Technical Program Manager for Search Signals at Pinterest, you will lead company-...  ...methodologies for signals management, data acquisition, and model evaluation.Shape the future of the signals domain at Pinterest... 
    Work at office
    Local area
    Remote work
    Relocation package

    Pinterest

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Technical Program Manager - Embedded Evaluations and Investigations. Be the first to apply!