Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Technical Program Manager - Embedded Evaluations and Investigations

$250k - $350k

Jobleads-US

Salary range:

$250,000 - $350,000/year + benefits + bonus

Description:

Transluce is a fast-moving nonprofit research lab building the public tech stack for AI evaluation and oversight. We partner with frontier AI developers, governments, and civil society organizations to evaluate how AI systems behave, from misaligned agent swarms to child safety and mental health.

About the role:

As a Technical Program Manager, you will scope, organize, and direct the work of our technical staff across our external engagements. These include embedded evaluations on site at frontier labs, rapid-response incident analysis, and evaluation services for partners such as the EU AI Office and Common Sense Media. You will own each engagement end to end, from the first scoping conversation to the final dissemination.

As an early member of a highly collaborative team, you will learn and grow quickly, and work closely with our technical and governance teams to protect researcher time and turn one-off engagements into repeatable playbooks.

Core responsibilities:

  • Define the scope of each engagement, set key milestones, and negotiate terms, with support from our operations team.
  • Organize the technical team's work, manage dependencies, and keep everyone aligned through frequent touchpoints.
  • Act as a sounding board on key strategic and methodological questions, reflecting the needs of the engagement and other considerations, such as relevant regulatory guidance.
  • Own the day-to-day partner relationship, building trust and resolving issues while protecting Transluce’s core interests and the technical team's time.
  • Engage directly with evaluation results and technical analysis to understand the work, identify issues, and help drive the engagement forward.
  • Present deliverables to partners and summarize results for broader audiences, including blog posts, papers, and government and media briefings.

Minimum qualifications:

  • Understanding of AI evaluations and the ability to engage with technical teams on their design and results.
  • Track record of managing cross-functional teams, for example in a tech company, consulting firm, or fast-paced startup.
  • Experience engaging external partners such as frontier AI companies, government actors, or civil society organizations.
  • Ability to work through ambiguity and deliver against complex, evolving goals on short timelines, building workflows where none exist.
  • Ability to translate technical research for a range of audiences.
  • Exceptional communication and relationship skills, low ego, openness to giving and receiving feedback.

Preferred qualifications (not required):

  • Experience managing evaluations at scale or in a production context.
  • Proficiency in Python and data analysis tools (e.g., pandas, SQL), and familiarity with common ML and evaluation frameworks (e.g., PyTorch, Hugging Face, Inspect).
  • Experience building and applying software tools, for example in a forward-deployed engineering role.
  • Knowledge of frontier AI risk management practices or relevant regulatory guidance.

We are hiring at all levels of experience and would encourage those enthusiastic about the role who do not meet all of the qualifications to apply. This role involves regular travel. We are located in San Francisco and excited to work together in person. We are open to sponsoring international visas.

#J-18808-Ljbffr Jobleads-US
Vacancy posted 13 hours ago
Similar jobs that could be interesting for youBased on the Technical Program Manager - Embedded Evaluations and Investigations in San Francisco, CA vacancy
  • $133k - $223k

     ...system of record to making and managing AI agents to automating away...  ...the Role:We're hiring a Technical Program Manager to lead the systems,...  ...standards: a defined task, a way to evaluate output quality, explicit...  ..., or equivalent time embedded on an IT audit teamExperience... 
    Suggested
    Local area

    Notion Labs

    San Francisco, CA
    23 hours ago
  • $169k - $245k

     ...! We're looking for an experienced Technical Program Manager to build and run the program operating...  .... Reporting into the CIO PMO and embedded within the team driving this work, you...  ...what gets delivered, but also how Figma evaluates, builds, releases, and operates... 
    Suggested
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Jobleads-US

    San Francisco, CA
    2 days ago
  • $231.3k - $256.5k

     ...hardware, professional and managed services, vendor-...  ...research. We build the programs and products that help...  ...for a Vendor Security Technical Program Manager who...  ...understand the business need, investigate the actual data and...  ...on security addenda. Evaluate proposed terms and... 
    Suggested
    Work at office
    Local area
    Remote work
    Flexible hours

    OpenAI

    San Francisco, CA
    1 day ago
  • $116k - $145k

    We are seeking a motivated and experienced Technical Program Manager to join Datadog’s Technical Solutions organization. This organization is...  ...Uses AI tools confidently in day-to-day program work and can evaluate where AI can be responsibly and effectively applied to... 
    Suggested
    Work at office

    Datadog

    San Francisco, CA
    14 hours ago
  • $128k - $160k

     ...the fastest-growing and most technically demanding in enterprise AI....  ...to support them.As Program Manager, Technical Enablement, you...  ...Program ManagementServe as the embedded enablement partner to FAE leadership...  ...ensure a fair and thorough evaluation of all applicants.About Us:... 
    Suggested
    Full time

    Scale AI

    San Francisco, CA
    23 hours ago
  •  ...What the job involves The Principal Technical Program Manager will lead the development and...  ...-of-concepts (PoCs) and the rigorous evaluation of next-generation components, shaping...  ...risk ~ Strong technical foundation in embedded systems, hardware/software integration... 

    Jobleads-US

    San Francisco, CA
    1 day ago
  • $165k - $210k

    The RoleAt Candid Health, we’re searching for a Platform Technical Program Manager (TPM) to drive operational strategy alongside engineering and product leadership. As a dedicated partner embedded within our Platform Engineering team, you will own the team's long-term roadmap... 
    Temporary work
    Work at office
    Remote work

    Candid Health

    San Francisco, CA
    23 hours ago
  • $180.2k - $225.2k

     ...infrastructure, we need someone who can hold the full program together.The Senior Technical Program Manager for Credit and Lending will own end-to-end delivery...  ...management systems.How you workProduct-first. You evaluate everything through: what is the user problem, what... 

    Mercury

    San Francisco, CA
    23 hours ago
  •  ...where the hardest problems stop being technical and start being cross-cutting. Work arrives...  .... You would be our first Technical Program Manager, and you would own that layer. Not by...  ..., especially the reliability and evaluation problems that come with non-deterministic... 
    Work at office
    Flexible hours

    BackOps AI

    San Francisco, CA
    4 days ago
  •  ...are what get people building. Give non-technical builders the same visibility engineers...  ...systems that make agentic work observable and evaluated are what turn agents into something the...  ...the rollout, onboarding, and training programs that take a team from first demo to... 
    Local area

    Fluidstack

    San Francisco, CA
    1 day ago
  • $125k - $250k

     ...some of the earliest and most influential research in AI evaluation like FinanceBench, Lynx, SimpleSafetyTests, CopyrightCatcher...  ..., Gokul Rajaram, and more. Responsibilities As a Technical Program Manager at Patronus AI, you will run the production line that turns... 
    Work at office
    Immediate start

    Patronus AI, Inc.

    San Francisco, CA
    2 days ago
  •  ...Technical Program Manager San Francisco, California About HumanSignal Real-world data is the competitive edge in AI. HumanSignal...  ...datasets from scratch, recruit and manage the domain experts who evaluate model output, and run everything through our own platform,... 
    Worldwide

    HumanSignal

    San Francisco, CA
    2 days ago
  •  ...startups. We’ve raised $16M from top VCs and were YC W25. About the role We’re looking for a Technical Program Manager to own complex, time-sensitive data and evaluation programs for frontier AI labs, data vendors, and internal teams. You’ll turn ambiguous technical... 
    Full time
    Work at office
    Remote work
    Relocation
    Visa sponsorship

    Human Union Data, Inc.

    San Francisco, CA
    2 days ago
  •  ...Technical Program Manager III Our client is a unified analytics platform that helps organizations accelerate innovation by simplifying data...  ...Support, Product, Finance, and Leadership stakeholders. Investigate capacity constraints, service bottlenecks, and resource... 
    Hourly pay
    Full time
    Temporary work

    Ursus Inc

    San Francisco, CA
    4 days ago
  • $60 - $75 per hour

     ...Century Group is partnering with a client that is seeking a Technical Program Manager to assist their team. Exact compensation may vary based on...  ...-making for technology expansion, including vendor evaluations and onboarding processes. Requirements: A minimum... 
    Hourly pay

    Century Group

    San Francisco, CA
    2 days ago
  • $150k - $175k

     ...class team, and strong financial backing. We are hiring a Technical Program Manager to improve how product and engineering plan, coordinate, and...  ...and launch readiness across product and engineering. Evaluate developer workflow tools through structured pilots. Track... 
    Work at office
    Visa sponsorship

    Hooglee

    San Francisco, CA
    1 day ago
  • $120k - $160k

     ...and sources of truth (Linear, program reviews) that keep work...  ...execution framework for high-stakes technical roadmaps, giving teams the...  ...slowing down. Orchestration: Manage the technical roadmap from...  ...that keep delivery healthy - evaluation, onboarding, quality - and keep... 

    Charta Health

    San Francisco, CA
    3 days ago
  • $151.2k - $189k

     ...governments, and enterprises deploy them. We are hiring a Technical Program Manager to own day-to-day partnerships with frontier model developers...  ...major model developers to generate adversarial data, run evaluations, and publish benchmarks across jailbreaks, prompt... 
    Full time

    Scale AI

    San Francisco, CA
    1 day ago
  • $171k - $231.4k

    We are seeking an ambitious Technical Program Manager to join our Metrics and Data Platform team at Amazon Music. The Metrics and Data Platform...  ...coordinating release schedules- Experience building and evaluating system-level technical design- Experience developing and executing... 
    Local area
    Flexible hours

    Amazon

    San Francisco, CA
    4 days ago
  • $130k - $225k

     ...About the Role Lead complex data and evaluation programs for AI research teams and internal partners. You will turn evolving technical needs into reliable delivery processes...  ...difficulty, and reward distributions. Manage external vendors and improve delivery pipelines... 
    Full time
    Visa sponsorship

    Clera

    San Francisco, CA
    3 days ago
  • $146.4k - $235.38k

     .... With intelligent agreement management, Docusign unleashes business-...  ...). What you'll do Our Program Management team under the Commerce...  ...to market. The Senior Technical Program Manager will be responsible...  ...and development Evaluate existing processes and procedures... 
    Contract work
    Work experience placement
    Work at office
    Local area
    Remote work
    2 days per week

    DocuSign

    San Francisco, CA
    4 days ago
  •  ...Rad AI Product Manager Opportunity At Rad AI, we're on a mission...  .... In this role you'll own program delivery for Rad AI Reporting...  ...-lives end to end and being technical enough to roll up your sleeves...  ...(SQL, light Python/shell) to investigate issues. Clinical workflow... 
    Full time
    Work at office
    Remote work

    Rad AI

    San Francisco, CA
    3 days ago
  • $163.64k - $336.9k

     ...how we use AI in our recruiting process here.As a Sr. Staff Technical Program Manager for Search Signals at Pinterest, you will lead company-...  ...methodologies for signals management, data acquisition, and model evaluation.Shape the future of the signals domain at Pinterest... 
    Work at office
    Local area
    Remote work
    Relocation package

    Pinterest

    San Francisco, CA
    1 day ago
  • $150.1k - $227k

     ...is the future of AI, and you are the future of Salesforce.Technical Program Managers (TPMs) lead large-scale, cross-functional initiatives across...  ...intelligence (AI) tools to help our recruiters assess and evaluate candidates’ resumes and qualifications throughout the... 
    Full time

    Salesforce

    San Francisco, CA
    1 day ago
  • $152k - $190k

     ...customers, our communities, and ourselves. The Lead Technical Program Manager, Risk & Security will drive the cross-functional execution...  ...reliability, and IT operations teams. Strong ability to evaluate technical dependencies, surface emerging risks early, and... 
    Full time
    Flexible hours

    AppFolio

    San Francisco, CA
    3 days ago
  • $150k - $190k

     ...enables our customers’ missions. We’re looking for a Senior Technical Program Manager to join our Infrastructure team and help deliver complex...  ...The salary range for this role is intentionally wide as we evaluate individuals based on their unique experience and abilities... 
    Full time
    Temporary work
    Work at office
    Relocation package
    Flexible hours

    Loft Orbital Solutions

    San Francisco, CA
    3 hours ago
  • $257k - $335k

     ...Technical Program Manager, People Innovation Labs | OpenAI Careers Technical Program Manager, People Innovation Labs Technical Program...  ...Labs is a product, design, and engineering team embedded in the People organization. We build AI-powered products that... 
    Work at office
    Local area
    Relocation package
    Flexible hours

    Jobleads-US

    San Francisco, CA
    4 days ago
  •  ...breaking speeds. The Role Zipline's Program Management team is responsible for ensuring that...  ...on time and on budget. Our PMs are embedded across our 6 hardware teams and work directly...  ...You'll Do Understand and mitigate technical and program risks to keep Zipline's... 
    Full time
    Summer work
    Internship
    Summer internship
    Work at office
    Local area

    Zipline

    San Francisco, CA
    1 day ago
  • $257k - $335k

    # Technical Program Manager, People Innovation LabsOpenAISan Francisco (Hybrid)Full-time$257,000 - $335,000 / yearUpload your resume once and...  ...Innovation Labs is a product, design, and engineering team embedded in the People organization. We build AI-powered products that... 
    Permanent employment
    Full time
    Work at office
    Remote work

    Jobleads-US

    San Francisco, CA
    13 hours ago
  • $210k - $285k

     ...of Google's earliest product managers and co-creator of Google Maps...  ...Lead complex, cross-functional programs spanning cloud infrastructure...  ...Agent SDK engineers to shape technical requirements, manage...  ...job description. We strive to evaluate all applicants consistently without... 
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Technical Program Manager - Embedded Evaluations and Investigations. Be the first to apply!