Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Researcher, Agent Safety, Oversight and System Mitigations

Precision Labs

About the Team The Agent Safety team works to ensure that increasingly capable AI agents act safely, exercise sound judgment, and remain aligned with user intent. Our mission is to reduce the probability of severe unintended outcomes from increasingly capable AI agents while preserving their ability to act effectively and autonomously. Our work spans three areas: Training: Create training methods, environments and data that teach agents to make better decisions in consequential situations. We turn real-world failures into training signals that prevent similar incidents, and identify precursor behaviors and mitigations to address emerging risks. Measurements: Build evaluations and production metrics that identify emerging risks and measure whether our interventions work. Oversight: Develop oversight and system mitigation mechanisms that reduce harmful actions while preserving useful agent autonomy (for example future versions of auto-review). About the Role This role focuses on oversight and system-level mitigations that enable increasingly capable agents to operate safely and autonomously in real environments. We prioritize building oversight systems that are used in practice today, both internally and externally (see our recent work on action monitoring for codex and former code review). We also study longer-term questions about how increasingly capable agentis systems can be supervised, constrained, and corrected. We're looking for a safety&security minded researcher or engineer who can reason rigorously about security boundaries and agent behavior, then build and test practical mitigations. A background in AI control or security is welcome but not required. This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees. In this role, you will: Design, build, and evaluate system-level controls for agent actions like agent-based review. Plan how they fit in a broader system including sandboxing with process isolation and permission boundaries. Work closely with a Codex harness engineering team to productionize the AI controls. Red-team end-to-end agentic systems to measure whether controls prevent data exfiltration, unsafe tool use, and other harmful outcomes. Improve the safety-productivity tradeoff by measuring and reducing missed harmful actions, unnecessary blocks, approval burden, and latency. You might thrive in this role if you: Have strong systems or security instincts and can reason concretely about isolation boundaries, permissions, attack surfaces, and failure modes in complex systems. Enjoy turning ambiguous safety questions into concrete threat models, reproducible experiments, and practical mitigations, and revising your approach based on evidence from deployment. Can build robust experimental infrastructure and design evaluations that distinguish promising mitigations from brittle ones. Are deeply interested in frontier AI alignment, safety and control. About OpenAI OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. For additional information, please see OpenAI's Aff... Policy Statement. Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations. To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance. We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link. OpenAI Global Applicant Privacy Policy At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology. #J-18808-Ljbffr Precision Labs

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Researcher, Agent Safety, Oversight and System Mitigations in San Francisco, CA vacancy
  • $380k

    About the TeamThe Safety Systems team is responsible for various safety work to ensure our best...  .... This requires a breadth of new ML research to address the growing set of safety challenges...  ...areas of risk and proposing mitigation strategies.You might thrive in this role... 
    Suggested
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    3 days ago
  • $380k

     ...tools that assist humans to agents that can plan, execute,...  ...in the real world. Mitigating the frontier risks resulting...  ...of frontier AI systems.Mitigation. Keeping misuse...  ...are seeking exceptional researchers who can push the frontier of safety mitigations. You will help... 
    Suggested
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    3 days ago
  • About the Team: Our Safety Systems org ensures that OpenAI’s most capable models can be responsibly...  .... About the Role: We are seeking a Researcher in Privacy-Preserving Safety to help...  ...that enable robust harm detection and mitigation without exposing sensitive user data.... 
    Suggested

    openai

    San Francisco, CA
    3 days ago
  • $52 per hour

     ...leader in security and threat mitigation. We specialize in risk...  ...passionate about security and safety. Join our innovative team committed...  ...such as executive protection agents, intelligence analysts, armed...  ...Operating surveillance systems, alarms, and security technology... 
    Suggested
    Hourly pay
    Work at office
    Local area
    Flexible hours
    Shift work
    Night shift
    Weekend work

    Enhanced Protection Services

    San Francisco, CA
    1 day ago
  • $248.4k - $310.5k

     ...ScaleScale's mission is to develop reliable AI systems for the world's most important...  ...in production, paired with applied ML research, design, and evaluation to ensure these...  ...About the RoleAs Engineering Manager for Agent Oversight, you'll lead the team building our platform... 
    Suggested
    Full time

    Scale AI

    San Francisco, CA
    3 days ago
  • $150k - $250k

     ...manufacturing, consumer goods, and global social organizations.We research and deploy technologies that power AI-native operations — both...  ...Distyl itself. Our work spans research into self-constructing systems, the development of the most reliable execution of AI systems,... 
    Work at office
    3 days per week

    Distyl AI

    San Francisco, CA
    3 days ago
  • $380k

    About the TeamThe Safety Training research team aims to fundamentally advance our capabilities for precisely implementing safe behavior in AI models...  ...humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our... 
    Work at office
    Local area
    Remote work
    Flexible hours

    OpenAI

    San Francisco, CA
    3 days ago
  • ABOUT THE COMPANY We're building autonomous research agents for recursive self-improvement (multi-agent systems that propose, run, and analyze machine learning experiments). We're a small, well-funded team that works onsite in San Francisco. ABOUT THE ROLE You'll be researching... 
    Shift work

    MakerMaker.AI

    San Francisco, CA
    2 days ago
  • Harvey in San Francisco is seeking a legal researcher with a strong understanding of how law firms, financial institutions, and other organizations...  ..., and the role focuses on accelerating workflows with AI systems. You’ll partner with engineering, product, and design to... 

    Harvey

    San Francisco, CA
    4 days ago
  •  ...San Francisco is seeking a senior Safety/Alignment lead to build the safety...  ...function for Devin. You will shape the research agenda, evaluation, red-teaming,...  ..., deep understanding of agentic systems, and a track record shipping mitigations. You will hire and lead safety... 

    Jobleads-US

    San Francisco, CA
    3 days ago
  • $148k - $208k

     ...dense, high-agency AI safety team at Lila that...  ...), to identify and mitigate risks from...  ...evaluations, safety systems to mitigate risks, and a research agenda that explores...  ...term needs such as oversight of superintelligent...  ...scientific models, agents and automated experimentation... 
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences, Inc.

    San Francisco, CA
    1 day ago
  • $235.5k - $329.5k

     ...on powering the immune system to transform lives by...  ...Senior Director, Clinical Research Oncology Program...  ...resource needs, and risk mitigation strategiesPartner with...  ...resourced and provide oversight and input on major...  ...Operations, Biometrics, Safety, CMC/Technical Operations... 
    Full time
    Work at office
    Work visa
    3 days per week

    Vir Biotechnology

    San Francisco, CA
    3 days ago
  • $380k

     ...Assurance team strengthens OpenAIs safety decisions through independent...  ...consequential decisions about advanced AI systems. About the role As a researcher on Frontier Assurance you will...  ...relevant teams to test proposed mitigations and identify unresolved questions... 
    Full time

    OpenAI

    San Francisco, CA
    6 days ago
  • $100.4k - $186.4k

     ...people we love.The PositionThe Complex in Vitro Systems (CiS) Lab within the Department of Translational Safety is seeking a highly motivated Scientist 3/4 to develop...  ...Sciences, Translational Medicine, and Research to establish and implement innovative platforms that... 
    Local area

    Genentech

    South San Francisco, CA
    19 hours ago
  • $216k - $270k

    Scale Labs, Research Scientist — Safety Post TrainingAs the leading data and evaluation...  ...safeguarding AI models and systems. Building on this expertise...  ...the hardest problems in agent robustness, AI control...  ...the public understand and mitigate AI risk while maximizing AI... 
    Full time

    Scale AI

    San Francisco, CA
    4 days ago
  •  ...Proximal is building the research systems needed to identify what models can't yet do, build the...  .... Our early team has built coding agents and RL infrastructure at companies like...  ...problems end-to-end without heavy process or oversight Execution with excellence, even at... 

    Proximal LLC

    San Francisco, CA
    4 days ago
  • $116.2k - $146.7k

    Associate Professional Researcher - Andino LabThe Andino Laboratory at UCSF is seeking an Associate...  ..., infection models, high-throughput and systems-level analyses, and data interpretation...  ...and research technicians. This includes oversight of experimental design and execution,... 

    University of California, San Francisco

    San Francisco, CA
    3 days ago
  • $22 - $28 per hour

     ...regulations set forth by Expeditors, with safety being the priority. Ensure that shipments...  ...and advise supervisor of abuses Agents will closely work with the shift lead to...  ...habits. Must be familiar with warehouse systems. Fork-lift certification may be required... 
    Hourly pay
    Temporary work
    Part time
    Local area
    Flexible hours
    Shift work

    Expeditors

    Brisbane, CA
    2 days ago
  •  ...Night Audit Agent Palisociety is a society of unique hotels and residences Palihouse...  ...guest information and payments into hotel systems such as Opera. Communicate guest requests...  ..., and conduct walkthroughs for safety, security, and cleanliness. Reconcile... 
    Flexible hours
    Shift work
    Night shift
    Day shift

    Hotel Grand Stark

    San Francisco, CA
    19 hours ago
  • $139.6k - $225.78k

     ...a passionate and self-driven Sr. Staff Researcher to join our Cloud-Delivered Security Services...  ...You will build and optimize automation systems to process real-time data, collaborate...  ...traffic for threat detection and mitigation.Conduct in-depth research on network security... 
    Full time
    Work experience placement
    Work at office
    Visa sponsorship
    Work visa

    Palo Alto Networks

    San Francisco, CA
    2 days ago
  • Thinking Machines Lab Inc. in San Francisco is seeking a safety researcher to bridge research and hands-on engineering, focusing on making models safe and trustworthy. You will explore how training shapes refusals and how to evaluate boundaries, designing experiments to... 

    Thinking Machines Lab Inc.

    San Francisco, CA
    2 days ago
  •  ...founding engineer in San Francisco to build production software for AI agent security. You will own ambiguous engineering problems, from...  ...technical direction and execution. This role focuses on runtime systems, model/inference integrations, and production workflows that... 

    Greylock Partners

    San Francisco, CA
    4 days ago
  •  ...Corporate Security Agent/Emergency Response AgentCrisis24 is a global...  ...this role:Ensure the overall safety and security of protectees/...  ...employees.Monitoring security systems and technology tools for various...  ...to proactively identify and mitigate threats.Detect and report suspicious... 
    Local area
    Shift work
    Night shift

    Crisis24

    San Francisco, CA
    2 days ago
  •  ...outreach clients. Assure optimal safety and efficiency of all...  ..., and laboratory information system (LIS) functions. Involves...  ...STANDARDS Personnel Oversight/Management # Direct supervision...  ...through advanced biomedical research, graduate-level education in... 
    Traineeship
    Work experience placement
    Local area
    Immediate start
    Worldwide

    University of California , San Francisco

    San Francisco, CA
    1 day ago
  • $180k - $225k

     ...transformation through frontier AI systems that solve real...  ...build production AI agents that automate complex...  ...architectures, and research papers emerge every week...  ...execution, and human oversight.Translate frontier AI...  ...observability, latency, safety, and cost.Design agent... 
    Full time

    Scale AI

    San Francisco, CA
    19 hours ago
  • $189k - $260k

     ...Product Manager, Okta for AI Agents, you will drive the product strategy...  ...require for their enterprise systems. You will partner closely...  ...driving how agent access, oversight, and governance are rolled out...  ...work cross-functionally with research, design, engineering, and... 
    Local area
    Worldwide
    Flexible hours

    Okta

    San Francisco, CA
    19 hours ago
  •  ...site in the specified location(s).As an AI Researcher within Schwab’s Artificial Intelligence...  ...research and production‑grade AI systems that support millions of investors, advisors...  ...operating large‑language‑model‑based and agent‑driven systems, establishing robust evaluation... 
    Work at office

    Forge Global

    San Francisco, CA
    1 day ago
  • $96.7k - $257.1k

    Professional Researcher- Deitchman Lab Department of Clinical Pharmacy University of California, San FranciscoThe Department of Clinical...  ...of developing and leveraging innovative human tissue-based systems. Experience managing a diverse portfolio of collaborative projects... 

    University of California, San Francisco

    San Francisco, CA
    4 days ago
  • $302.4k - $378k

     ...and private evaluations.About the ACE team The Agent Capabilities & Environments (ACE) team, part of Scale’s Research organization, brings together customer-facing Researchers...  ...Scale, our mission is to develop reliable AI systems for the world's most important decisions. Our... 
    Full time

    Scale AI

    San Francisco, CA
    3 days ago
  • $216.3k - $280.8k

     ...AI, we are leading frontier AI research across Cisco. Our mission is...  ...multimodal learning, reasoning systems, scalable training algorithms,...  ...scaling agentic AI workflows, multi-agent frameworks, and autonomous AI...  ...security-focused use cases, safety, and robust machine learning.... 
    Full time
    Temporary work
    Local area
    Flexible hours

    CISCO Systems

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Researcher, Agent Safety, Oversight and System Mitigations. Be the first to apply!