Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Technical Governance Researcher

Machine Intelligence Research Institute

Machine Intelligence Research Institute Technical Governance Team Position

The Machine Intelligence Research Institute (MIRI) is a nonprofit based in Berkeley, California, focused on reducing existential risks from the transition to smarter-than-human AI. We've historically been very focused on technical alignment research. Since summer 2023, we have shifted our focus towards communication and AI governance. See our strategy update post for more details.

About the Role

In this role, you would have the chance to work on all of the above areas. The work will be a mixture of researching, writing (for internal and external use), and engaging with collaborators and policymakers. Most of the day-to-day work is a combination of reading, writing, and meetings. Some example activities could include:

  • Threat modeling, working out how AI systems could cause large-scale harm, and hopefully what actions could be taken to prevent this
  • Responding to a US government agency's Request for Comment
  • Learning about risk management practices in other industries, and applying these to AI
  • Designing and implementing evaluations of AI models, for example to demonstrate failure modes with current policy
  • Preparing and presenting informative briefings to policymakers, such as explaining the basics and current state of AI evaluations
  • Reading a government or AI developer's AI policy document, and writing a report on its limitations
  • Designing new AI policies and standards which address the limitations of current approaches
  • In the above work, maintain particular focus on what is needed for solutions to scale to smarter-than-human intelligence and conduct research on which new challenges may emerge at that stage

Who We're Looking For

There are no formal degree requirements to work on the team, however we are especially excited about applicants who have a strong background in AI Safety and have particular previous experience or familiarity working in (or as) one or more of:

  • Compute governance. Technical knowledge of AI hardware / chips manufacturing and related governance proposals.
  • Policy (including AI policy). Experience here could involve writing legislation or white papers, engaging with policy makers or other research in AI policy and governance
  • Strong AI Safety generalist. For example, you have produced good AI safety research and have a good overview-level understanding of empirical, theory and conceptual approaches, or otherwise have a demonstrated ability to think clearly and carefully about AI safety.
  • Bonus: Research or engineering focused on frontier AI models or the AI tech stack. The role may involve creating or running model evaluations, benchmarking AI hardware, conducting scaling law experiments, and other empirical work.

We are also excited about candidates who are particularly strong in the following areas:

  • Agency You get things done without someone constantly looking over your shoulder. You notice problems and are motivated to fix them. You focus on solving the problem, not waiting to be told what to do. You know when to defer to another's decision, and when to ask for guidance. You are an active member of the team, not a mindless cog in the machine.
  • Conscientiousness You are diligent and hard-working, and complete your work reliably and dependably. You desire to do tasks well and effectively. You pay attention to details and are organized, and able to manage lots of small tasks and projects.
  • Comfort learning on the job You enjoy and are able to quickly acquire new skills and knowledge as needed. You feel comfortable working on underspecified tasks where part of your job is to further develop the research questions appropriately.
  • Generative thinking You enjoy coming up with and iterating on new ideas. You can generate original work as well as extend others' thoughts. You aren't afraid to suggest things, or point out flaws in your or others' thoughts.
  • Communication (Internal) You are a team player who is excited to work together with others and willing to attend several weekly meetings. You proactively keep teammates/manager in the loop about the status of projects you manage, when things are falling behind, when you need more information. You voice your confusions.
  • Communication (External) You are able to communicate effectively to external stakeholders who have a range of technical expertise, including policymakers. You can produce concise, clear, and compelling writing, and deliver presentations on the team's research and ideas.

In addition, we are looking for candidates who:

  • Are broadly aligned with MIRI's values and willing to work toward MIRI's goals (i.e., the world needs to build an Off Switch for AI ), and the Technical Governance Team's research directions (e.g., those described in our research agenda )
  • Are passionate about MIRI's mission and excited to support our work in reducing existential risks from AI.

Logistics

  • Application deadline - No current deadline, we will evaluate applications as they come in.
  • Location Prefer in-office (in Berkeley, CA).
  • Compensation $120200k. The range is due to the wide possibility space of experience and skills that candidates may bring. We strive to ensure that all staff are paid an appropriate and comfortable living wage such that they feel fairly compensated and are able to focus on doing great work.
  • Benefits MIRI offers a variety of benefits including: Health insurance (the best available plans from Kaiser and Blue Shield) as well as dental and vision coverage. ("No vacation policy" staff are encouraged to take vacation when they want/need to in coordination with their manager).
  • Visas We can potentially sponsor visas for particularly promising candidates.
Machine Intelligence Research Institute
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Technical Governance Researcher in Berkeley, CA vacancy
  • $200k - $350k

     ...Mercor, Ramp, Midjourney, Apple, Jane Street and Zoox. This is a research-first role, not an engineering role: you'll own Pantheon's...  ...equity. Full-time, on-site in San Francisco. Interview: screening, technical chat with the RL research lead, 6-hour technical interview, 1–... 
    Suggested
    Full time
    H1b
    Work at office
    Visa sponsorship

    Pantheon

    San Francisco, CA
    13 days ago
  • About Redwood Research At Redwood Research, we strive to ensure the safe development of artificial intelligence through rigorous technical research, thoughtful analysis, and strategic advising. About the role As an empirical researcher, you will design and run experiments... 
    Suggested
    Full time
    Immediate start

    Redwood Research

    Berkeley, CA
    2 days ago
  • $7,029 per month

    Berkeley Lab's Energy Analysis (EA) Division performs innovative research to achieve competitive, affordable, and reliable energy...  ...multi-disciplinary projects that will develop process models, technical performance benchmarks, and prospective technoeconomic assessments... 
    Suggested
    Full time
    Contract work

    Lawrence Berkeley Lab

    Berkeley, CA
    3 days ago
  •  ...and interactive environments. We are looking for exceptional researchers to advance the simulation technologies that will power the next...  ...foundation in mechanics and physical modeling. You can derive governing equations, state the assumptions behind a model, and connect... 
    Suggested

    Moonlake

    San Francisco, CA
    1 day ago
  •  ...and interactive environments. We are looking for exceptional researchers to advance the simulation technologies that will power the...  ...intelligence. The Role We're looking for a Member of Technical Staff – Simulation Researcher to advance the scientific and technical... 
    Suggested
    Full time

    Moonlake

    San Francisco, CA
    4 days ago
  •  ...Member of Technical Staff: AI Research & Engineering in Media Integrity About Synhawk Synhawk builds omnimodal foundation models for communication integrity , aimed at infrastructure-side deployment in telco and banking sectors. Our platform analyzes the integrity... 
    Remote job
    Full time
    Internship
    Immediate start
    Shift work

    synhawk

    San Francisco, CA
    9 days ago
  •  ...physical world.   The Role We are looking for a Member of Technical Staff – Robotics to help build the bridge between simulation,...  ...and operating physical robots. You will work closely with researchers and engineers developing next-generation simulation environments... 
    Full time

    Moonlake

    San Francisco, CA
    9 days ago
  • $10k

     ...Company Description:   Halluminate is a data research lab building benchmarks and RL environments to push the frontier of AI in...  ...and processes ~ Detail oriented execution across projects, technical and problem solving skills to build and QA RL tasks ~ Fluency... 
    Full time
    H1b
    Work at office
    Relocation
    Visa sponsorship

    halluminate

    San Francisco, CA
    9 days ago
  • $142.08k - $307.9k

     ...position does not offer work visa sponsorship * The Vulnerability Researcher is responsible for analyzing systems, software, architectures,...  ...reports and presentations for client stakeholders including technical staff and executive leadership Maintains communication... 
    Work experience placement
    Local area
    Remote work

    Delta Dental of California

    San Francisco, CA
    1 day ago
  • $247k - $396k

     ...Aurora Technical Pathfinder Aurora's mission is to deliver the benefits of self-driving technology safely, quickly, and broadly. The...  ...PhD Graduate in AI, Computer Science, or Robotics (Top-tier research lab background) Deep expertise in Vision-Language Models (VLM... 
    Work at office
    Local area
    3 days per week

    Aurora CO

    San Francisco, CA
    2 days ago
  • $5,957 - $9,234 per month

     ...the Accelerator Technology & Applied Physics (ATAP) Division at Lawrence Berkeley National Laboratory, is seeking a Postdoctoral Researcher to develop artificial intelligence (AI) and machine learning methods for accelerator physics and operations. You will... 
    Full time
    Contract work
    Work at office
    Shift work

    Lawrence Berkeley Lab

    Berkeley, CA
    2 days ago
  • $6,790 per month

     ...Lawrence Berkeley National Laboratory (LBNL) Climate and Ecosystem Sciences Division is seeking an innovative Postdoctoral Researcher to investigate the controls of soil carbon and nutrient cycling, and how these cycles are affected by soil temperature and soil depth.... 
    Full time
    Contract work
    Remote work
    Night shift

    Lawrence Berkeley Labs

    Berkeley, CA
    17 hours ago
  •  ...Security Researcher We believe that software is the foundation of modern civilization - yet vulnerabilities threaten its integrity,...  ...deep expertise in data, infrastructure, security and LLMs with technical leaders from DeepMind, Databricks, Square, and Faire. We are looking... 
    Full time
    Work at office

    DepthFirst

    San Francisco, CA
    1 day ago
  • $6,790 per month

     ...Hydrologic Modeling. About the position You will conduct research as part of an interdisciplinary team of scientists from LBNL’s...  ...computing. Author peer-reviewed journal articles and technical reports. We are looking for: Ph.D. in hydrology, civil,... 
    Full time
    Contract work
    Remote work

    Lawrence Berkeley Lab

    San Francisco, CA
    3 days ago
  •  ...Job Description Job Description Our client, an AI healthcare software startup, is seeking a Member of Technical Staff (Research Scientist) to join their team. In this role, you'll be at the forefront of developing benchmarks and evaluation methodologies for large language... 
    H1b
    Relocation

    Thomas Talent Network

    San Francisco, CA
    21 days ago
  •  ...World-Class Team: You'll work directly with some of the best AI researchers and engineers in the world in a small, mighty, and fast-paced...  ...teams to synthesize high-impact needs, design and implement technical solutions, and communicate deliverables and tradeoffs.... 
    Work at office
    Visa sponsorship

    Spellbrush

    San Francisco, CA
    17 hours ago
  •  ...idea of breaking down the final barrier among peoples of the world — the language barrier. We are currently seeking a content researcher to find foreign news stories for translation, as well as English-original foreign opinions for direct linkage to the site. Though... 
    Remote work
    1 day per week

    Watching America

    Oakland, CA
    3 days ago
  • $148.5k - $223.9k

     ....The ExperienceWe are looking for a Senior Offensive Security Researcher with an attacker mindset to discover, analyze, and remediate security...  ...findings into clear, actionable guidance for engineers and technical leadership.Strong communication and collaboration skills, with... 
    Full time

    Salesforce

    San Francisco, CA
    3 days ago
  • $184k - $238.8k

     ...notice. Meet the TeamAt Foundation AI, we are leading frontier AI research across Cisco. Our mission is to advance the state of AI. We...  ...have opportunities to contribute to open-source projects, technical writing, and collaborative research.In this role, you will:Build... 
    Full time
    Temporary work
    Local area
    Flexible hours

    CISCO Systems

    San Francisco, CA
    2 days ago
  • $96.7k - $257.1k

    Professional Researcher in Molecular Imaging and Neurobiology of Neurodegenerative ProteinopathiesThe Institute for Neurodegenerative Diseases...  ...& Molecular Biology, Biotechnology, or related field. Technical Qualifications Require d: 5+ years of experience in molecular... 
    Traineeship

    University of California, San Francisco

    San Francisco, CA
    17 hours ago
  • $216.3k - $280.8k

    Meet the TeamAt Foundation AI, we are leading frontier AI research across Cisco. Our mission is to advance the state of artificial intelligence...  ...a Senior AI Researcher you will operate as a visionary technical leader, architecting and executing frontier AI research that... 
    Full time
    Temporary work
    Local area
    Flexible hours

    CISCO Systems

    San Francisco, CA
    3 days ago
  • $96.7k - $257.1k

    Researcher, NeurosciencePosition Overview We are seeking an experienced and highly motivated Researcher to investigate the molecular mechanisms...  ...to develop experimental strategies, troubleshoot complex technical challenges, and continuously improve research methodologies to... 

    University of California, San Francisco

    San Francisco, CA
    4 days ago
  •  ...RoleWe are looking for a Principal AI Researcher to join our growing AI team and help build...  ....You can set a two-to-four-quarter technical direction and then get a team to execute...  ...data, empowering providers, payers, and government organizations to deliver intelligent and... 
    Full time
    Temporary work
    Internship
    Immediate start

    Innovaccer

    San Francisco, CA
    1 day ago
  • $256.9k - $333.4k

     ...autonomous systems.Join Cisco’s AI Threat Intelligence and Security Research team to design the frontline defense for enterprise AgenticOps...  ...the field through open-source projects, industry frameworks, technical publications, customer and partner engagement, and education!... 
    Full time
    Temporary work
    Work experience placement
    Local area
    Flexible hours

    CISCO Systems

    San Francisco, CA
    4 days ago
  • $131k - $196k

     ...actually happened, and it is ours.We're growing fast and hiring the Research talent to match.We're looking for a Design Researcher to help...  ...platform engineering managers across multiple teams, present technical priorities to executive stakeholders, and align with... 
    Immediate start

    MaintainX

    San Francisco, CA
    2 days ago
  • $184.7k - $324.8k

     ...organization sits at the nexus of these systems—where deep applied research, advanced machine learning, and large language models converge...  ..., and advanced NLP systems. This role is ideal for a hands-on technical leader who has taken novel ideas from research inception to... 
    Relocation

    Apple

    San Francisco, CA
    3 days ago
  • $216.3k - $280.8k

     ...observability and control.Your ImpactYou will independently own applied research problems that help organizations understand, evaluate, and...  ...research methods into production workflows.Communicate technical findings through research code, experimental reports, model documentation... 
    Full time
    Temporary work
    Local area
    Remote work
    Flexible hours

    CISCO Systems

    San Francisco, CA
    4 days ago
  •  ...on investigation of phishing, BEC, and malware campaigns with research and thought leadership that advances the broader cybersecurity...  ...Excellent written and verbal communication skills — able to translate technical findings into impactful narratives for both executives and... 
    Flexible hours

    Aegis AI Security

    San Francisco, CA
    17 hours ago
  •  ...company knowledge with fiduciary-grade governance and compliance.   Fortune 500 companies...  ....com .     About the role AI research at WRITER isn't just about publishing papers...  ...complex ideas with clarity to both technical and non-technical audiences ~ you Challenge... 
    Full time
    Local area
    Flexible hours

    Writer Corporation

    San Francisco, CA
    3 days ago
  •  ...and for society. About the role Preparedness is hiring strong technical executors to support preparations for accelerated AI...  ...team alternates between performing rigorous hypothesis-driven research and turning our insights into interventions or control systems... 

    OpenAI, Inc.

    San Francisco, CA
    17 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Technical Governance Researcher. Be the first to apply!