Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Lead - AI Cyber Testing & Evaluation

$146.2k - $261.4k

Dormont Manufacturing Co

Job Type Term (Fixed Term) Position Description RAND’s Center on AI, Security, and Technology (CAST), part of the Global and Emerging Risks (GER) Division conducts cutting‑edge research on transformative, high‑impact technologies—including artificial intelligence and biotechnology—to shape policies that protect global security and advance the public good. You will be responsible for managing significant research budgets and personnel, overseeing complex technical research and policy analysis projects, and leading multidisciplinary teams of policy researchers, engineers, and scientists. Your team will build systems to evaluate how AI models perform across the full attack lifecycle, including resource development, initial access, discovery, lateral movement, and defense evasion. Your projects may include developing benchmarks for fully autonomous operations using scaffolding and tools, as well as uplift of both novice and expert humans. Such benchmarks may involve environments like CTF challenges, frameworks for assessing ability to reason over attack graphs and conduct multi‑stage operations, assessment of stealth and defense evasion capabilities, and benchmarks for ability to conduct time‑sensitive operations at machine speed. Many of your evaluations will be commissioned directly by relevant government agencies, and the results of your evaluations will drive responsible AI policy across the world. Your team will communicate findings through detailed technical analyses, evaluation frameworks, and quick‑turnaround policy briefs. Your work will inform analysis delivered to senior government and industry leaders. This position is structured as a two‑year appointment with options to renew and explore opportunities for longer‑term employment at RAND thereafter. RAND’s reputation for excellence is built on our commitment to high‑quality, rigorous analysis and objectivity. As a Research Lead - AI Cyber Testing & Evaluation, you’ll maintain that excellence while engaging with some of the most pressing challenges of our time. Qualifications All research positions at RAND require excellent analytic skills; the ability to communicate clearly and effectively, both orally and in writing; the ability to work effectively as a member of a multi‑disciplinary team; and a strong commitment to RAND’s core values of quality and objectivity. Required 6+ years of technical experience in security engineering, software engineering, firmware engineering, hardware engineering, or related fields 6+ years of technical management experience, including leading cross‑functional teams, managing project budgets, and mentoring and developing team members Demonstrated ability to successfully lead complex projects to completion Proficiency in Python, Java, C/C++, or other popular programming languages Experience with red team operations or offensive cyber capabilities development Ability to develop rigorous and comprehensive threat models and identify potential system vulnerabilities Strong ability to communicate effectively in English, both verbally and in writing Ability to work effectively in a collaborative, multidisciplinary environment Fluency with MS Office suite Preferred Graduate of the Computer Network Operations Development Program (CNODP), Remote Interactive Operator Training (RIOT), Future Operator Readiness Growth and Enrichment (FORGE), or equivalent experience Understanding of advanced persistent threat (APT) tactics, techniques, and procedures (TTPs) and experience with defending against them Ability to think creatively about offensive and/or defensive techniques and strategies, beyond compliance with existing regulations Experience working on AI research, ML model training, or model deployment Education Requirements RAND is hiring a Research Lead at either the specialist or expert level of experience. Minimum education requirements at the specialist level include: A PhD in Computer Science, Computer Engineering, Electrical Engineering, Cybersecurity, Information Security, Information Technology, Mathematics, Applied Mathematics, Physics, Applied Physics, Engineering Physics, Artificial Intelligence, Machine Learning, Engineering and Public Policy, Technology and Policy, National Security Policy, Policy Analysis, Political Science, International Relations, or similar with at least 3 years of relevant professional experience is required. OR A Master’s degree in the fields listed above with at least 6 years of relevant professional experience is required. OR A Bachelor’s degree in the fields listed above with at least 8 years of relevant professional experience is required. Master’s or PhD preferred. Security Clearance Ability to obtain and maintain a U.S. government clearance is preferred but not required. Location We are hiring for this position in San Francisco, CA; Washington, DC; Santa Monica, CA; Pittsburgh, PA; and Boston, MA. We offer a hybrid work arrangement, combining work from home and on‑site options. Fully remote work will also be considered. Writing or Code Sample Either a writing sample or a code sample is required for this position. This sample can use a recent, previously written paper or technical report (e.g., journal article, master’s thesis or paper written for coursework, research project, technical analysis, briefings), or source code showing technical expertise in relevant domains. Term This position is a 3‑year term appointment with a possibility of renewal, alongside options for longer term employment. Salary Range $146,200 - $261,400 Visiting Technical Specialist = $146,200 - $211,900 Visiting Technical Expert = $167,300 - $261,400 RAND considers a variety of factors when formulating an offer, including but not limited to, the specific role and associated responsibilities; a candidate’s work experience, education/training, skills, expertise; and internal equity. Successful candidates will be offered employment in a specific title, as determined by the candidate’s education and experience. The salary range includes base pay plus RAND’s sabbatic pay (which provides additional compensation above base pay when vacation is taken). In addition, RAND provides strong benefits including health insurance coverage, life and disability insurance, savings plan, paid time‑off and more. Equal Opportunity Employer #J-18808-Ljbffr Dormont Manufacturing Co

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Research Lead - AI Cyber Testing & Evaluation in San Francisco, CA vacancy
  • Dormont Manufacturing Co in California is hiring a Research Lead for AI Cyber Testing & Evaluation. This role requires managing research budgets and leading teams in technical evaluations of AI performance and security policies. The ideal candidate has a strong background... 
    Cyber

    Dormont Manufacturing Co

    San Francisco, CA
    2 days ago
  • $167.3k - $261.4k

    Senior Research Lead - AI Security Portfolio page is loaded## Senior Research Lead - AI Security...  ...advanced AI systems, understanding their cyber capabilities, and informing the policy...  ...AI security research, cyber capability evaluation, and infrastructure development. Your work... 
    Cyber
    Fixed term contract
    Work experience placement
    Remote work
    Work from home

    RAND Corporation

    San Francisco, CA
    1 day ago
  • $228k - $358k

     ...talent-dense, high-agency AI safety team at Lila...  ...and capability-focused evaluations and safeguards. What You...  ...Evaluations to test for scientific risks (both...  ...Broader, high-quality research efforts - as and when needed...  ...team exercises, for CBRN/cyber risks (or for frontier... 
    Cyber
    Full time
    Work at office
    Local area
    Flexible hours

    Alumni Ventures

    San Francisco, CA
    2 days ago
  •  ...Services Pvt Ltd. is seeking a Cybersecurity Expert to remotely evaluate AI-generated outputs related to cybersecurity and provide...  ...skills, and proficiency in incident response and penetration testing. Compensation includes task-based pay, a weekly performance bonus... 
    Suggested
    Remote job
    Hourly pay
    Weekly pay

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    1 day ago
  • Gravity Engineering Services Pvt Ltd. is looking for a Technical Program Manager for Research to define and build programs essential for research teams at the cutting edge of AI development. This role requires engagement across complex and ambiguous research initiatives... 
    Suggested

    Gravity Engineering Services Pvt Ltd.

    San Francisco, CA
    3 days ago
  • $325k

     ...driving our commitment to AI safety and fostering a...  ...The Threat Modeling Lead will own OpenAI’s holistic...  ...role ensures that our evaluation frameworks, safeguards,...  ...all misuse areas (bio, cyber, attack planning, etc.)...  ...to both capability testing and safeguard sufficiency... 
    Cyber
    Work at office
    Local area
    Relocation package
    Flexible hours

    Dormont Manufacturing Company

    San Francisco, CA
    4 days ago
  • $77k - $202k

     ...variety of stakeholders. They evaluate compliance with regulations including...  ...and managed services, using AI and other risk technology and...  ...expertise, in areas like cyber, forensics and compliance, to...  ...risk assessments and controls testing Address IT management and cyber... 
    Cyber
    Full time
    H1b

    PowerToFly

    San Francisco, CA
    4 days ago
  • $148.5k - $223.9k

    ## Adversarial AI & Research EngineerApplyremote type: Remote Home-Basedlocations...  ...your career at the company leading workforce transformation in...  ...tooling, and foundational testing methodologies for both...  ...frameworks or large-scale evaluation pipelines.* Familiarity with... 
    Remote work
    Shift work

    Salesforce, Inc.

    San Francisco, CA
    2 days ago
  • $155k - $410k

     ...protecting organisations from cyber threats through...  ...assessments and vulnerability testing of cloud-based systems,...  ...you need to lead and deliver value at this...  ...management across analytics and AI ecosystems Define...  ...with team members. We evaluate these factors... 
    Cyber
    Full time
    Temporary work
    H1b

    PwC

    San Francisco, CA
    2 days ago
  •  ...Engineer (Remote) role at Jobright.ai 1 day ago Be among the first 25...  ...and Scale Innovative Tools: Lead development of novel, high-...  ...scalable architecture, clean code, testing best practices, and developer...  ...-$215,000.00 2 weeks ago Staff Cyber Security Engineer - GRC Automation... 
    Cyber
    Remote job
    Full time

    Jobright.ai

    Mill Valley, CA
    4 days ago
  • $293k - $405k

     ...is a critical Safety Research team at OpenAI, focused on mitigating AI threats to global security...  ...become a dangerous cyber threat. People in...  ...on measures with long lead times that benefit from...  ...preparation. Stress‑test defenses with AI agent evaluations and penetration tests... 
    Cyber

    The Consulting Solutions

    San Francisco, CA
    19 hours ago
  • $29 per hour

    A leading AI talent connector based in San Francisco is looking for an AI Red Team Specialist. This role involves evaluating AI models for vulnerabilities and generating human data for testing. Candidates should have native-level fluency in English and Brazilian Portuguese... 
    Cyber
    Remote job
    Hourly pay
    Full time
    Contract work
    Part time

    Mercor

    San Francisco, CA
    3 days ago
  •  ...next generation of AI. The Data Center Engineering...  ...support OpenAI research, products, and...  ...systems background to lead the design and...  ...OT network designs, evaluates vendor solutions, and...  ..., certifications, test reports, and quality...  ..., lockout/tagout, cyber hygiene, and change... 
    Cyber
    For contractors
    Work at office
    Remote work

    OpenAI

    San Francisco, CA
    5 days ago
  • $185k - $220k

     ...Notion is the collaborative AI workspace where teams and agents...  ...strategic and technically fluent Lead, IT Audit to join our Finance...  ...AI and automation into how we test and monitor controls, and...  ...walkthroughs, testing, deficiency evaluation, remediation, and reporting —... 
    Full time
    Local area

    Notion

    San Francisco, CA
    1 day ago
  • $320k

     ...interpretable, and steerable AI systems. We want AI to...  ...group of committed researchers, engineers, policy...  ...This role builds the evaluation infrastructure that answers...  ...system — defining metrics, test cases and grading...  ...across harm areas (e.g., cyber attacks, bio weapons, influence... 
    Cyber
    Visa sponsorship

    United States Digital Space LLC

    San Francisco, CA
    4 days ago
  • $90k - $110k

    Common Sense Media is seeking an Evaluations Partner Manager in San Francisco, California. This role involves managing the operational execution of the Youth AI Safety Institute's evaluation work, with responsibilities such as coordinating workflow between internal teams... 
    Full time

    Common Sense Media

    San Francisco, CA
    4 days ago
  • About the Role Hopper is looking for a Lead, Finance Analytics & Enablement AI/ML to own our data warehouse,...  ...systems, prompt design, and AI model evaluation frameworks. Familiarity with automation...  ...— questioning assumptions, stress‑testing processes, and always asking why... 
    Work experience placement
    Work from home

    Drive Capital

    San Francisco, CA
    4 days ago
  • Cartesia is seeking an Evaluations Lead in San Francisco to design evaluation frameworks for AI models. This role involves defining key model capabilities, developing evaluation pipelines, and partnering with various teams to ensure robust evaluations. Ideal candidates... 

    Cartesia, Inc.

    San Francisco, CA
    3 days ago
  • $176k - $253k

    Harper Group, an AI-native commercial insurance company in San Francisco, is looking for a Senior Member of Technical Staff focused...  ...vague estimations to concrete metrics, ensuring agents are evaluated, tested, and monitored effectively. Candidates should have experience... 

    Harper Group

    San Francisco, CA
    2 days ago
  • $224k - $241k

     ...of 300+ experts, DT is leading the charge in digital transformation...  ...including Cyber Defense, Identity Management...  .... Our focus includes AI adoption, cloud...  ...including system integration, testing, deployment, user...  ...selection process will include evaluation of applications in... 
    Cyber
    Hourly pay
    Full time
    Contract work
    Temporary work
    Work experience placement
    Second job
    Work at office
    Immediate start
    Remote work
    Night shift
    2 days per week

    TryApplyNow

    San Francisco, CA
    4 days ago
  •  ...Autonomous Detection Layer designed to fight AI with AI. We aren't just "bolting on" a...  ...Your Role: Detection Architect & Adversarial Lead You won't just be writing detections; you'...  ...the tech that defines the next decade of cyber defense, let’s talk. #J-18808-Ljbffr... 
    Cyber
    Live in

    Cerebras

    San Francisco, CA
    1 day ago
  • $2,150 per month

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Role Responsibilities Review and evaluate AI-generated outputs related to threat...  ...hunting queries, and penetration testing reports. Annotate, label, and validate... 
    Cyber
    Hourly pay
    Contract work
    Part time
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    8 days ago
  • $150k - $250k

     ...0.00 / year Job Title: AI Systems and Innovation...  ...built on ASP.NET, and for leading the development of an...  ...and workflow automation Evaluate and implement practical...  ...‑use guidelines. Research and pilot emerging AI tools...  ...CD pipeline standards, testing procedures, and technical... 
    For contractors
    Work at office
    Local area

    Kai Ming, Inc.

    San Francisco, CA
    2 days ago
  • $102.17k

     ...models, geospatial data, and AI/machine learning, we...  ...Team as a Senior Cyber Security Analyst, where...  ...detect emerging threats. • Lead response efforts for complex...  ..., penetration tests, and simulated attack scenarios...  ...remediation efforts. • Research advanced threat actors and... 
    Cyber
    H1b

    Trinnex

    San Francisco, CA
    4 days ago
  •  ...technology stack for intelligent cyber security. Designed for enterprise...  ...happen. If you've ever wanted to lead data infrastructure at the intersection of AI, defense, and cyber security—this...  ...environments Develop performance testing and stress-testing frameworks to identify... 
    Cyber

    Alaris

    San Francisco, CA
    3 days ago
  • $158k - $215k

     ...quietly, relentlessly, and with resolve. As cyber threats grow faster and smarter, we...  ...source innovations and fueled by industry‑leading AI technology, Corelight helps teams detect...  ...of our innovation, where open‑source research meets cutting‑edge detection. As a Technical... 
    Cyber

    Corelight

    San Francisco, CA
    3 days ago
  • A leading cybersecurity firm is seeking a Security Researcher to identify vulnerabilities in their AI agent runtime. The ideal candidate will have deep experience in application security and penetration testing, along with a strong background in system-level reasoning.... 
    Remote job
    Contract work

    OpenCompany

    San Francisco, CA
    2 days ago
  • $140k - $180k

     ...mission-driven Threat Intel Research Engineer to join our...  ...insider risk and workforce cyber intelligence. Key...  ...Engineering Ownership: Lead QE efforts for the Intelligence team, including test automation, regression validation...  ...UEBA. Exposure to ML/AI techniques for detection... 
    Cyber
    Remote work

    DTEX Systems Inc.

    San Francisco, CA
    5 days ago
  • Anthropic is seeking a Research Lead for the Training Insights team to shape the evaluation of model capabilities. This hands-on leadership role involves developing innovative...  ...You will play a crucial role in transforming how AI capabilities are assessed, working... 
    Remote work

    Anthropic

    San Francisco, CA
    6 days ago
  •  ...to join a team focused on the evaluation, enhancement, and maintenance...  ...infrastructure, and the associated systems testing, vulnerability assessments,...  ...testing Experience with cyber threat information collection...  ...use artificial intelligence (AI) tools to support parts of the... 
    Cyber
    Full time
    Local area
    Monday to Friday
    Flexible hours

    CGS Federal (Contact Government Services)

    San Francisco, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Lead - AI Cyber Testing & Evaluation. Be the first to apply!