Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Lead - AI Cyber Testing & Evaluation

$146.2k - $261.4k

Employment Opportunities Inc

Research Lead - AI Cyber Testing & Evaluation

RAND's Center on AI, Security, and Technology (CAST), part of the Global and Emerging Risks (GER) Division conducts cutting-edge research on transformative, high-impact technologies—including artificial intelligence and biotechnology—to shape policies that protect global security and advance the public good.

You will be responsible for managing significant research budgets and personnel, overseeing complex technical research and policy analysis projects, and leading multidisciplinary teams of policy researchers, engineers, and scientists. Your team will build systems to evaluate how AI models perform across the full attack lifecycle, including resource development, initial access, discovery, lateral movement, and defense evasion.

Your projects may include developing benchmarks for fully autonomous operations using scaffolding and tools, as well as uplift of both novice and expert humans. Such benchmarks may involve environments like CTF challenges, frameworks for assessing ability to reason over attack graphs and conduct multi-stage operations, assessment of stealth and defense evasion capabilities, and benchmarks for ability to conduct time-sensitive operations at machine speed.

Many of your evaluations will be commissioned directly by relevant government agencies, and the results of your evaluations will drive responsible AI policy across the world. Your team will communicate findings through detailed technical analyses, evaluation frameworks, and quick-turnaround policy briefs. Your work will inform analysis delivered to senior government and industry leaders.

This position is structured as a two-year appointment with options to renew and explore opportunities for longer-term employment at RAND thereafter.

RAND's reputation for excellence is built on our commitment to high-quality, rigorous analysis and objectivity. As a Research Lead - AI Cyber Testing & Evaluation, you'll maintain that excellence while engaging with some of the most pressing challenges of our time.

Qualifications

All research positions at RAND require excellent analytic skills; the ability to communicate clearly and effectively, both orally and in writing; the ability to work effectively as a member of a multi-disciplinary team; and a strong commitment to RAND's core values of quality and objectivity.

Required:

  • 6+ years of technical experience in security engineering, software engineering, firmware engineering, hardware engineering, or related fields
  • 6+ years of technical management experience, including leading cross-functional teams, managing project budgets, and mentoring and developing team members
  • Demonstrated ability to successfully lead complex projects to completion
  • Proficiency in Python, Java, C/C++, or other popular programming languages
  • Experience with red team operations or offensive cyber capabilities development
  • Ability to develop rigorous and comprehensive threat models and identify potential system vulnerabilities
  • Strong ability to communicate effectively in English, both verbally and in writing
  • Ability to work effectively in a collaborative, multidisciplinary environment
  • Fluency with MS Office suite

Preferred:

  • Graduate of the Computer Network Operations Development Program (CNODP), Remote Interactive Operator Training (RIOT), Future Operator Readiness Growth and Enrichment (FORGE), or equivalent experience
  • Understanding of advanced persistent threat (APT) tactics, techniques, and procedures (TTPs) and experience with defending against them
  • Ability to think creatively about offensive and/or defensive techniques and strategies, beyond compliance with existing regulations
  • Experience working on AI research, ML model training, or model deployment
Education Requirements

RAND is hiring a Research Lead at either the specialist or expert level of experience. Minimum education requirements at the specialist level include:

A PhD in Computer Science, Computer Engineering, Electrical Engineering, Cybersecurity, Information Security, Information Technology, Mathematics, Applied Mathematics, Physics, Applied Physics, Engineering Physics, Artificial Intelligence, Machine Learning, Engineering and Public Policy, Technology and Policy, National Security Policy, Policy Analysis, Political Science, International Relations, or similar with at least 3 years of relevant professional experience is required.

OR

A Master's degree in the fields listed above with at least 6 years of relevant professional experience, is required.

OR

A Bachelor's degree in the fields listed above with at least 8 years of relevant professional experience, is required.

Master's or PhD preferred.

Security Clearance

Ability to obtain and maintain a U.S. government clearance is preferred but not required.

Location

We are hiring for this position in San Francisco, CA; Washington, DC; Santa Monica, CA; Pittsburgh, PA; and Boston, MA. We offer a hybrid work arrangement, combining work from home and on-site options. Fully remote work will also be considered.

Writing or Code Sample

Either a writing sample or a code sample is required for this position. This sample can use a recent, previously written paper or technical report (e.g., journal article, master's thesis or paper written for coursework, research project, technical analysis, briefings), or source code showing technical expertise in relevant domains.

Term

This position is a 3-year term appointment with a possibility of renewal, alongside options for longer term employment.

Salary Range: $146,200 - $261,400

Visiting Technical Specialist = $$146,200 - $211,900

Visiting Technical Expert = $167,300 - $261,400

RAND considers a variety of factors when formulating an offer, including but not limited to, the specific role and associated responsibilities; a candidate's work experience, education/training, skills, expertise; and internal equity. Successful candidates will be offered employment in a specific title, as determined by the candidate's education and experience. The salary range includes base pay plus RAND's sabbatic pay (which provides additional compensation above base pay when vacation is taken). In addition, RAND provides strong benefits including health insurance coverage, life and disability insurance, savings plan, paid time-off and more.

Equal Opportunity Employer

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Research Lead - AI Cyber Testing & Evaluation in Boston, MA vacancy
  • $146.7k - $214.8k

     ...If you enjoy vulnerability research, crash analysis, reverse engineering...  ...reports, summaries, and testing methodologies Research emerging...  ..., Electrical Engineering, Cyber Security, or other tech-related...  ...protect organizations in the AI era - and beyond. We've been innovating... 
    Cyber
    Full time
    Temporary work
    Local area
    Remote work
    Flexible hours

    Cisco

    Boston, MA
    1 day ago
  • $40 per hour

    A technology firm specializing in cybersecurity is seeking experienced cybersecurity professionals to help train AI models. In this role, you will evaluate AI-generated security content and solve technical problems to strengthen AI's reasoning. Candidates should have 2... 
    Cyber
    Hourly pay
    Remote work

    DataAnnotation

    Boston, MA
    3 days ago
  • $60 per hour

     ...contribute to developing cutting-edge AI systems, while enjoying the...  ...‑art AI models on tasks like evaluating AI‑generated security content,...  ...role — such as penetration testing, red teaming, incident...  ...including government or military cyber operations. Some coding experience... 
    Cyber
    Hourly pay
    Full time
    Remote work
    Flexible hours

    DataAnnotation

    Boston, MA
    2 days ago
  • $40 per hour

     ...seeking experienced professionals for a remote position focused on evaluating AI-generated security content. Candidates should have over 2 years of experience in cybersecurity, with skills in penetration testing, incident response, and vulnerability assessments.... 
    Suggested
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Boston, MA
    3 days ago
  •  ...Sr. Cyber Security Analyst Locations: Waltham, MA / Boston, MA - Hybrid / New York...  ...improvements. Adopt and extend AI-assisted security tooling to reduce toil...  ...and DLP solutions. ~ Experience with evaluating and testing the security of Public Cloud (AWS, Azure... 
    Cyber
    Ongoing contract
    Temporary work
    Remote work

    SS&C Technologies Holdings

    Boston, MA
    2 days ago
  • $110k - $138k

     ...these integrated systems through test. We focus on the capabilities...  ...on Air Force, Navy, and DARPA research programs. Role The SAAM group...  ...with ability to critically evaluate data, identify insights, and draw...  ..., and national security in cyber; next generation sensors, radar... 
    Cyber
    Full time
    Local area
    Remote work
    Night shift

    STR

    Boston, MA
    1 day ago
  • $130.9k - $154k

     ...providing independent testing and audit coverage of technology...  ...over information and cyber security areas,...  ...Responsible for tracking and evaluating the adequacy and...  ...of control function by leading periodic control certifications...  ...and PowerPoint. ~*AI Requirements: *... 
    Cyber
    Local area

    Coinbase

    Boston, MA
    3 days ago
  •  ...We're looking for a hands-on Cyber Security Engineer to sit at the intersection of AI-driven tooling and real-world security research. In this role, you'll own the end-to-end triage...  ...vulnerability research, or penetration testing roleDemonstrated CTF experience through... 
    Cyber

    Theori, Inc.

    Cambridge, MA
    2 days ago
  • $230k - $280k

     ...Platform unites agentic AI solutions with the...  ...community of security researchers to continuously discover...  ...continuous reduction of cyber risk for enterprises. Industry...  ...in AI Security Testing and has been named a Most...  ...metrics, observability, evaluation frameworks, and continuous... 
    Cyber
    Apprenticeship
    Work at office
    Local area
    Remote work
    Flexible hours
    Shift work
    1 day per week

    HackerOne

    Boston, MA
    4 days ago
  •  ...real business value with AI. What You’ll Do...  ...leaders to assess risk, evaluate the effectiveness of controls...  ...Plan, lead, and execute risk‑based...  ...Technology, Information/Cyber Security, or a related...  ...audit planning, control testing, and issue validation.... 
    Cyber
    Permanent employment
    Remote work
    Flexible hours

    Teradata

    Boston, MA
    1 day ago
  • $155k - $410k

     ...protecting organisations from cyber threats through...  ...assessments and vulnerability testing of cloud-based systems,...  ...you need to lead and deliver value at this...  ...management across analytics and AI ecosystems Define...  ...with team members. We evaluate these factors... 
    Cyber
    Full time
    Temporary work
    H1b

    PwC

    Boston, MA
    15 hours ago
  •  ...Assurance (SQA) Engineer. This role focuses on end-to-end quality assurance testing, covering data pipelines, API integrations, backend services, user interfaces, and automation across our Cyber AI application platform. This position plays a crucial role in ensuring the... 
    Cyber

    Samprasoft

    Quincy, MA
    15 hours ago
  •  ...this role, you will: Lead and manage data...  ...analytics, reporting, and AI/ML use cases. Establish...  ...culture of documentation, testing, and continuous...  ...certification or other cyber certification/experience...  ...opportunity employer. We evaluate qualified applicants without... 
    Cyber
    Full time
    Contract work
    Part time
    Local area
    Immediate start
    Flexible hours

    Serco

    Boston, MA
    4 days ago
  • $124.22k - $131k

     ...Hardware built in-house, for our Cyber group, you'll be a member of a...  ...into software design, code, test plans, and then execute...  ...Identifies opportunities to apply AI for continuous improvement and...  ...learning and development. Research oriented work, alongside award... 
    Cyber
    Relocation package
    Flexible hours

    Progeny Systems Corporation

    Dedham, MA
    4 days ago
  • $110.24k - $117k

     ...Hardware built in-house, for our Cyber group, you'll be a member of a...  ...into software design, code, test plans, and then execute...  ...Identifies opportunities to apply AI for continuous improvement and...  ...learning and development. Research oriented work, alongside award... 
    Cyber
    Flexible hours

    Progeny Systems Corporation

    Dedham, MA
    4 days ago
  • $130.3k - $260.59k

     ...Directors, and operational teams to evaluate care models, identify cost...  ...recommendations. This Lead Decision Scientist will be embedded...  ...analysis, and exploratory research to support new initiatives....  ...statistical modeling, A/B testing, or causal inference methods... 
    Hourly pay
    Full time
    Temporary work
    Work experience placement
    Local area

    CVS Health

    Boston, MA
    3 days ago
  • $168.8k - $241.2k

     ...brave - product designers, researchers, content designers,...  ...Your Impact As a Lead Design Researcher, you'...  ...primarily supporting the AI Software & Platform team...  ...rigorous generative and evaluative research executed to...  ...interviews, usability testing, surveys, benchmarking,... 
    Full time
    Temporary work
    Local area
    Flexible hours

    Cisco

    Boston, MA
    2 days ago
  • $77k - $202k

     ...and/or a proven record of success with leading efforts to understand, assess, consult,...  ...systems, conducting and supporting solution testing, building test cases, assisting with...  ...collaborating closely with team members. We evaluate these factors thoughtfully to establish... 
    Full time
    Work experience placement
    H1b

    PwC

    Boston, MA
    9 days ago
  • $90k - $115k

     ...Behavioral Science & UX Research - Hybrid (Boston only)...  ...strategies guide the world’s leading brands. We accelerate...  ...Leading generative and evaluative UX research Partnering...  ...guides, surveys, test plans) that balance scientific...  ...Explore and expand AI-powered applications,... 
    Remote work
    Flexible hours
    Shift work

    Escalent

    Boston, MA
    4 days ago
  • $116.4k - $140k

     ...contribute to world-class research in artificial...  ...missions. Group 52 AI Technology & Systems specializes...  ...with the Nation's top cyber organizations. As a...  ...relevance: we design and evaluate AI/ML systems using...  ...continuous-integration testing, environment reproducibility... 
    Cyber
    Work experience placement
    Internship

    Massachusetts Institute of Technology

    Lexington, MA
    15 hours ago
  •  ...can believe in: Immersive One is the leading cyber resilience solution across the globe...  ..., by simulating real-world threats, testing your skills, and measuring...  ...candidates who are confident using AI tools to support research, drafting, editing, and workflow efficiency... 
    Cyber
    Remote work
    Flexible hours
    Night shift

    Immersive Labs

    Boston, MA
    1 day ago
  • $82.3k - $220k

     ...independent, nonprofit research and development company...  ...reviews, integration and testing, verification and...  ...needs, understand and evaluate relevant technology options...  .... Conceptualize and lead the development of the...  ...architectures, fault tolerance, cyber/security, comms/... 
    Cyber
    Full time
    Local area

    Draper

    Cambridge, MA
    7 days ago
  • $156k - $211.1k

     ...Vectra® is the leader in AI-driven threat detection...  ...to the most advanced cyber-attacks. With 35 patents...  ...Be on the leading edge of applying machine...  ...collaboration with Security Researchers, who are experts in cyber...  ...prototyping, development, and testing of complex detection... 
    Cyber
    Worldwide

    VECTRA

    Boston, MA
    2 days ago
  • $165k - $190k

    Schneider Electric has an opportunity for a Lead Solution Architect in our Boston office or one of our other Hub Locations. System.AI is a Global ETO Service Center of...  ...Cloud Environments (Azure) / Networking / Cyber Security OT OPC / Modbus / OT Cyber / OT Networks... 
    Cyber
    Temporary work
    Work at office
    Flexible hours

    Schneider Electric

    Boston, MA
    1 day ago
  •  ...Product & Engineering team is looking for a Sr. Data Engineer, Cyber AI App & Attack Surface Management. CASM Platform team is focused...  ...Automation: Experience building CI/CD pipelines that automate testing, security scans, and deployment processes. Proficiency in deploying... 
    Cyber

    Kaav Inc.

    Quincy, MA
    3 days ago
  • YO IT Consulting is hiring an AI Evaluation Specialist to work remotely. You'll leverage your expertise to train next-generation AI systems by reviewing AI-generated outputs for quality and usability. This role requires a detail-oriented candidate with exceptional reading... 
    Remote job

    YO IT Consulting

    Boston, MA
    4 days ago
  • $90k - $180k

     ...robust body of proprietary research and a collaborative...  ...seeking an experienced Lead Systems Analyst to join...  ...investors analyze portfolios, evaluate risk, and make...  ...solution design reviews, testing, and rollout readiness....  ...tools. Experience with AI‑enabled tooling... 
    Remote work
    Flexible hours
    1 day per week

    CFA Institute

    Boston, MA
    2 days ago
  •  ...Massachusetts Institute of Technology (MIT) is seeking an AI Policy Lead to support policy outreach and manage a research fund. The ideal candidate will possess a Master'...  ...with significant experience in randomized evaluations and international development policy.... 

    Massachusetts Institute of Technology (MIT)

    Cambridge, MA
    4 days ago
  • $109.39k - $179.71k

     ...environment. This role evaluates the design and operating...  ...of IT SOX control testing and review, document workpapers...  ..., data analytics and AI initiatives, and system...  ...IT general controls, cyber security, data privacy,...  ...COBIT, AI, and / or other leading IT control frameworks.... 
    Cyber
    Work experience placement
    Work at office

    Eastern Bank

    Wakefield, MA
    4 days ago
  •  ...to join a team focused on the evaluation, enhancement, and maintenance...  ...infrastructure, and the associated systems testing, vulnerability assessments,...  ...testing Experience with cyber threat information collection...  ...use artificial intelligence (AI) tools to support parts of the... 
    Cyber
    Full time
    Local area
    Monday to Friday
    Flexible hours

    CGS Federal (Contact Government Services)

    Boston, MA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Lead - AI Cyber Testing & Evaluation. Be the first to apply!