Research Lead - AI Cyber Testing & Evaluation
$146.2k - $261.4kEmployment Opportunities Inc
Research Lead - AI Cyber Testing & Evaluation
RAND's Center on AI, Security, and Technology (CAST), part of the Global and Emerging Risks (GER) Division conducts cutting-edge research on transformative, high-impact technologies—including artificial intelligence and biotechnology—to shape policies that protect global security and advance the public good.
You will be responsible for managing significant research budgets and personnel, overseeing complex technical research and policy analysis projects, and leading multidisciplinary teams of policy researchers, engineers, and scientists. Your team will build systems to evaluate how AI models perform across the full attack lifecycle, including resource development, initial access, discovery, lateral movement, and defense evasion.
Your projects may include developing benchmarks for fully autonomous operations using scaffolding and tools, as well as uplift of both novice and expert humans. Such benchmarks may involve environments like CTF challenges, frameworks for assessing ability to reason over attack graphs and conduct multi-stage operations, assessment of stealth and defense evasion capabilities, and benchmarks for ability to conduct time-sensitive operations at machine speed.
Many of your evaluations will be commissioned directly by relevant government agencies, and the results of your evaluations will drive responsible AI policy across the world. Your team will communicate findings through detailed technical analyses, evaluation frameworks, and quick-turnaround policy briefs. Your work will inform analysis delivered to senior government and industry leaders.
This position is structured as a two-year appointment with options to renew and explore opportunities for longer-term employment at RAND thereafter.
RAND's reputation for excellence is built on our commitment to high-quality, rigorous analysis and objectivity. As a Research Lead - AI Cyber Testing & Evaluation, you'll maintain that excellence while engaging with some of the most pressing challenges of our time.
Qualifications
All research positions at RAND require excellent analytic skills; the ability to communicate clearly and effectively, both orally and in writing; the ability to work effectively as a member of a multi-disciplinary team; and a strong commitment to RAND's core values of quality and objectivity.
Required:
- 6+ years of technical experience in security engineering, software engineering, firmware engineering, hardware engineering, or related fields
- 6+ years of technical management experience, including leading cross-functional teams, managing project budgets, and mentoring and developing team members
- Demonstrated ability to successfully lead complex projects to completion
- Proficiency in Python, Java, C/C++, or other popular programming languages
- Experience with red team operations or offensive cyber capabilities development
- Ability to develop rigorous and comprehensive threat models and identify potential system vulnerabilities
- Strong ability to communicate effectively in English, both verbally and in writing
- Ability to work effectively in a collaborative, multidisciplinary environment
- Fluency with MS Office suite
Preferred:
- Graduate of the Computer Network Operations Development Program (CNODP), Remote Interactive Operator Training (RIOT), Future Operator Readiness Growth and Enrichment (FORGE), or equivalent experience
- Understanding of advanced persistent threat (APT) tactics, techniques, and procedures (TTPs) and experience with defending against them
- Ability to think creatively about offensive and/or defensive techniques and strategies, beyond compliance with existing regulations
- Experience working on AI research, ML model training, or model deployment
Education Requirements
RAND is hiring a Research Lead at either the specialist or expert level of experience. Minimum education requirements at the specialist level include:
A PhD in Computer Science, Computer Engineering, Electrical Engineering, Cybersecurity, Information Security, Information Technology, Mathematics, Applied Mathematics, Physics, Applied Physics, Engineering Physics, Artificial Intelligence, Machine Learning, Engineering and Public Policy, Technology and Policy, National Security Policy, Policy Analysis, Political Science, International Relations, or similar with at least 3 years of relevant professional experience is required.
OR
A Master's degree in the fields listed above with at least 6 years of relevant professional experience, is required.
OR
A Bachelor's degree in the fields listed above with at least 8 years of relevant professional experience, is required.
Master's or PhD preferred.
Security Clearance
Ability to obtain and maintain a U.S. government clearance is preferred but not required.
Location
We are hiring for this position in San Francisco, CA; Washington, DC; Santa Monica, CA; Pittsburgh, PA; and Boston, MA. We offer a hybrid work arrangement, combining work from home and on-site options. Fully remote work will also be considered.
Writing or Code Sample
Either a writing sample or a code sample is required for this position. This sample can use a recent, previously written paper or technical report (e.g., journal article, master's thesis or paper written for coursework, research project, technical analysis, briefings), or source code showing technical expertise in relevant domains.
Term
This position is a 3-year term appointment with a possibility of renewal, alongside options for longer term employment.
Salary Range: $146,200 - $261,400
Visiting Technical Specialist = $$146,200 - $211,900
Visiting Technical Expert = $167,300 - $261,400
RAND considers a variety of factors when formulating an offer, including but not limited to, the specific role and associated responsibilities; a candidate's work experience, education/training, skills, expertise; and internal equity. Successful candidates will be offered employment in a specific title, as determined by the candidate's education and experience. The salary range includes base pay plus RAND's sabbatic pay (which provides additional compensation above base pay when vacation is taken). In addition, RAND provides strong benefits including health insurance coverage, life and disability insurance, savings plan, paid time-off and more.
Equal Opportunity Employer
- ...technology stack for intelligent cyber security. Designed for... .... About the Role As an AI Research Engineer, you will apply cutting... ...performance. Design an evaluation system for calculating... ...promising new research and lead programs for testing and ultimately implementing...Cyber
$167.3k - $261.4k
Senior Research Lead - AI Security Portfolio page is loaded## Senior Research Lead - AI Security... ...advanced AI systems, understanding their cyber capabilities, and informing the policy... ...AI security research, cyber capability evaluation, and infrastructure development. Your work...CyberFixed term contractWork experience placementRemote workWork from home$60 per hour
...Work Location Sylmar, CA Rate: $60.00/hr AI Please send it with this... ...output. • Strong experience in System-level testing • Experience on hardware experience, especially... ...experience. • Contributes to the evaluation and validation of a specific system or...CyberFor contractorsRelocation$2,150 per month
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Role Responsibilities Review and evaluate AI-generated outputs related to threat... ...hunting queries, and penetration testing reports. Annotate, label, and validate...CyberHourly payContract workPart timeSummer workRemote work£100k - £200k per year
...for frontier AGI safety research, e.g. building and... ...running and analyzing evaluations. For example, a tool that... ...model for pre-deployment testing to analyzing the most important... ...model evaluations Lead the development of... ...with AWS Interest in AI Safety We want to...SuggestedFull timeWork at officeRemote workVisa sponsorshipFlexible hours$77k - $202k
...of stakeholders. They evaluate compliance with regulations... ...services, using AI and other risk technology... ...expertise, in areas like cyber, forensics and compliance... ...you need to lead and deliver value at this... ...assessment, and controls testing methodologies across the...Cyber$320k
...interpretable, and steerable AI systems. We want AI to... ...group of committed researchers, engineers, policy... ...systems—especially ones with cyber‑physical capabilities.... ...team, you’ll build and evaluate model organisms of... ...adversarial games) to test defensive AI capabilities...CyberRelocationVisa sponsorship$77k - $202k
...of stakeholders. They evaluate compliance with regulations... ...services, using AI and other risk technology... ...expertise, in areas like cyber, forensics and compliance... ...you need to lead and deliver value at this... ...assessment, and controls testing methodologies across the...CyberH1bRemote work$207k - $300k
...Engineering Manager II, Agentic AI Systems, Cloud Security... ...5 years of experience leading ML design and... ...model deployment, model evaluation, data processing, debugging... ...to implementation, testing, and deployment of robust... ...machine learning, and cyber‑security. Google is proud...CyberFull timeWorldwide$257k - $327k
...next generation of AI. The Data Center Engineering... ...support OpenAI research, products, and... ...systems background to lead the design and... ...OT network designs, evaluates vendor solutions, and... ..., certifications, test reports, and quality... ..., lockout/tagout, cyber hygiene, and change...CyberFor contractorsWork at officeRemote work$148.5k - $223.9k
...SalesforceSalesforce is the #1 AI CRM, where humans with... ...career at the company leading workforce... ...partner to Salesforce's AI Research, Ethics, Engineering, and... ...tooling, and foundational testing methodologies for both... ...frameworks or large-scale evaluation pipelines.Familiarity...Shift work$155k - $410k
...protecting organisations from cyber threats through... ...assessments and vulnerability testing of cloud-based systems,... ...you need to lead and deliver value at this... ...management across analytics and AI ecosystems Define... ...with team members. We evaluate these factors...CyberFull timeTemporary workH1b$29 per hour
A leading AI talent connector based in San Francisco is looking for an AI Red Team Specialist. This role involves evaluating AI models for vulnerabilities and generating human data for testing. Candidates should have native-level fluency in English and Brazilian Portuguese...CyberRemote jobHourly payFull timeContract workPart time- A nonprofit organization in San Francisco is seeking a Research & Evaluation Senior Lead to lead research efforts and manage impact measurement. This... ...leadership, with strong skills in survey design and using AI tools for analysis. Responsibilities include developing research...Remote workFlexible hours
$99k - $232k
...of stakeholders. They evaluate compliance with regulations... ...services, using AI and other risk technology... ...expertise, in areas like cyber, forensics and compliance... .... You are expected to lead with integrity and... ...assessment and controls testing methodologies across the...Cyber- ...team of 300+ experts, DT leads digital transformation.... ...including Cyber Defense, Identity Management... ...work across development, test, and production environments... ...Experience leveraging AI-assisted development tools... ...process includes evaluation of applications against...CyberFull timeTemporary workWork experience placementSecond jobWork at officeLocal areaImmediate startWork from homeNight shift2 days per week1 day per week
- ...A leading cybersecurity firm is seeking a Security Researcher to identify vulnerabilities in their AI agent runtime. The ideal candidate will have deep experience in application security and penetration testing, along with a strong background in system-level reasoning...Contract workRemote work
- ...on a mission to create the world's first AI-powered Personal & Entrepreneurial Resource... ...ensure our systems remain resilient against cyber threats. Your expertise will help build... ...vulnerability scanning, penetration testing, and security assessments to detect weaknesses...CyberTemporary workWorldwide
- ...its ML Data Team in San Francisco. This role involves designing evaluation frameworks, managing data operations, and collaborating cross-functionally... .... Ideal candidates should have over 5 years of experience in AI data operations, proficiency in Python and a strong ability to...Flexible hours
$150k
About the Role We're looking for a Lead, Applied AI to architect and scale intelligent automation... ...practices including guardrails, evaluation, fallback logic, and PII protections Build... ...Champion engineering excellence across testing, observability, and incident response for...Full time- A cutting-edge AI technology firm in San Francisco is seeking an Evaluation Lead to drive the assessment of AI model performance. You will design evaluation methodologies, automate evaluation processes, and oversee various evaluation strategies. The ideal candidate has...
$119k - $299.93k
PwC is seeking a Senior Manager for its AI Governance team in San Francisco. This... ...with innovative methodologies, and leading teams to evaluate governance and risk frameworks. Candidates... ...’s degree, and skill in AI/ML model testing. The salary range is $119,000 to $299,...Full time- ...Francisco is seeking a vital ML Data Team member to lead video-language data preparation and model evaluation. You will define dataset needs, automate evaluation... ...collaborate cross-functionally with engineering and AI model teams. Ideal candidates have over 5 years in AI...Flexible hours
$225k - $300k
ConTra is seeking a Founding AE in San Francisco to drive full-cycle sales for AI and creative evaluation solutions. The ideal candidate will own pipeline creation, consult with various stakeholders, and contribute to the authority of Contra Labs. Compensation includes...$150k - $250k
...AI Systems & Innovation Manager Administration... ...program management, while leading the development of AI... ...automation Evaluate and implement practical... ...responsible-use guidelines. Research and pilot emerging AI... ...CD pipeline standards, testing procedures, and...Full timeFor contractorsWork at officeLocal area- About Archetype AI Archetype AI is developing the world's first... ...AI is seeking a hands‑on Evaluation Lead to build and assess model performance... ...frameworks to rapidly test and generate reports on model... ...include partnering closely with research and engineering teams to...
$225k
...sales from initial contact to expansion. You will build pipelines across AI labs, turning ambiguous problems into clear deals, and help establish Contra Labs as the authority in creative evaluation. The ideal candidate has experience selling to AI/ML teams and thrives...- ...technical and product knowledge. They can lead unlimited, simultaneous conversations 24... .... Job Description We’re looking for an AI Research Lead to define and drive 1mind’s... ...for a world‑class applied research team. Evaluate new model architectures, training strategies...Full timeLive inRelocationVisa sponsorship
$99k - $232k
...of stakeholders. They evaluate compliance with regulations... ...services, using AI and other risk technology... ...expertise, in areas like cyber, forensics and compliance... .... You are expected to lead with integrity and... ...assessment and controls testing methodologies across the...CyberH1bRemote work$99k - $232k
...of stakeholders. They evaluate compliance with regulations... ...services, using AI and other risk technology... ...expertise, in areas like cyber, forensics and compliance... .... You are expected to lead with integrity and... ...assessment and controls testing methodologies across the...CyberFull timeH1b
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Lead - AI Cyber Testing & Evaluation. Be the first to apply!
- cyber San Francisco, CA
- research professional San Francisco, CA
- research and development manager San Francisco, CA
- research and development engineer San Francisco, CA
- vice president research and development San Francisco, CA
- research assistantship San Francisco, CA
- research investigator San Francisco, CA
- pharmaceutical research San Francisco, CA
- research nurse San Francisco, CA
- research chef San Francisco, CA


