Senior Cybersecurity Professional for AI Evaluation

Design and author realistic evaluation tasks and scenarios for AI systems that operate in enterprise security operations, incident response, and risk management. Work calibrates scenarios to threat sophistication, business risk stakes, and the scope of major enterprise security programs, producing reference outputs and rubrics that reflect senior security leader judgment. Contributions follow two standards tracks, a US track aligned to NIST Cybersecurity Framework and SOC 2, and an International track aligned to ISO 27001 and the EU NIS2 Directive.

• Construct cybersecurity scenarios covering security operations center monitoring, incident response and digital forensics, vulnerability management, and security architecture design.
• Build tasks across these areas: security operations and threat detection, incident response and forensics, vulnerability and penetration testing, security architecture and engineering, and governance, risk, and compliance.
• Develop scenarios that incorporate enterprise tools such as SIEM platforms, EDR solutions, vulnerability scanners, and GRC platforms commonly used by large organizations.
• Apply cybersecurity methodologies including threat modeling, incident response playbooks, and risk assessment to the designated standards track, and produce reference incident reports, security assessments, architecture designs, and compliance documentation.
• Author evaluation rubrics that separate authentic, senior-level security judgment from textbook or certification-exam-level recall.

• Minimum 5 years of experience as a security engineer, CISO, or equivalent security lead at a major company or security firm, including firms such as Mandiant or CrowdStrike, or as an in-house security lead.
• Direct ownership of incident response programs, security architecture, or compliance initiatives.
• Fluency with security tooling and a strong understanding of regulatory frameworks and the current threat landscape.
• Recognized professional credential strongly preferred, for example CISSP, CISM, or an international equivalent.
• Prior experience authoring rubrics or training content is a plus.

• Location: Remote.
• Engagement type: Hourly.

• Rate: 80 to 90 hourly.

Candidates qualified on either the US standards track or the International standards track, or on both, are encouraged to apply. Qualifications should reflect the standards and responsibilities described above.

If your background matches the qualifications for one or both standards tracks, you are encouraged to apply. Applications from experts with direct experience in the listed responsibilities and credentials will be considered.