Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Cybersecurity Analyst - AI Evaluation (US)

$55 - $75 per hour

Braintrust

About the opportunity

Help evaluate AI-generated answers on cybersecurity tasks. You’ll read code, apply the assigned policy to each case, and write concise notes that explain your labels. You’ll switch between policy sets as assignments change, flag issues in AI output, and support investigations through consistent case review.

What you’ll do

Review escalations, resolve edge cases and policy conflicts within the guidance, and document decisions so other reviewers can apply them consistently.

What we’re looking for

  • Solid cybersecurity fundamentals, the ability to read code and spot mistakes in model output, and clear written reasoning.
  • Experience with data labeling, quality review, or investigations under a defined procedure is especially valuable.
  • Familiarity with LLMs is helpful.
  • Bring experience handling technical escalations or ambiguous policy decisions.

Engagement

Remote within the United States. This is a dedicated full-time contractor assignment lasting 6–12 months, with 40 hours per week and four hours of Pacific Time overlap. Start as soon as available. Candidate pay is USD $55–$75 per hour, depending on experience.

Interview process

Selected candidates will need to complete an interest check form, an AI interview on security fundamentals, LLM experience and scenario judgment, then an interview with the CISO or a member of the security team.

Vacancy posted 4 hours ago
Similar jobs that could be interesting for youBased on the Senior Cybersecurity Analyst - AI Evaluation (US) in San Francisco, CA vacancy
  • AI/ML Engineer**** Please note: This role is not eligible for 1...  ...Experience with AI validation, evaluation, observability, and production...  ...meaningful impact. What sets us apart? We believe work should...  ...Consultant: $142,000-$173,500* Senior Consultant: $178,000- $218,000... 
    Senior
    Temporary work
    Work at office
    Local area
    3 days per week

    Slalom

    San Francisco, CA
    4 days ago
  •  ...Evaluate and refine AI-generated code for efficiency and reliability. About Us Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems.... 
    Senior
    Part time
    For contractors
    Flexible hours

    Turing

    San Francisco, CA
    14 days ago
  •  ...Create and evaluate datasets for training large language models. About Us Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing... 
    Senior
    Part time
    For contractors
    Flexible hours

    Turing

    San Francisco, CA
    14 days ago
  • $105.4k - $207.8k

     ...Deloitte is seeking an AI Cloud Security Engineer, Senior Consultant to design, build...  ...on software engineering, cybersecurity, and cloud architecture experience...  ...and prompt versioning, evaluation datasets, approval...  ...collectively. It enables us to leverage different ways... 
    Senior
    Work experience placement
    Local area
    Visa sponsorship

    Deloitte

    San Francisco, CA
    2 days ago
  • $105.4k - $207.8k

     ...Cyber Data Protection Senior ConsultantAre you passionate...  ...requirements, evaluating vendor solutions, architecting...  ...online protection, privacy, AI governance, identity, data protection, cybersecurity, and regulatory...  ...collectively. It enables us to leverage different ways... 
    Senior
    Local area

    Deloitte

    San Francisco, CA
    1 day ago
  • $80k - $120k

     ...Senior Systems Analyst Employment Type: Full Time, Senior-level Department...  ...- Performs systems evaluations. - Makes presentations of...  ...use artificial intelligence (AI) tools to support parts of the...  ...information about how your data is processed, please contact us.
    Senior
    Full time
    Contract work
    For contractors
    Work at office
    Flexible hours

    Contact Government Services, LLC

    San Francisco, CA
    3 days ago
  • $175k - $220k

     ...for a highly technical Senior Security Engineer who is...  ..., automation, and AI rather than relying solely...  ...data security challenges.Evaluate emerging technologies...  ...SaaS Security, or related cybersecurity roles.Bachelor or...  ...benefits package.About us: Sigma is the AI Apps and... 
    Senior
    Full time
    Work at office

    Sigma Computing

    San Francisco, CA
    1 day ago
  • $105.4k - $207.8k

     ...As a Sr. Consultant: AI Security, Identity in our...  ...Qualifications3-5+ years of cybersecurity experience, including 1...  ...red teaming, security evaluations, secure AI development...  .... It enables us to leverage different ways...  ...entry-level employees to senior leaders, we believe there... 
    Senior
    Local area
    Visa sponsorship

    Deloitte

    San Francisco, CA
    3 days ago
  • $105.4k - $207.8k

     ...As a Sr Consultant: AI Data Security in Deloitte...  ...3-5+ years of combined cybersecurity and AI engineering experience...  ...red teaming, security evaluations, secure AI development...  .... It enables us to leverage different ways...  ...entry-level employees to senior leaders, we believe there... 
    Senior
    Local area
    Visa sponsorship

    Deloitte

    San Francisco, CA
    3 days ago
  • $105.4k - $207.8k

    Position Summary As a AI Infrastructure Senior Consultant in our Cyber for...  ...3-5+ years of combined cybersecurity and AI engineering experience...  ..., red teaming, security evaluations, secure AI development practices...  ...collectively. It enables us to leverage different ways... 
    Senior
    Local area
    Visa sponsorship

    Deloitte

    San Francisco, CA
    3 days ago
  • $175k - $220k

     ...for a highly technical Senior Security Engineer who thrives...  ..., automation, and AI rather than relying...  ...services, and integrations.Evaluate emerging technologies...  ...Engineering, or related cybersecurity roles.Bachelor or Masters...  ...benefits package.About us: Sigma is the AI Apps... 
    Senior
    Full time
    Work at office

    Sigma Computing

    San Francisco, CA
    1 day ago
  • $10 per hour

     ...that impact business, society, and the environment? Come join us.What you'll doThere is no MSSP and no tier-1 queue here....  ...retrofitting logging after an incident.A track record of critically evaluating and verifying AI-assisted work - testing, source-checking, validation -... 
    Senior
    Work at office
    Local area
    Immediate start
    Relocation
    Relocation package
    Flexible hours

    Flexport

    San Francisco, CA
    4 days ago
  •  ...12,000 financial institutions across the US, Canada, UK and Europe. Founded in 2013, the...  ...and reduce recurring vulnerabilities. As AI accelerates software development, our goal...  ...security problems early in development. You can evaluate technical and business tradeoffs and... 
    Senior
    Full time
    Work experience placement
    Work at office
    Local area
    Immediate start

    Plaid Financial

    San Francisco, CA
    1 day ago
  • $90.4k - $168.2k

     ...team.KPMG is currently seeking a Senior Associate, Cyber Forward...  ...while building custom tooling, evaluation harnesses, and agentic workflows...  ...GXPN)Genuine fluency with modern AI coding harnesses (e.g., Claude...  ...the bottom of our KPMG US Careers site at Benefits & How... 
    Senior
    Local area

    KPMG

    San Francisco, CA
    2 days ago
  •  ...Superintelligence Cloud, is a leader in AI cloud infrastructure serving...  ...world's best AI cloud, join us. *Note: This position...  ...artificial intelligence. As a Senior Security Engineer on Product...  ...revenue. Enterprises and AI labs evaluate our security before they move billion... 
    Senior
    Work at office
    Local area
    Work from home
    Flexible hours
    Shift work

    Lambda

    San Francisco, CA
    5 days ago
  • $100k - $150k

     ...operating efficiencies. We’re building an AI-first audit function, using AI and automation...  ...Cycle Controls (SDLC), address risks and evaluate the related ITGC controls across homegrown...  ...Auditing Standards, COSO 2013, COBIT, US GAAP, Internal Audit Standards, including... 
    Senior
    Work at office

    Klaviyo

    San Francisco, CA
    5 days ago
  • $175k - $250k

     ...StatesSalary: USD 175000 - 250000 yearEmployment type: FULL TIMEPosted: 2026-05-13About the RoleWe’re seeking a strong Senior Backend Engineer to join our AI Evaluation team, focused on building the infrastructure and internal tooling that enable reliable, repeatable evaluation... 
    Senior
    Flexible hours

    Ellipsis Health

    San Francisco, CA
    3 days ago
  • $130k - $200k

    Position Summary AI Conversation Design Senior ConsultantOur Deloitte Sales & Service team empowers...  ...client-facing POCs and demos.Define evaluation frameworks and test suites for LLM-...  ...organizational performance.#Customer_US#SS_US Deloitte is committed to... 
    Senior
    Local area
    Visa sponsorship

    Deloitte

    San Francisco, CA
    21 hours ago
  • $250k - $300k

     ...the only vertically integrated AI infrastructure company built...  ...in each other, come build with us at Crusoe.About This Role:Crusoe...  ...toward hundreds of Tbps, evaluating 400ZR/ZR+, 800ZR, and embedded...  ...including 5+ years as an architect or senior technical lead designing... 
    Senior
    Full time
    Temporary work
    Flexible hours

    Crusoe

    San Francisco, CA
    3 days ago
  •  ...Management, IT Operations Management, AI, and Data Foundations to...  ...business process consultant, business analyst, or functional leadRequired...  ...meaningful impact. What sets us apart? We believe work should...  ...San Francisco, Silicon Valley:* Senior Principal: $222,000-$271,000* San... 
    Senior
    Temporary work
    Local area
    Flexible hours

    Slalom

    San Francisco, CA
    3 days ago
  • $143k - $178k

     ...Scale is powering this generative AI wave by providing the data and infrastructure for companies to build large-...  ...reconsidering candidates for the same role. This allows us to ensure a fair and thorough evaluation of all applicants.* About Us: *At Scale, our mission... 
    Senior
    Full time

    Scale AI

    San Francisco, CA
    4 days ago
  • $250k - $300k

     ...the only vertically integrated AI infrastructure company built...  ...in each other, come build with us at Crusoe. About This Role...  ...toward hundreds of Tbps, evaluating 400ZR/ZR+, 800ZR, and embedded...  ...including 5+ years as an architect or senior technical lead designing... 
    Senior
    Full time
    Temporary work
    Flexible hours

    Crusoe

    San Francisco, CA
    16 days ago
  • $160.3k - $240.5k

     ...their users. We are seeking a Senior Application Security Engineer...  ..., secure design reviews, code evaluation, and vulnerability management,...  ...manual methods and advanced AI tooling. You will also help secure...  ...engineering teams across the US and EMEA. What you will do... 
    Senior
    Work at office
    Worldwide

    UNITY

    San Francisco, CA
    1 day ago
  • $232k - $290k

     ...If you’re ready to see your impact and unlock incredible career growth opportunities, join us, and build real world value.THE WORK:As a Senior Staff Security Engineer focused on AI Security, you will be Ripple's deepest technical expert at the intersection of artificial... 
    Senior
    Full time
    Work at office
    Local area

    Ripple

    San Francisco, CA
    5 days ago
  • $116.2k - $229.1k

     ...career to new heights? Join our US Supply Chain & Network Operations...  ...Work You’ll DoThe Software & ALM Senior Consultant executes hands-on delivery to build AI-enabled software and systems engineering...  ...approvals and auditability.Build evaluation approaches/harnesses to measure... 
    Senior
    Local area

    Deloitte

    San Francisco, CA
    4 days ago
  • $150.1k - $227k

     ...DetailsAbout SalesforceSalesforce is the #1 AI CRM, where humans with agents drive...  ...establish self-introductions with senior leadership. Dynamically evaluate and adapt to evolving organizational...  ...e.g.: PSM, CSPO, PMP, SAFe RTEJoin us to lead the charge in defining the next... 
    Senior
    Full time
    Shift work

    Salesforce

    San Francisco, CA
    1 day ago
  •  ...Rippling.com addresses.About the roleRippling AI is becoming a foundational platform across...  ...such as memory systems, automated tuning, evaluation frameworks, reporting, and AI performance...  ...+ benefits + equity. The salary for US-based employees will be aligned with one of... 
    Senior
    Work at office
    3 days per week

    Rippling

    San Francisco, CA
    1 day ago
  • $180k - $240k

     ..., CO or San Francisco / Remote US Infrastructure – Cloud Infrastructure...  ...simple for our customers. As a Senior Cloud Infrastructure Engineer...  ...is intentionally wide as we evaluate individuals based on their...  ...observation, IoT connectivity, on-orbit AI, national security missions,... 
    Senior
    Full time
    Work at office
    Remote work
    Relocation package
    Flexible hours

    Loft Orbital

    San Francisco, CA
    4 days ago
  • $218.4k - $365.2k

     ...About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer...  ...product strategy for AI quality and evaluation, establish how we measure progress, and personally...  ...choices clearly to customers and senior stakeholders. Minimum Requirements... 
    Senior
    Full time
    Flexible hours

    Salesforce

    San Francisco, CA
    12 days ago
  • $20 - $40 per hour

     ...Filmmaking Video Annotation AI Training Motion Graphics About...  ...models and agents. We provide frontier evaluations and reinforcement learning environments...  ...quality and velocity. Role Title: Senior AI Video Trainer (US Based) Role Type: Contractor Location... 
    Senior
    Part time
    For contractors
    Remote work

    micro1

    San Francisco, CA
    11 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Cybersecurity Analyst - AI Evaluation (US). Be the first to apply!