Senior Cybersecurity Analyst - AI Evaluation (US)
$55 - $75 per hourBraintrust
About the opportunity
Help evaluate AI-generated answers on cybersecurity tasks. You’ll read code, apply the assigned policy to each case, and write concise notes that explain your labels. You’ll switch between policy sets as assignments change, flag issues in AI output, and support investigations through consistent case review.
What you’ll do
Review escalations, resolve edge cases and policy conflicts within the guidance, and document decisions so other reviewers can apply them consistently.
What we’re looking for
- Solid cybersecurity fundamentals, the ability to read code and spot mistakes in model output, and clear written reasoning.
- Experience with data labeling, quality review, or investigations under a defined procedure is especially valuable.
- Familiarity with LLMs is helpful.
- Bring experience handling technical escalations or ambiguous policy decisions.
Engagement
Remote within the United States. This is a dedicated full-time contractor assignment lasting 6–12 months, with 40 hours per week and four hours of Pacific Time overlap. Start as soon as available. Candidate pay is USD $55–$75 per hour, depending on experience.
Interview process
Selected candidates will need to complete an interest check form, an AI interview on security fundamentals, LLM experience and scenario judgment, then an interview with the CISO or a member of the security team.
- AI/ML Engineer**** Please note: This role is not eligible for 1... ...Experience with AI validation, evaluation, observability, and production... ...meaningful impact. What sets us apart? We believe work should... ...Consultant: $142,000-$173,500* Senior Consultant: $178,000- $218,000...SeniorTemporary workWork at officeLocal area3 days per week
- ...Evaluate and refine AI-generated code for efficiency and reliability. About Us Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems....SeniorPart timeFor contractorsFlexible hours
- ...Create and evaluate datasets for training large language models. About Us Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing...SeniorPart timeFor contractorsFlexible hours
$105.4k - $207.8k
...Deloitte is seeking an AI Cloud Security Engineer, Senior Consultant to design, build... ...on software engineering, cybersecurity, and cloud architecture experience... ...and prompt versioning, evaluation datasets, approval... ...collectively. It enables us to leverage different ways...SeniorWork experience placementLocal areaVisa sponsorship$105.4k - $207.8k
...Cyber Data Protection Senior ConsultantAre you passionate... ...requirements, evaluating vendor solutions, architecting... ...online protection, privacy, AI governance, identity, data protection, cybersecurity, and regulatory... ...collectively. It enables us to leverage different ways...SeniorLocal area$80k - $120k
...Senior Systems Analyst Employment Type: Full Time, Senior-level Department... ...- Performs systems evaluations. - Makes presentations of... ...use artificial intelligence (AI) tools to support parts of the... ...information about how your data is processed, please contact us.SeniorFull timeContract workFor contractorsWork at officeFlexible hours$175k - $220k
...for a highly technical Senior Security Engineer who is... ..., automation, and AI rather than relying solely... ...data security challenges.Evaluate emerging technologies... ...SaaS Security, or related cybersecurity roles.Bachelor or... ...benefits package.About us: Sigma is the AI Apps and...SeniorFull timeWork at office$105.4k - $207.8k
...As a Sr. Consultant: AI Security, Identity in our... ...Qualifications3-5+ years of cybersecurity experience, including 1... ...red teaming, security evaluations, secure AI development... .... It enables us to leverage different ways... ...entry-level employees to senior leaders, we believe there...SeniorLocal areaVisa sponsorship$105.4k - $207.8k
...As a Sr Consultant: AI Data Security in Deloitte... ...3-5+ years of combined cybersecurity and AI engineering experience... ...red teaming, security evaluations, secure AI development... .... It enables us to leverage different ways... ...entry-level employees to senior leaders, we believe there...SeniorLocal areaVisa sponsorship$105.4k - $207.8k
Position Summary As a AI Infrastructure Senior Consultant in our Cyber for... ...3-5+ years of combined cybersecurity and AI engineering experience... ..., red teaming, security evaluations, secure AI development practices... ...collectively. It enables us to leverage different ways...SeniorLocal areaVisa sponsorship$175k - $220k
...for a highly technical Senior Security Engineer who thrives... ..., automation, and AI rather than relying... ...services, and integrations.Evaluate emerging technologies... ...Engineering, or related cybersecurity roles.Bachelor or Masters... ...benefits package.About us: Sigma is the AI Apps...SeniorFull timeWork at office$10 per hour
...that impact business, society, and the environment? Come join us.What you'll doThere is no MSSP and no tier-1 queue here.... ...retrofitting logging after an incident.A track record of critically evaluating and verifying AI-assisted work - testing, source-checking, validation -...SeniorWork at officeLocal areaImmediate startRelocationRelocation packageFlexible hours- ...12,000 financial institutions across the US, Canada, UK and Europe. Founded in 2013, the... ...and reduce recurring vulnerabilities. As AI accelerates software development, our goal... ...security problems early in development. You can evaluate technical and business tradeoffs and...SeniorFull timeWork experience placementWork at officeLocal areaImmediate start
$90.4k - $168.2k
...team.KPMG is currently seeking a Senior Associate, Cyber Forward... ...while building custom tooling, evaluation harnesses, and agentic workflows... ...GXPN)Genuine fluency with modern AI coding harnesses (e.g., Claude... ...the bottom of our KPMG US Careers site at Benefits & How...SeniorLocal area- ...Superintelligence Cloud, is a leader in AI cloud infrastructure serving... ...world's best AI cloud, join us. *Note: This position... ...artificial intelligence. As a Senior Security Engineer on Product... ...revenue. Enterprises and AI labs evaluate our security before they move billion...SeniorWork at officeLocal areaWork from homeFlexible hoursShift work
$100k - $150k
...operating efficiencies. We’re building an AI-first audit function, using AI and automation... ...Cycle Controls (SDLC), address risks and evaluate the related ITGC controls across homegrown... ...Auditing Standards, COSO 2013, COBIT, US GAAP, Internal Audit Standards, including...SeniorWork at office$175k - $250k
...StatesSalary: USD 175000 - 250000 yearEmployment type: FULL TIMEPosted: 2026-05-13About the RoleWe’re seeking a strong Senior Backend Engineer to join our AI Evaluation team, focused on building the infrastructure and internal tooling that enable reliable, repeatable evaluation...SeniorFlexible hours$130k - $200k
Position Summary AI Conversation Design Senior ConsultantOur Deloitte Sales & Service team empowers... ...client-facing POCs and demos.Define evaluation frameworks and test suites for LLM-... ...organizational performance.#Customer_US#SS_US Deloitte is committed to...SeniorLocal areaVisa sponsorship$250k - $300k
...the only vertically integrated AI infrastructure company built... ...in each other, come build with us at Crusoe.About This Role:Crusoe... ...toward hundreds of Tbps, evaluating 400ZR/ZR+, 800ZR, and embedded... ...including 5+ years as an architect or senior technical lead designing...SeniorFull timeTemporary workFlexible hours- ...Management, IT Operations Management, AI, and Data Foundations to... ...business process consultant, business analyst, or functional leadRequired... ...meaningful impact. What sets us apart? We believe work should... ...San Francisco, Silicon Valley:* Senior Principal: $222,000-$271,000* San...SeniorTemporary workLocal areaFlexible hours
$143k - $178k
...Scale is powering this generative AI wave by providing the data and infrastructure for companies to build large-... ...reconsidering candidates for the same role. This allows us to ensure a fair and thorough evaluation of all applicants.* About Us: *At Scale, our mission...SeniorFull time$250k - $300k
...the only vertically integrated AI infrastructure company built... ...in each other, come build with us at Crusoe. About This Role... ...toward hundreds of Tbps, evaluating 400ZR/ZR+, 800ZR, and embedded... ...including 5+ years as an architect or senior technical lead designing...SeniorFull timeTemporary workFlexible hours$160.3k - $240.5k
...their users. We are seeking a Senior Application Security Engineer... ..., secure design reviews, code evaluation, and vulnerability management,... ...manual methods and advanced AI tooling. You will also help secure... ...engineering teams across the US and EMEA. What you will do...SeniorWork at officeWorldwide$232k - $290k
...If you’re ready to see your impact and unlock incredible career growth opportunities, join us, and build real world value.THE WORK:As a Senior Staff Security Engineer focused on AI Security, you will be Ripple's deepest technical expert at the intersection of artificial...SeniorFull timeWork at officeLocal area$116.2k - $229.1k
...career to new heights? Join our US Supply Chain & Network Operations... ...Work You’ll DoThe Software & ALM Senior Consultant executes hands-on delivery to build AI-enabled software and systems engineering... ...approvals and auditability.Build evaluation approaches/harnesses to measure...SeniorLocal area$150.1k - $227k
...DetailsAbout SalesforceSalesforce is the #1 AI CRM, where humans with agents drive... ...establish self-introductions with senior leadership. Dynamically evaluate and adapt to evolving organizational... ...e.g.: PSM, CSPO, PMP, SAFe RTEJoin us to lead the charge in defining the next...SeniorFull timeShift work- ...Rippling.com addresses.About the roleRippling AI is becoming a foundational platform across... ...such as memory systems, automated tuning, evaluation frameworks, reporting, and AI performance... ...+ benefits + equity. The salary for US-based employees will be aligned with one of...SeniorWork at office3 days per week
$180k - $240k
..., CO or San Francisco / Remote US Infrastructure – Cloud Infrastructure... ...simple for our customers. As a Senior Cloud Infrastructure Engineer... ...is intentionally wide as we evaluate individuals based on their... ...observation, IoT connectivity, on-orbit AI, national security missions,...SeniorFull timeWork at officeRemote workRelocation packageFlexible hours$218.4k - $365.2k
...About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer... ...product strategy for AI quality and evaluation, establish how we measure progress, and personally... ...choices clearly to customers and senior stakeholders. Minimum Requirements...SeniorFull timeFlexible hours$20 - $40 per hour
...Filmmaking Video Annotation AI Training Motion Graphics About... ...models and agents. We provide frontier evaluations and reinforcement learning environments... ...quality and velocity. Role Title: Senior AI Video Trainer (US Based) Role Type: Contractor Location...SeniorPart timeFor contractorsRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Cybersecurity Analyst - AI Evaluation (US). Be the first to apply!
- senior living San Francisco, CA
- senior trade analyst San Francisco, CA
- senior accountant manufacturing San Francisco, CA
- senior manager customer operations San Francisco, CA
- senior director information security San Francisco, CA
- senior full stack web developer San Francisco, CA
- senior technical director San Francisco, CA
- senior service engineer San Francisco, CA
- senior environment artist San Francisco, CA
- senior chief engineer San Francisco, CA






