Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Cybersecurity Analyst - AI Evaluation (US)

$55 - $75 per hour

Braintrust

About the opportunity

Help evaluate AI-generated answers on cybersecurity tasks. You’ll read code, apply the assigned policy to each case, and write concise notes that explain your labels. You’ll switch between policy sets as assignments change, flag issues in AI output, and support investigations through consistent case review.

What you’ll do

Review escalations, resolve edge cases and policy conflicts within the guidance, and document decisions so other reviewers can apply them consistently.

What we’re looking for

  • Solid cybersecurity fundamentals, the ability to read code and spot mistakes in model output, and clear written reasoning.
  • Experience with data labeling, quality review, or investigations under a defined procedure is especially valuable.
  • Familiarity with LLMs is helpful.
  • Bring experience handling technical escalations or ambiguous policy decisions.

Engagement

Remote within the United States. This is a dedicated full-time contractor assignment lasting 6–12 months, with 40 hours per week and four hours of Pacific Time overlap. Start as soon as available. Candidate pay is USD $55–$75 per hour, depending on experience.

Interview process

Selected candidates will need to complete an interest check form, an AI interview on security fundamentals, LLM experience and scenario judgment, then an interview with the CISO or a member of the security team.

Vacancy posted 10 hours ago
Similar jobs that could be interesting for youBased on the Senior Cybersecurity Analyst - AI Evaluation (US) in Boston, MA vacancy
  • $105.4k - $207.8k

     ...Deloitte is seeking an AI Cloud Security Engineer, Senior Consultant to design, build...  ...on software engineering, cybersecurity, and cloud architecture experience...  ...and prompt versioning, evaluation datasets, approval...  ...collectively. It enables us to leverage different ways... 
    Senior
    Work experience placement
    Local area
    Visa sponsorship

    Deloitte

    Boston, MA
    2 days ago
  • $105.4k - $207.8k

     ...Cyber Data Protection Senior ConsultantAre you passionate...  ...requirements, evaluating vendor solutions, architecting...  ...online protection, privacy, AI governance, identity, data protection, cybersecurity, and regulatory...  ...collectively. It enables us to leverage different ways... 
    Senior
    Local area

    Deloitte

    Boston, MA
    1 day ago
  • $93.6k - $158.4k

     ...ID: 8726Your Impact at LILALila is building a dedicated platform evaluation function within our robotics organization. The team tests and...  ...challenges. We believe science is the most inspiring frontier for AI. Rather than hard-coding expert knowledge into tools, LILA builds... 
    Senior
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    Somerville, MA
    1 day ago
  • $142k - $190k

    The Senior Data Science Manager, Predictive Analytics & AI - US Commercial will be responsible for developing, implementing and optimizing of machine learning and...  ...solutions supporting U.S. Commercial function. Evaluate business and analytical needs to select and implement... 
    Senior
    Full time
    Temporary work
    Work at office
    Local area
    3 days per week

    Biogen Idec

    Cambridge, MA
    3 days ago
  • $225k

     ...DoThe Information Security Senior Director serves as the...  ...on enterprise cybersecurity strategy, risk governance...  ...support proposal responses.AI Security Governance: Provide...  ...cloud service provider evaluations across subcontractors...  ...and teamwork.*** For US locations only *** In... 
    Senior
    For subcontractor
    Work at office
    Local area

    The Boston Consulting Group

    Boston, MA
    11 hours ago
  • $105.4k - $207.8k

     ...As a Sr. Consultant: AI Security, Identity in our...  ...Qualifications3-5+ years of cybersecurity experience, including 1...  ...red teaming, security evaluations, secure AI development...  .... It enables us to leverage different ways...  ...entry-level employees to senior leaders, we believe there... 
    Senior
    Local area
    Visa sponsorship

    Deloitte

    Boston, MA
    3 days ago
  • $105.4k - $207.8k

     ...As a Sr Consultant: AI Data Security in Deloitte...  ...3-5+ years of combined cybersecurity and AI engineering experience...  ...red teaming, security evaluations, secure AI development...  .... It enables us to leverage different ways...  ...entry-level employees to senior leaders, we believe there... 
    Senior
    Local area
    Visa sponsorship

    Deloitte

    Boston, MA
    3 days ago
  • $90k - $180k

     ...Application Support team is seeking a Senior Systems Analyst to join the Data Support...  ...with the integration of AI technologies into GDAS...  ...with prompt engineering and evaluating AI output quality, accuracy,...  ...one of our jobs, please email us at ****@*****.***... 
    Senior
    Full time
    Remote work
    Flexible hours
    Rotating shift
    Weekend work
    1 day per week

    Wellington Management

    Boston, MA
    3 days ago
  • $105.4k - $207.8k

    Position Summary As a AI Infrastructure Senior Consultant in our Cyber for...  ...3-5+ years of combined cybersecurity and AI engineering experience...  ..., red teaming, security evaluations, secure AI development practices...  ...collectively. It enables us to leverage different ways... 
    Senior
    Local area
    Visa sponsorship

    Deloitte

    Boston, MA
    3 days ago
  • $99.6k - $174k

    Senior Full Stack Engineer, AI Platform & AgentsBuild the GenAI platform that powers critical decisions in...  ...making at a global scale.-Location:: US/Canada, Hybrid or Remote-Work Hours:...  ...concept to production, including safety evaluations, iterative testing (e.g., A/B testing... 
    Senior
    Full time
    Work at office
    Remote work
    2 days per week

    Wolters Kluwer

    Waltham, MA
    3 days ago
  • $105.6k

     ...Technology Audit & Advisory Senior...  ...our way, inclusion moves us forward together, innovation...  ...managed by incorporating AI and automation. Technology...  ...related topics, including: Cybersecurity Cloud Assurance Project...  ...automation, AI/ML etc.).  Evaluating, summarizing, organizing... 
    Senior
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours

    Protiviti

    Boston, MA
    2 days ago
  • $125k - $205k

     ...investments.Built on a native, AI-powered platform and more than...  ...results. Learn more at later.com.Senior Security EngineerAbout this...  ...party compensation sources to help us understand the market value of...  ...geographic location, and scope. We evaluate compensation bi-annually,... 
    Senior
    Permanent employment
    Local area
    Remote work

    Later

    Boston, MA
    1 day ago
  • $99k - $225k

    RMF Cybersecurity AnalystThe Opportunity:Cyber threats are everywhere...  ...systems.Work with us as we protect our...  ...5+ years of experience evaluating the compliance of a system...  ...engineer, requirements analyst, ISSO, ISSM, or...  ...prevent fraud.Candidate AI Usage PolicyAI is a part... 
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Remote work

    Booz Allen Hamilton

    Lexington, MA
    4 days ago
  • $135k - $180k

     ...Summary: We're looking for a Senior Corporate Security Engineer to...  ...risk management for corporate AI usage - SaaS AI feature adoption...  ...or Entra ID, including how to evaluate and harden tenant configuration...  ...life for all people-supporting us at home, at work, in factories,... 
    Senior
    Work at office
    Flexible hours
    Day shift

    Walden Robotics

    Cambridge, MA
    1 day ago
  • $102.7k

     ...JOB SUMMARY CANDIDATE MUST BE US Citizen (due to contractual/access...  ...Highmark Health is seeking a Senior Security Engineer to join our...  ...development process, including within AI-assisted development workflows,...  ...-fidelity, actionable signal. Evaluate, onboard, and operationalize... 
    Senior
    For contractors
    Work at office
    Local area
    Shift work

    Highmark Health

    Boston, MA
    1 day ago
  • $149k - $198k

    As a Senior Enterprise Sales Engineer, you’ll serve as a trusted technical...  ...You’ll lead complex technical evaluations, align solutions to business...  ...capability of utilizing AI tooling and scaling it Growth...  ...If you would like to contact us regarding the accessibility of... 
    Senior

    Datadog

    Boston, MA
    3 days ago
  • $120k - $202.5k

     ...ForWe are looking for a Senior Application Security...  ...-native platforms, and AI-enabled systems. You will...  ...science, cloud engineering, cybersecurity, and business teams to...  ...across the enterprise.Evaluate emerging application...  ...institutional investors rely on us to help them manage... 
    Senior
    Full time
    Temporary work
    Flexible hours
    Shift work

    State Street Bank

    Quincy, MA
    2 days ago
  • $120k

     ...carries our newly rolled out CASB, Generative AI Control, and DLP capabilities forward as...  ...policy coverage and adoption.Research and evaluate emerging security technologies, producing...  ..., CISSP, GIAC).What you can expect from us:• Base annual salary target starts at $120... 
    Local area
    Remote work
    Worldwide

    IDEXX Laboratories

    Boston, MA
    3 days ago
  • $95k - $140k

     ...celebrating the differences that make us who we are and the work we do...  ...world, we enable it. Senior Product Security Engineer...  ...assessment, development, and evaluation of security solutions and architectures...  ...services. ~ Exposure to AI/ML security, responsible AI... 
    Senior
    Work at office
    Local area
    Immediate start
    Visa sponsorship
    Flexible hours

    PTC

    Boston, MA
    3 days ago
  • About Us:Proofpoint is a global leader in human- and agent-centric cybersecurity. We protect how people, data, and AI agents connect across email, cloud, and...  ...every single day. As a Senior Sales Engineer in the fast...  ...(POC) and Production Evaluations You will design and champion... 
    Senior
    Full time

    Proofpoint

    Boston, MA
    2 days ago
  • $119.7k - $222.3k

     ...use of artificial intelligence (AI) enabled strategies to...  ...experience to be considered for Senior Principal Scientist.Extensive...  ...including, drug metabolism and PK/PD evaluation, experience in working in...  ...considered for annual equity awards.US-based eligible employees will... 
    Senior
    Full time

    Novartis

    Somerville, MA
    11 hours ago
  • $100k - $150k

     ...operating efficiencies. We’re building an AI-first audit function, using AI and automation...  ...Cycle Controls (SDLC), address risks and evaluate the related ITGC controls across homegrown...  ...Auditing Standards, COSO 2013, COBIT, US GAAP, Internal Audit Standards, including... 
    Senior
    Work at office

    Klaviyo

    Boston, MA
    11 hours ago
  • $120k - $140k

    Our cybersecurity and information security teams at IDEXX contribute to a more resilient...  ...seeking an experienced and proactive Senior Cybersecurity Analyst & Threat Hunter to join our security...  ...occasionally.What you can expect from us:• Base annual salary target: $120000-... 
    Senior
    Local area
    Worldwide
    Relocation

    IDEXX Laboratories

    Boston, MA
    11 hours ago
  • $130k - $200k

    Position Summary AI Conversation Design Senior ConsultantOur Deloitte Sales & Service team empowers...  ...client-facing POCs and demos.Define evaluation frameworks and test suites for LLM-...  ...organizational performance.#Customer_US#SS_US Deloitte is committed to... 
    Senior
    Local area
    Visa sponsorship

    Deloitte

    Boston, MA
    1 day ago
  • $81k - $121.4k

     ...motivated and analytical Junior Cybersecurity Threat Hunter & Analyst to join our Cybersecurity...  ...behavior, and work with senior cybersecurity team members...  ...belief continues to guide us. The Global Spirit is the cornerstone...  ...platform. Leverage Agentic AI to assist with incident... 
    Permanent employment
    Local area

    Global Partners

    Newton, MA
    1 day ago
  • $70 - $85 per hour

    Sr Cybersecurity Strategic Advisor (GRC, IAM & Third-Party Risk...  ...are seeking a Senior Cybersecurity Advisor/Manager...  ...Asia, who partner with us for our scale, full-stack...  ...Intelligence (AI): We may use Artificial...  ...sourcing, screening, and evaluating candidates. AI helps assess... 
    Contract work
    Temporary work
    Immediate start
    Remote work

    TEKsystems

    Boston, MA
    2 days ago
  •  ...Management, IT Operations Management, AI, and Data Foundations to...  ...business process consultant, business analyst, or functional leadRequired...  ...meaningful impact. What sets us apart? We believe work should...  ...San Francisco, Silicon Valley:* Senior Principal: $222,000-$271,000* San... 
    Senior
    Temporary work
    Local area
    Flexible hours

    Slalom

    Boston, MA
    3 days ago
  • $148k - $222k

     ...How you’ll make an impactAs a Senior Software Engineer on the Infrastructure...  ...’ve already experimented with AI in work or personal projects,...  ...runs on AWS. Engineers join us from a wide range of technical...  ...it as an AEDT. As part of the evaluation process we provide Covey with... 
    Senior
    Relocation

    Klaviyo

    Boston, MA
    11 hours ago
  • $116.2k - $229.1k

     ...career to new heights? Join our US Supply Chain & Network Operations...  ...Work You’ll DoThe Software & ALM Senior Consultant executes hands-on delivery to build AI-enabled software and systems engineering...  ...approvals and auditability.Build evaluation approaches/harnesses to measure... 
    Senior
    Local area

    Deloitte

    Boston, MA
    11 hours ago
  • $180k - $256k

     ...'re building a talent-dense, high-agency AI safety team at Lila that will engage all...  ...broader ecosystem engagement, safety-focused evaluations, safety systems to mitigate risks, and a...  ...that informs safety decisions made by senior leadership at Lila.What You'll Be BuildingTranslate... 
    Senior
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    Somerville, MA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Cybersecurity Analyst - AI Evaluation (US). Be the first to apply!