Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

GenAI Security Evaluation Engineer (Up to $150/hr)

$150 per hour
Part-time

Turing

Evaluate security tools for vulnerabilities in GenAI applications.

About Turing

Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.

Offer Details

  • Required commitment: At least 4 hours per day, minimum 20 hours per week, with 4 hours of overlap with Pacific Time.
  • Engagement type: Contractor
  • Engagement length: Up to 2 weeks
  • Pay up to $150/hr depending on internal evaluation and location. 

About the Role

We’re looking for experienced security engineers to evaluate how effectively static analysis tools detect vulnerabilities in GenAI applications.

You’ll build small, runnable agent and RAG codebases containing realistic examples of Sensitive Information Disclosure and Excessive Agency, along with fixed and near-miss versions. You’ll then trace, annotate, test, and explain each finding.

What You’ll Do

  • Build runnable agent/RAG repositories with code-reachable Sensitive Information Disclosure or Excessive Agency vulnerabilities across tool calling, memory, and MCP.
  • Create vulnerable, fixed, and hard-negative variants with minimal security-relevant differences.
  • Trace and annotate assets, data/action paths, controls, root causes, severity, and residual risk.
  • Define authorization contexts and write deterministic tests validating vulnerable, fixed, and negative behavior.
  • Recommend security controls and participate in calibration and peer review.

What We’re Looking For

  • 5+ years in application/product security or security-focused software engineering, including secure code review.
  • Experience with source-to-sink analysis, taint analysis, SAST, CodeQL, or Semgrep.
  • Hands-on experience building LLM agents or RAG systems using frameworks such as LangChain, LlamaIndex, OpenAI/Anthropic SDKs, or MCP.
  • Strong authorization knowledge, including actors, trust boundaries, tenants, OAuth, IAM, identity, permitted data/actions, purposes, recipients, and document-level access control.
  • Production coding experience in Python and/or TypeScript, with strong judgment in distinguishing genuine SID/EA findings from non-findings.

Experience with OWASP LLM security risks, MCP, threat modeling, or security evaluation is a plus.

Evaluation Process

  • AI interview (~25 minutes)
  • Resume and overall application review
  • Offer

Skills: Cyber Security, LLM, Code Reviews, Code Analysis

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the GenAI Security Evaluation Engineer (Up to $150/hr) in San Francisco, CA vacancy
  • $75 - $90 per hour

     ...Rate: $75 – $90/hr Hours: 20 hours / week Experience: 5 - 10 years...  ...Canada + 21 more Help a top AI lab evaluate and improve large language models through security-focused coding tasks. Bring your software-engineering judgment and hands-on security experience... 
    Suggested
    Temporary work
    Remote work

    Braintrust

    San Francisco, CA
    2 days ago
  • $166.6k - $212.8k

     ...communities around the world.We are a specialized security team that sits inside a global satellite...  ...responding to builder teams, you will evaluate overall security posture across the...  ...in a STEM field (Science, Technology, Engineering, Mathematics), or 4+ years of IT... 
    Suggested
    Permanent employment
    Local area
    Immediate start
    Flexible hours
    Shift work

    Amazon

    San Francisco, CA
    3 days ago
  • $237.6k - $297k

    We are seeking a highly technical Security Engineer to join our Product Security team. This role is integral to ensuring the security and...  ...reviews to identify and remediate security vulnerabilities.Evaluate and enhance the security of our product offerings, through RFC... 
    Suggested
    Full time

    Scale AI

    San Francisco, CA
    7 days ago
  •  ...complex network infrastructure, routing, and security configuration issues across both on-...  ...Founded in 2016, Crypto.com serves more than 150 million customers and is the world's...  ...tools assist our recruitment team in their evaluation of your application by providing... 
    Suggested
    Work at office

    Crypto.com

    San Francisco, CA
    15 days ago
  • $155.58k - $320.32k

     ...in our recruiting process here.We’re looking for a Senior Security Software Engineer to provide technical leadership within Security Operations...  ...ambiguous technical initiatives, including defining architecture, evaluating tradeoffs and delivering impact beyond a single team.... 
    Suggested
    Work at office
    Local area
    Remote work
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    3 days ago
  • $175k - $220k

     ...officeAbout the RoleWe are looking for a highly technical Senior Security Engineer who is passionate about protecting data across modern SaaS,...  ...engineering practices to solve data security challenges.Evaluate emerging technologies and drive adoption where they provide... 
    Full time
    Work at office

    Sigma Computing

    San Francisco, CA
    6 days ago
  • $128.9k - $180k

     ...we can’t wait to meet you. WHAT YOU'LL DO As a Senior Security Engineer on the Enterprise Security team, you'll protect Braze employees...  ...and production IT security support Perform the Evaluation and Recommendation of current and future technology solutions... 
    Full time
    Work at office
    Flexible hours

    Braze

    San Francisco, CA
    11 days ago
  • $141.6k - $212.4k

     ...creators to own their own destiny.Klaviyo is looking for a Senior Security Engineer to add to our growing Detection and Response (D&R) Team....  ...certain features may qualify it as an AEDT. As part of the evaluation process we provide Covey with job requirements and candidate... 

    Klaviyo

    San Francisco, CA
    7 days ago
  • $150k - $240k

     ...re assembling a diverse, world-class team—engineers, designers, researchers, and product...  ...best work.About The RoleAs an Offensive Security Engineer within HP IQ’s Product Security...  ...offensive findings.​​​​​​​​​​​​​​​​Salary: $150,000- $240,000Compensation & Benefits (Full... 
    Full time
    Temporary work
    Local area
    Flexible hours

    HP IQ

    San Francisco, CA
    5 days ago
  • $130k - $200k

     ...see it in full.About the teamAirwallex’s Information Security team partners closely with engineering, IT, and other stakeholders to protect our systems, data...  ..., digital forensics.Design, develop, test, and evaluate new corporate security controls for a rapidly growing... 
    Temporary work
    Local area

    Airwallex

    San Francisco, CA
    3 days ago
  • $266k - $385k

     ...intelligence benefits all of humanity.The Security team protects OpenAI’s technology,...  ...security culture.About the RoleAs a Security Engineer on Detection & Response, you’ll help...  ...when it’s the fastest/most effective path).Evaluate and respond to emergent security concerns... 
    Work at office
    Local area
    Flexible hours

    OpenAI

    San Francisco, CA
    3 days ago
  • $10 per hour

     ...tier-1 queue here. Detection & Response engineers own their detections end to end: you write...  ...your team is paged when they fire. The security team is spread across the globe with a...  ...an incident.A track record of critically evaluating and verifying AI-assisted work - testing... 
    Work at office
    Local area
    Immediate start
    Relocation
    Relocation package
    Flexible hours

    Flexport

    San Francisco, CA
    4 days ago
  • $174.5k - $240k

     ...adoption moving fast, safely:The Enterprise Security team at Faire owns the tools and...  ...and AI governance.As our Senior Security Engineer focusing on Enterprise AI, you will own...  ..., OpenAI, Portkey, Fireworks, and more, evaluating and enabling features as they launch.Partner... 
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday
    Flexible hours
    3 days per week

    Faire

    San Francisco, CA
    7 days ago
  • $180k - $280k

     ...get issues fixed.You'll lead application security across our SaaS and AI products as part of our infrastructure team within Engineering. Working directly with product managers and...  ..., testing, or remediation and can evaluate their limitations. You have a point of view... 
    Shift work

    Assembled

    San Francisco, CA
    7 days ago
  • $230k - $390k

     ...led the product and design teams for Google Workspace.Security EngineerSecurity Engineering builds the foundations that let Sierra deliver powerful...  ...doesn't precisely match the job description. We strive to evaluate all applicants consistently without regard to race,... 
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    3 days ago
  • $175k - $220k

     ...officeAbout the RoleWe are looking for a highly technical Senior Security Engineer who thrives on building security capabilities from the...  ...security tools, dashboards, APIs, services, and integrations.Evaluate emerging technologies and drive adoption where they provide... 
    Full time
    Work at office

    Sigma Computing

    San Francisco, CA
    6 days ago
  •  ...customers. Cohere is a team of researchers, engineers, designers, and more, who are passionate...  ...building great products. As a Senior Security Engineer you will Serve as trusted...  ...and scale security processes, i.e.: evaluate open-source vs vendor solutions Gather... 
    Full time
    Work at office
    Remote work
    Flexible hours

    Cohere

    San Francisco, CA
    4 days ago
  •  ...Overview We are looking for a seasoned Senior / Staff Network Security Engineer to spearhead our security strategy and defend our fast-...  ...assets while empowering the business. Skilled in crafting and evaluating security controls for massively scalable systems, and familiar... 
    Full time

    Hamilton Barnes ?

    San Francisco, CA
    4 days ago
  • $220k

     ...Venture Partners, and Craft Ventures.The Security Team @ PaveSecurity at Pave protects the...  ...across domains. As Pave's Corporate Security Engineer, you'll own the corporate side of that...  ...experience (nice to have)Background at a 150-500 person B2B SaaS company handling sensitive... 
    Work at office
    Flexible hours

    Trove Information Technologies

    San Francisco, CA
    3 days ago
  • $175k - $270k

     ...build what’s next.About the teamAirwallex’s Information Security team partners closely with engineering, IT, and other stakeholders to protect our systems,...  ..., digital forensics.Design, develop, test, and evaluate new corporate security controls for a rapidly growing... 
    Temporary work
    Local area
    Worldwide

    Airwallex

    San Francisco, CA
    3 days ago
  • $275k - $300k

     ...at Postman.About the TeamThe Information Security organization at Postman operates across...  ...looking for a Principal Offensive Security Engineer who is as much a strategist as they are...  ...manual test twice. You can architect evaluation harnesses and adversarial test suites for... 
    Full time
    Work at office
    Flexible hours
    3 days per week

    Postman

    San Francisco, CA
    5 days ago
  • $266k

     ...artificial general intelligence benefits all of humanity. The Security team protects OpenAI’s technology, people, and products. We are...  ...engaging a robust security culture. About the RoleAs a Security Engineer, Application Security you will be responsible for identifying and... 
    Work at office
    Remote work
    Relocation package
    Flexible hours

    OpenAI

    San Francisco, CA
    7 days ago
  • $200k - $220k

     ...employees, their laptops, their identities, and the SaaS apps they rely on every day.We are looking for a hands-on Corporate Security Engineer to own and improve the technical controls that keep our workforce and corporate environment safe. This is a security engineering... 
    Work at office
    Local area

    Notion Labs

    San Francisco, CA
    3 days ago
  • $10 per hour

     ...impact business, society, and the environment? Come join us.All security disciplines work under the umbrella of the combined PSI (...  ...Infrastructure) team: we build the paved path and tooling that hundreds of engineers around the world rely on every day to ship. Corporate Security... 
    Work at office
    Immediate start
    Relocation
    Relocation package
    Flexible hours

    Flexport

    San Francisco, CA
    5 days ago
  • $226k - $300k

     ...of an exciting phase and we’re excited to hire a Principal Security Engineering / Security Architect to define secure-by-design architecture...  ...in conjunction with performance review cycles. By evaluating compensation on a regular basis, we are able to reward high... 
    Work at office
    Immediate start
    3 days per week

    Altruist

    San Francisco, CA
    5 days ago
  • $226k - $283k

     ...workflows inside some of the country’s most security-sensitive health systems. Security can't be bolted on - it must be engineered into the product. This is a senior...  ...integration, tuning, triage, maintenance, and evaluation. AI-augmented security engineering. You... 
    Work at office
    3 days per week

    Ambience Healthcare, Inc.

    San Francisco, CA
    5 days ago
  • $232k

     ...team: As a member of Uber’s Offensive Security team, you will work across multiple...  ...We are looking for a technically curious engineer who thrives in ambiguity, takes extreme...  ...modeling for AI agents and agentic systems, evaluating risks across models, tools, data,... 
    Full time
    Work at office
    Remote work

    Uber Technologies Inc

    San Francisco, CA
    3 days ago
  • $2,150 per month

     ...Cybersecurity Expert Type: Contract Compensation: $1,750–$2,150 total Location: Remote Responsibilities Review and evaluate AI-generated outputs related to threat analysis, vulnerability assessment, and security architecture recommendations. Create realistic scenarios... 
    Hourly pay
    Contract work
    Part time
    Summer work
    Remote work

    Mercor Inc

    San Francisco, CA
    3 days ago
  • $160k - $250k

     ...see it in full.About the teamAirwallex’s Information Security team partners closely with engineering, IT, and other stakeholders to protect our systems, data...  ...security improvements.Design, develop, test, and evaluate new security controls for a rapidly growing business.... 
    Temporary work
    Local area

    Airwallex

    San Francisco, CA
    6 days ago
  • $148.5k - $223.9k

     ...you are the future of Salesforce.Job Title: Senior Product Security Engineer, InfrastructureJob Category: Technology / SecurityLocation:...  ...Top 10, Common Weakness Enumeration (CWE) Top 25), and can evaluate and communicate security risk to technical and non-technical... 
    Full time

    Salesforce

    San Francisco, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to GenAI Security Evaluation Engineer (Up to $150/hr). Be the first to apply!