AI Security Engineer - Red Team & Agent Evaluation
Alexander Chapman
Alexander Chapman in San Francisco is seeking a Member of Technical Staff to lead red-teaming and evaluation of frontier AI agents. The successful candidate will own AI agent assessments, improve evaluation infrastructure, and develop novel adversarial attacks. The ideal applicant should possess strong backend engineering skills, thrive in fast-paced environments, and have clarity in technical communication. Bonus points for experience in startups, security, or AI agents. #J-18808-Ljbffr Alexander Chapman
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Security Engineer - Red Team & Agent Evaluation in San Francisco, CA vacancy
- Motion Recruitment Partners LLC is seeking an AI Security Engineer for a remote position. The successful candidate will focus on evaluating security models and building controls... ...experience in securing LLM systems and red teaming. This is a 6-month contract-to-hire role...SuggestedRemote jobContract work
- B Capital in San Francisco is looking for individuals passionate about AI safety to own the red-teaming and adversarial evaluation pipeline for their models. The role involves collaborating with the Alignment team and ensuring all releases meet safety thresholds. Candidates...Suggested
- ...looking for a highly skilled Offensive Security Engineer to join our security team in San Francisco. This role involves planning and executing red team operations, as well as penetration... ...our infrastructure, applications, and AI systems. The ideal candidate has over 5...Suggested
- Anysphere is seeking a Software Engineer for the Agent Quality team in San Francisco, CA. In this role, you will... ...design and build infrastructure to evaluate and improve ML agents. Responsibilities... ...candidates will have experience in AI evaluations, data analysis, and solid...Suggested
- Brain Co. in San Francisco is looking for a Security Engineer for Applications & AI. You will be responsible for integrating security practices into product... ...coding. Competitive salary, daily lunches, and strong team collaboration are part of the offer. #J-18808-Ljbffr...Suggested
$130k - $220k
...Analysis is the leading independent AI benchmarking and insights company. They help engineers, enterprises, investors, media,... ...24, has raised $3.5M, and has a team of 30+ employees across San... ...role is best described as an AI Evaluation Engineer / Technical Generalist....Full timeWorldwideAurora Jobs ApS
San Francisco, CA2 days ago- ...foundation of useful, agentic AI. We are here to take a big swing at the most ambitious engineering challenge of our careers. Everyone... ...of an effective background agent. Let's design and build the rest... ...interview day. Meet the whole team, then you'll have 3-4 hours to...Work at officeImmediate start
$176k - $253k
...Senior Member of Technical Staff, AI Quality, in San Francisco. Your main goal will be to turn agent quality into quantifiable... ...high standards through robust evaluation processes. You'll build capability... ..., and work directly with engineers to ensure our AI systems excel...$200k - $275k
...blockchain analytics and AI solutions to help law... ...and national security agencies, financial institutions... ...world for all. The AI Engineering Team is chartered with... ...also deeply involved in evaluating and integrating cutting... ...tools in the LLM and agent space — including open...Work at officeLocal areaRemote workWorldwide3 days per weekTRM Labs
San Francisco, CA1 day ago- ...re looking for a founding engineer focused on building production agents—someone who will push our... ...Agents on a New AI Platform This isn’t a typical... ...Collaborate Closely with Product & Evaluation: Work with PMs and... ...tooling used by engineering teams. Prior work with...Flexible hours
Guild.ai, Inc.
San Francisco, CA2 days ago - ...Software Engineer, Agent Evaluation and Quality Engineering · Full-time · San Francisco; New York... ...Our organization is very flat, and our team is small and talent dense. We particularly... ...Designing and building best-in-class AI evaluation system: curated datasets, offline...Full timeWork at office
Anysphere
San Francisco, CA4 days ago $240k - $360k
...leader to oversee the detection, mitigation, and governance of AI agent abuse. Your role will combine offensive and defensive skills, shaping secure agent architectures while championing necessary engineering changes. The role requires extensive experience in security,...$240k - $280k
Sentry, located in San Francisco, is searching for a Senior Software Engineer to enhance its AI/ML team. In this role, you'll build the evaluation infrastructure for AI systems, ensuring they perform accurately and reliably. Responsibilities include designing datasets,...- A cutting-edge AI firm in San Francisco is seeking a Research Engineer to develop evaluation systems and benchmarking pipelines for language models. Candidates should have... ...work collaboratively with cross-functional teams and operate in a fast-paced environment, conducting...
$160k - $210k
About the Role We’re seeking a strong Software Engineer to join our AI Evaluation team, focused on building the infrastructure and internal tooling that... ..., including automated testing platform for AI voice agents, debugging and observability tools. Develop and productionalize...Flexible hours- A leading cybersecurity firm in San Francisco is looking for an experienced AI engineer to design and build intelligent autonomous security testing agents. The role requires 8+ years of engineering experience and deep expertise in AI/ML, particularly with large language...Remote job
$170k - $190k
...CodeIntegrity CodeIntegrity builds security infrastructure for AI agents. As AI systems connect to... ...'ll work across security engineering, applied research, and... ...test cases that help us evaluate risks and shape product... .... Work closely with the team to identify the security...$240k - $280k
A leading software monitoring company is seeking a Senior Software Engineer on its AI/ML team to build evaluation infrastructure for measuring the performance of AI systems. This role involves designing datasets, creating benchmarks, and ensuring AI features behave reliably...- black.ai is seeking a Senior Research Engineer in San Francisco to develop next-gen generative video and audio technology... ...for multi-turn sessions, building evaluation metrics, and closely collaborating with product and design teams. The ideal candidate should have 5+ years...
$240k - $360k
## AI Agent Abuse Prevention EngineerPostulerremote type... ...sensibility to design secure agent architectures,... ...company-wide and engineering changes to prevent AI... ...Platform, Product, and SDK teams to bake secure defaults... ...be used to screen or evaluate applications for this...Remote work- ...About the Team The Codex Core Agent team builds the kernel of Codex. We own making... ...We’re looking for applied AI engineers to help bring Codex agents... ...real‑task data into evaluation and research. Work with product... ...duties require access to secure and protected information...
Slope
San Francisco, CA1 day ago - B Capital seeks a talented individual for an AI Evaluation role in San Francisco. This position involves conducting critical comparative analysis... ..., refining evaluation systems, and collaborating with various teams to enhance model capabilities. The ideal candidate will have...
- ...Francisco is seeking an innovative Quality Engineer for their AI products. This role blends ops,... ...quality. As part of the AI engineering team, you will use data to shape how AI behaves... ...user satisfaction through effective evaluation baselines. Competitive salary and...
- An innovative AI company in San Francisco is looking for an Applied AI Engineer to develop LLM-driven features aimed at enhancing interactions on their... ...closely with product and engineering teams, and creating robust evaluation frameworks. This position offers an exciting...
- ...with Gen3, a cutting-edge AI Agent system that's pushing the boundaries... ...influential Staff AI Agent Engineer to join our team. In this role, you'll be... ...architectural risks.* Evaluate and select appropriate foundation... ...Designing and implementing secure and scalable integrations...Work at officeLocal areaRemote work
- AI Systems Engineer - Codex Core Agents About the team: The Codex Core Agents team builds the agent harness that turns... ...sandboxed execution, orchestration, evaluations, production reliability, and the... ...under demanding reliability and security constraints. Open‑source...
- AI Systems Engineer - Codex Core Agents Location San Francisco Employment Type Full time... ...development environments. Develop evaluation, experimentation, and... ..., and easier for other teams and open-source users to... ...reliability and security constraints. Open‑source...Full timeWork at officeLocal areaRelocation packageFlexible hours
- Cacheflow is seeking a Senior Applied Research Engineer to enhance the effectiveness of our AI systems through focused research and experimentation. This role involves designing information retrieval strategies and collaborating with engineers to turn validated approaches...Flexible hours
- A leading AI research organization in San Francisco seeks applied AI engineers to enhance Codex agents for software engineering tasks. This role involves designing agent... ..., and collaborating with research teams on performance evaluation. Candidates should have a strong...
- ...seeking an Enterprise Solutions Engineer to support enterprises in securing software. This role entails leading technical evaluations, working directly with security and engineering teams, and translating results... ...impact in a growing AI security startup. #J-18808-...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Security Engineer - Red Team & Agent Evaluation. Be the first to apply!
Related searches
- ai engineer remote San Francisco, CA
- ai developer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- ai engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- ai research engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- information technology security engineer San Francisco, CA
- principal security engineer San Francisco, CA