Senior AI Safety & Abuse Prevention Engineer
Zendesk, Inc.
Zendesk, Inc. is seeking an AI Agent Abuse Prevention Engineer to lead the detection and mitigation of AI-related security threats. The ideal candidate will have 10+ years of experience in cybersecurity, particularly within SaaS environments, and will design secure architectures while collaborating with various teams. This position offers a hybrid working model allowing flexibility for remote work and in-office collaboration. The annual salary ranges from $240,000 to $360,000, with potential bonuses and benefits. #J-18808-Ljbffr Zendesk, Inc.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior AI Safety & Abuse Prevention Engineer in San Francisco, CA vacancy
$196k - $294k
...behind v0, Next.js, and AI SDK, Vercel helps customers... ...just ship things. As a Senior Software Engineer on our Trust & Safety team at Vercel, you’ll build... ...and projects from abuse at internet scale. You’ll... ...detection, classification, and prevention. Design and develop...SeniorWork at officeRemote workWork from homeMonday to FridayFlexible hoursNerdleveltech
San Francisco, CA3 days ago- Zendesk Group is looking for an AI Agent Abuse Prevention Engineer in San Francisco, California. This role involves leading the detection, mitigation, and governance of AI agent-related abuse. The ideal candidate will have over 10 years of experience in cybersecurity,...SeniorFlexible hours
- ...a machine learning research engineer at Scale AI. The rest of our team comes... ...Justworks, Together.AI, Flock Safety, Hightouch and more. We’re a... ...state-of-the-art AI. As a Senior SRE, you'll tackle the scaling... ...blameless postmortems that prevent recurrence. Who You Are...Senior
Unify
San Francisco, CA3 days ago $196k - $220.5k
...after playing games. The Safety Processing team builds the infrastructure... .... We're looking for a Senior Software Engineer who can take ownership of... ...systems to anticipate abuse patterns, edge cases, and failure... ...stakeholders. ~ Using Gen AI products, like Claude Code,...SeniorFull timeRelocationRelocation packageDiscord
San Francisco, CA3 days ago$200k - $250k
...combines modern web tooling with AI-powered workflows. Our stack... .... We’re hiring a senior owner of stability and infrastructure... ...service reliability end-to-end: prevent incidents, reduce blast radius... ...resource policies, and startup safety. Queue + job safety (BullMQ/Redis...SeniorPermanent employment- A leading AI research organization in San Francisco is looking for a Senior Research Engineer. In this role, you will own research projects, design experiments on large language... ...valuable benefits like health insurance and unlimited PTO. #J-18808-Ljbffr Center for AI SafetySenior
$200k - $400k
...Senior Software Engineer - Agentic Systems We are partnered with a highly technical AI research company building advanced AI systems capable of operating across complex, real... ...infrastructure, with a strong emphasis on safety, reproducibility, and first‑principles design...SeniorFull timeImmediate startStrativ Group
San Francisco, CA3 days ago$215k - $265k
COL Limited is looking for a Software Engineer to build the crucial platform for Apollo Research, enhancing our operational efficiency. The role includes responsibilities like developing cloud infrastructure, ensuring security, and maintaining reliability. You will need...Senior- 100 Salesforce, Inc. is looking for an AI Platform Engineer in San Francisco. You will build the next-generation ML/AI platform supporting autonomous AI agents. The role involves designing agent systems, ensuring effective evaluation, and managing CI/CD workflows. Ideal...Senior
- ...Anthropic, a public benefit corporation, is seeking a trust and safety software engineer to develop systems that ensure user well-being and prevent misuse of AI models. The role involves building monitoring systems, analyzing user reports, and collaborating with research...
Menlo Ventures
San Francisco, CA3 days ago - ...About the Role As a Senior Software Engineer on the Pay squad, you'll own the systems that move money to Handshake AI's global fellow workforce. That includes earnings calculation... ...out a much more sophisticated Trust & Safety surface area: KYC and identity verification...SeniorContract workWork at officeFlexible hours
Handshake
San Francisco, CA3 days ago - ...Safer World TRM Labs provides AI-powered intelligence solutions... ...safer and more secure. The AI Engineering Team is chartered with enabling... ...to be deployed with speed, safety, and scale. We manage petabyte... ...the market. About the Role As a Senior or Staff ML Systems Engineer -...SeniorRemote workWorldwide
$208k - $312k
...Vercel is seeking a Senior Software Engineer for our Trust & Safety team to build and operate systems that protect millions of developers. The role requires analyzing threat behaviors and detecting abuse patterns while working closely with various teams. Candidates should...SeniorRemote workVercel Corp
San Francisco, CA4 days ago$124k - $280k
...Specialty/Competency: Data, Analytics & AI Industry/Sector: Health Services Time... ...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies... ...tailored for health systems. As a Senior Manager, you will serve as a strategic advisor...SeniorFull timeH1bPwC
San Francisco, CA18 hours ago$215k - $250k
...time Location Type On-site Department Engineering About the Company World is a network of... ...our App and our controls for Fraud, Risk, Safety, and Security are a broad set of... ...specific features (Android, iOS etc) to prevent misuse. Advocate for our users, partnering...SeniorFull timeFlexible hours$175k - $200k
...the role We’re seeking a Safety Engineer to lead safety performance evaluations... ...analytics to forecast and prevent safety issues Evaluate... ...for more open roles. Seniority level ~ Seniority level... ...each article, started with the help of AI. #J-18808-LjbffrSeniorOdd jobFull timeWork at officeGatik
San Francisco, CA3 days ago$196k - $294k
...Nerdleveltech seeks a Senior Software Engineer to join their Trust & Safety team. Based in San Francisco, you'll protect millions of developers from abuse at internet scale, using your skills in JavaScript, Python, and LLM methodologies. Responsibilities include analyzing...SeniorFlexible hoursNerdleveltech
San Francisco, CA3 days ago- ...The Safety Systems team is dedicated to ensuring the safety, robustness, and reliability of AI models and their deployment in the real world.... ...we're seeking a software engineer to help us build out our trust... ...systems that detect and prevent abuse, promote user safety, and...
OpenAI
San Francisco, CA7 days ago $57 - $61 per hour
...Join to apply for the Software Engineer, AI Safety, Mid-Level role at Jobright.ai 2 days... ...implementing systems that detect and prevent abuse while promoting user safety. The role... ...of offering H1B sponsorships. Seniority level ~ Seniority level Mid-Senior...Full timeSummer workInternshipH1bjobright.com
San Francisco, CA3 days ago$170k - $240k
...company and the leader in AI music. We are backed by leading... ...Suno is hiring a Software Engineer, Trust and Safety, to be on the front lines... ...our platform and users from abuse, fraud, and harmful... ...user verification, and abuse prevention ~ Analyze large datasets...Full timeWork at officeLocal areaSUNO
San Francisco, CA4 days ago$124k - $280k
...Specialty/Competency: Data, Analytics & AI Industry/Sector: Health Services Time... ...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies... ...of health system and health plans. As a Senior Manager, you will drive use case...SeniorFull timeH1bPwC
San Francisco, CA2 days ago- ...important — than ever, with AI enabling fraudsters to... ...to comply with online safety regulations, protecting... ...from large-scale abuse in a time when AI is reshaping... ...isn't just another engineering role. This is a unique... ...systemic improvements to prevent future failures. Design...SeniorFull timeTemporary workFor contractorsInternship
Persona
San Francisco, CA4 days ago $196k - $220.5k
...of Discord's communities is Safety. The Safety team at Discord is... ...belonging by minimizing exposure to abuse on the platform. We're... ...functional strategy that detects and prevents scaled abuse before it... ...BA/BS in Computer Science, Engineering, or relevant technical experience...SeniorFull timeDiscord
San Francisco, CA3 days ago- Company: General Motors The Safety Assurance for Effective Autonomous Driving Software... ...process audits, and collaborate across engineering, product, and operations teams to... ...root cause analysis and corrective and preventative action (CAPA) Ability to proactively identify...Senior
$120k - $150k
A leading investment firm in the United States seeks a Senior Process Engineer to develop and own process safety and design standards for behind-the-meter power solutions. Candidates must hold a Bachelor's degree in Electrical Engineering or related disciplines and have...Senior- ...environmental aspects of the grid that affect reliability and safety. Gridware’s advanced Active Grid Response platform uses high-precision... ..., vibration, electrical, and visual signals Production Engineering Write clean, scalable, well-tested Python code that...SeniorLive in
Gridware
San Francisco, CA5 days ago $170k - $221k
...Senior Systems Engineer Agility's commercially deployed humanoids operate alongside teams in warehouses... ...-value work. With industry-leading safety standards and years of proven... ...might include analyzing field data to prevent failures, designing for customer deployment...SeniorFull timeTemporary workWork at officeRelocation packageFlexible hoursAgility Robotics
San Francisco, CA3 days ago$272k - $306k
...Staff Software Engineer, Machine Learning (Safety) San Francisco, CA Overview... ...our data and AI/ML infrastructure and... ...role reports to the Senior Manager of Machine Learning... ...adversarial abuse, harmful content detection... ...art ML to detect and prevent harm while staying ahead...Full timeESR Healthcare
San Francisco, CA3 days ago$150k - $190k
...for all. The company has developed an artificial intelligence (AI) powered technology stack purpose-built for commercial... ...capabilities for the U.S. Department of Defense. The Systems and Safety Engineering team at Kodiak is seeking an experienced Systems Engineer to own...SeniorTemporary workWork at officeVisa sponsorshipFlexible hoursKodiak
San Francisco, CA18 hours ago$180k - $275k
...challenges for any fast-growing AI platform: keeping millions of... ...magical. As a Trust & Safety Engineer, you'll architect the systems... ...our platform from phishing, abuse, fraud, and malicious content... ...you'll do Own detection and prevention systems for fraud, abuse, spam...Full timeWork at officeWork from home
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Safety & Abuse Prevention Engineer. Be the first to apply!
Related searches
- senior ai engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- ai engineer remote San Francisco, CA
- ai engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- ai developer San Francisco, CA
- ai research engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- senior safety engineer San Francisco, CA
- safety engineer San Francisco, CA