Staff Software Engineer, AI Safety & Abuse Detection
Anthropic
Anthropic, a San Francisco–based AI safety company, seeks software engineers for the Safeguards team to build safety and oversight mechanisms for our AI systems. You will work to monitor models, prevent misuse, and enforce our terms of service while improving user well-being. Responsibilities include developing monitoring systems, building abuse detection, surfacing patterns to researchers, and creating robust defenses for real-time safety improvements at scale. #J-18808-Ljbffr Anthropic
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Staff Software Engineer, AI Safety & Abuse Detection in San Francisco, CA vacancy
- ...interpretable, and steerable AI systems. We want AI to... ...committed researchers, engineers, policy experts, and... ...the role The Account Abuse team is tasked with ensuring... ...from coming back. As a software engineer on this team,... ...systems that help us detect and stop abuse at scale...Suggested
$207k - $300k
...oversight and guidance to executive engineers.Partner with cross-functional teams to serve the Detection and Response Platform... ...architecture; and testing/launching software products.Experience architecting... ..., and deploying generative AI agents or large language model...SuggestedFlexible hoursGoogle
San Francisco, CA17 hours ago$266k
Staff & Software Engineer, Payments & Billing, Consumer Monetization |... ...Monetization Applied AI Engineering - San Francisco... ...flows, reducing abuse while protecting legitimate... ...failures easier to detect, diagnose, and resolve... ...must be created with safety and human needs at its...SuggestedWork at officeLocal areaImmediate startRelocation packageFlexible hours3 days per week- ...businesses prevent payments fraud and abuse while enabling legitimate... ...combine machine learning and AI with the intelligence of... ...Our work spans payments fraud detection, protection against abuse... ...What you’ll do As a software engineer on Radar, you’ll build products...SuggestedFull time
- ...Kong’s product portfolio.As a Staff Software Engineer on the Konnect team at Kong,... ...rate limiting, anomaly detection, and fraud prevention systems... ...credential stuffing, token abuse, and distributed attacks.Build... ...AW1About Kong:Kong Inc., the AI Connectivity Company, is building...SuggestedTemporary workWorldwide
Kong
San Francisco, CA4 days ago $500 per month
We are looking for software engineers to help build safety and oversight mechanisms for our AI systems. As a software engineer on the Safeguards... ...and scalable systems to detect unwanted model behaviors and... ...with integrity, spam, fraud, or abuse detection and mitigation 8+...InternshipWork at officeHome officeRelocation packageFlexible hours$155k - $400k
...application monitoring standard and our team is building its AI-native future.About the roleSentry's issue platform... ...what a developer needs to know to investigate.As a Senior Software Engineer on the Issue Detection team, you'll design, build, and operate the systems that...Work experience placementImmediate startSentry
San Francisco, CA1 day ago$208k - $312k
...As the team behind Next.js, v0, and AI SDK, we create products that help builders... ...developer experience.Now, software is entering a new era, and the next generation... ...Role:We are looking for a Security Engineer to join our Detection Response team. In this role, you will...Work at officeRemote workWork from homeWorldwideMonday to FridayFlexible hoursShift workVercel
San Francisco, CA5 days ago$123.7k - $254.67k
...Creating a career you love? It’s Possible.At Pinterest, AI isn't just a feature, it's a powerful partner that augments... ...here.Pinterest is seeking an experienced Security Engineer to build and implement detection and response improvements and adapt to emerging threats...Work at officeLocal areaRemote workRelocationRelocation packagePinterest
San Francisco, CA2 days ago$190k - $265k
...and running the world's best data and AI infrastructure platform so our customers... ...AI teams in the world.As a Staff Software Engineer for AI Runtime, you will play a critical... ...foundations that keep multi-node jobs healthy, detecting and recovering from hardware and...Local areaWorldwideDataBricks
San Francisco, CA3 days ago$194k - $267k
Secure Every Identity, from AI to HumanIdentity is the... ...is composed of engineers who thrive at the intersection... ...and influential Software Engineer to join our macOS... ...multiple teams, mentoring Staff and Senior engineers,... ..., and endpoint detection).Understanding of Identity...Local areaWorldwideFlexible hoursOkta
San Francisco, CA2 days ago$347k - $405k
...security bar by anticipating abuse cases, failure modes,... ...leadership to senior engineers and raise the quality... ...systems domain at the senior-staff level.Have set multi-... ...OpenAIOpenAI is an AI research and deployment... ...that must be created with safety and human needs at its...Work at officeLocal areaImmediate startFlexible hoursOpenAI
San Francisco, CA17 hours ago$240k
...Global (NYSE: ZETA) is the AI-Powered Marketing Cloud that... ...ROLEZeta Global Corp. seeks a Staff Software Engineer in NYC to drive the design... ...improve quality, correctness, and safety of GenAI systems.Build... ...latency analysis, and failure detection. Optimize cost and...Remote work3 days per weekZeta Global
San Francisco, CA4 days ago$200.7k - $298.8k
...what our Risk product engineering teams do at Mercury. We... ...without compromising safety. Every day, our work helps... ...machine learning, AI, and human judgment work... ...use intelligence to detect risks earlier, make real... ....We’re looking for a Staff Software Engineer to contribute...Night shiftMercury
San Francisco, CA1 day ago$198k - $299k
Amplitude is the leading AI analytics platform,... ...focused on psychological safety, empathy, and human connection... .... Our in-house OLAP engine, Nova, processes... ...dramatically.We’re looking for a Staff Software Engineer who wants to... ...the bar on how we detect and respond to production...Work at officeImmediate startWorldwideHome officeAmplitude
San Francisco, CA17 hours ago$208k - $312k
...behind Next.js, v0, and AI SDK, we create... ...developer experience.Now, software is entering a new era... ...next.As a Software Engineer on our Trust & Safety at Vercel, you’ll build... ...and projects from abuse at internet scale. You... ...threat actor behavior, detect emerging abuse...Work at officeRemote workWork from homeWorldwideMonday to FridayFlexible hoursVercel
San Francisco, CA1 day ago$190k - $270k
Staff Software Engineer - AI Research InfrastructureP-1215At Databricks, we are obsessed with enabling data teams to solve the world’s toughest problems, from security threat detection to cancer drug development. We do this by building and running the world’s best data...Local areaWorldwideDataBricks
San Francisco, CA1 day ago$227.2k - $324.5k
About the Role:We are looking for a Staff Software Engineer who combines deep technical expertise with... ...development practices, including AI-native engineering workflowsFlexibility... ...design, performance tuning, and anomaly detection across Tubi’s distributed backend systems...Full timeTemporary workWork at officeLocal areaFlexible hours3 days per weekTubi TV
San Francisco, CA1 day ago$214.1k - $309.8k
...adversaries increasingly use AI to accelerate attacks,... ...action.Meet the TeamAs a Senior Staff Software Engineer on Cisco’s Security Core AI... ...gates.• Translate SOC, SIEM, detection, incident, investigation, and... ...quality, human intervention, safety, latency, cost, and...Full timeTemporary workWork at officeLocal areaFlexible hoursCISCO Systems
San Francisco, CA2 days ago$192k - $260k
...problems, from security threat detection to cancer drug development.... ...running the world’s best data and AI infrastructure platform, so... ...companies in the world.Our engineering teams build highly technical... ...operate one of the largest scale software platforms. The fleet consists...Work at officeLocal areaWorldwideFlexible hoursDataBricks
San Francisco, CA3 days ago- ...understanding of how a company works—so AI can help teams anticipate... ...to attack the biggest software category in the world. We previously... ..., creative, and versatile engineer who is eager to tackle the... ...operation, proactive issue detection, and continuous improvement....Work from home
LIGHTFIELD INC
San Francisco, CA4 days ago $192k - $272k
...re building a talent-dense, high-agency AI safety team at Lila that will engage all core... ...Safety team, you will build the shared software that helps our team understand and reduce... ...tools and systems. You will own engineering work from scoping and prototyping through...Full timeWork at officeLocal areaFlexible hours$279k - $341k
Staff Software Engineer Discord has a highly engaged community of millions of daily active users who use... ...a Staff Software Engineer to join our Safety Processing team. This team plays a... ...solutions and vendors Implement and enhance ML/AI models and automation to improve...Full timeWork at officeRemote workRelocation package2 days per week- Senior or Staff Software Engineer (Full-Stack) Join to apply for the Senior or Staff Software Engineer... ...on a mission to empower teachers with AI-powered tools that save time and improve... ...modify assignments for reading levels, detect plagiarism, and much more — directly in...
- ...understanding of how a company works—so AI can help teams anticipate... ...to attack the biggest software category in the world. We previously... ...looking for an experienced engineer who is product-minded, eager... ...operation, proactive issue detection, and continuous improvement....Work from home
$158k - $269k
Senior Perception Engineer Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a... ...to improve the accuracy, robustness, and safety of our self-driving technology. This includes working on 3D detection and tracking of traffic agents as well...Full timeWork at officeWork from homeFlexible hours$141k - $242k
Waabi Senior Or Staff Software Engineer Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world-class team, we're unlocking... ...comprehensive metrics, observability, and anomaly detection across various systems. Partner directly with...- ...Forbes.We prioritize candidate safety. Please be aware that all... ...role, you will fill a crucial engineering leadership gap, instilling a... ...be managed efficiently using AI.Develop customer-facing products... ...engine, creating conflict detection and intuitive UX for concurrent...Work at office3 days per week
Rippling
San Francisco, CA17 hours ago $193.8k - $285k
...experimentation, metric systems, and AI-assisted analysis workflows.... ...closely with data scientists, engineers, product managers, and... ...the RoleWe are looking for a Staff Applied Scientist to provide scientific... ...experiment readouts, risk detection, and hypothesis generation,...Hourly payContract workWork at officeLocal areaRemote workFlexible hoursDoordash
San Francisco, CA7 hours ago- ...more about ourTotal Rewards philosophy.AI is a fundamental part of how work gets... ...interview process.About the Role:As a Staff Software Engineer on the Cloud Infrastructure team, you'... ...and versioning strategy, drift detection and remediation, and policy-as-code enforcement...Full timeWork at officeLocal area2 days per week3 days per week
Gusto
San Francisco, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Software Engineer, AI Safety & Abuse Detection. Be the first to apply!
Related searches
- reliability and safety engineer San Francisco, CA
- senior safety engineer San Francisco, CA
- public health engineer San Francisco, CA
- safety engineer San Francisco, CA
- functional safety engineer San Francisco, CA
- software product owner San Francisco, CA
- software quality assurance San Francisco, CA
- entry level software sales San Francisco, CA
- software technical writer San Francisco, CA
- id software San Francisco, CA