AI Safety & Abuse Detection Engineer
Menlo Ventures
Anthropic, a public benefit corporation, is seeking a trust and safety software engineer to develop systems that ensure user well-being and prevent misuse of AI models. The role involves building monitoring systems, analyzing user reports, and collaborating with research teams to enhance model integrity. Candidates should have a Bachelor's degree in a related field and significant experience in software engineering. #J-18808-Ljbffr Menlo Ventures
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Safety & Abuse Detection Engineer in San Francisco, CA vacancy
- Zendesk, Inc. is seeking an AI Agent Abuse Prevention Engineer to lead the detection and mitigation of AI-related security threats. The ideal candidate will have 10+ years of experience in cybersecurity, particularly within SaaS environments, and will design secure architectures...SuggestedWork at officeRemote work
- ...leading creative entertainment platform is seeking a Software Engineer to join their Trust and Safety team. In this role, you will build data pipelines and anomaly detection systems to protect users against abuse and fraud. The ideal candidate has a strong background in...Suggested
$170k - $240k
...entertainment company and the leader in AI music. We are backed by... ...Suno is hiring a Software Engineer, Trust and Safety, to be on the front lines of... ...our platform and users from abuse, fraud, and harmful... ...maintain data pipelines for bot detection and content moderation using...SuggestedFull timeWork at officeLocal areaSUNO
San Francisco, CA1 day ago$185k - $325k
...About the Team The Safety Systems team is dedicated to ensuring... ..., and reliability of AI models and their deployment... ...why we're seeking a software engineer to help us build out our trust... ...and implement systems that detect and prevent abuse, promote user safety, and reduce...SuggestedOpenAI
San Francisco, CA2 days ago- ...company in San Francisco is seeking an Engineering Manager, Trust & Safety to lead a high-performing... ...team focused on protecting users from abuse and fraud. Key responsibilities include... ...growth, driving technical direction for detection systems, and collaborating with...SuggestedFull time
- Arena Intelligence, Inc. is looking for a Founding Abuse Engineer to lead efforts in ensuring platform integrity against misuse. The role involves developing detection systems, enforcing policies, and working with product and security teams. Ideal candidates will have...
$180k - $275k
...challenges for any fast-growing AI platform: keeping millions of... ...magical. As a Trust & Safety Engineer, you'll architect the systems... ...our platform from phishing, abuse, fraud, and malicious content... ...matters most. What you'll do Own detection and prevention systems for...Full timeWork at officeWork from home$196k - $294k
...team behind v0, Next.js, and AI SDK, Vercel helps customers... .... As a Senior Software Engineer on our Trust & Safety team at Vercel, you’ll build... ...developers and projects from abuse at internet scale. You’ll... ...world threat actor behavior, detect emerging abuse patterns...Work at officeRemote workWork from homeMonday to FridayFlexible hours$200k - $300k
...the Role As a Software Engineer, you will take ownership... ...Quizlet’s Trust and Safety infrastructure. You’ll... ...scalable content moderation, abuse prevention, and policy... ...access and anomaly detection Design, implement, productionize... ..., and improve AI-powered solutions to effectively...Work at office3 days per week$180k - $275k
A fast-growing AI platform in San Francisco is looking for a Trust & Safety Engineer to protect millions of users while maintaining a high level of service. In this role, you will own systems for detecting fraud and malicious content, design scalable infrastructure, and...$220k - $425k
Slope is hiring a Protection Scientist Engineer to design and build systems for identifying and enforcing abuse on its products. This role requires at least 4 years of experience in technical analysis, especially with SQL and Python. Responsibilities include monitoring...$196k - $220.5k
...and after playing games. The Safety Processing team builds the... ...looking for a Senior Software Engineer who can take ownership of complex... ...systems to anticipate abuse patterns, edge cases, and failure... ...Operations stakeholders. ~ Using Gen AI products, like Claude Code, as...Full timeWork at officeRelocation package2 days per weekDiscord
San Francisco, CA2 days ago$174k - $252k
Research Engineer, Frontier Safety Loss of Control, DeepMind DeepMind - San Francisco, CA, USA Qualified... .... Experience working in a frontier AI research and development environment.... ...(R&D). Experience with cybersecurity detection and response. Experience with collaborating...Full time$185k
About the Role The Engineering Acceleration team builds and operates... ...correctness, reliability, and safety. The best version of this work... ...work through affected-target detection, dependency graph analysis,... ...bottlenecks. Use modern AI tools to rethink CI failure analysis...Local areaRemote workOpenAI
San Francisco, CA4 days ago$200k - $240k
...provides blockchain analytics and AI solutions to help law... ...and cryptocurrency businesses detect, investigate, and disrupt crypto... ...secure world for all. The AI Engineering Team is chartered with enabling... ...systems to be deployed with speed, safety, and scale. We manage petabyte...Remote workWorldwide$210k - $260k
...About the Team The Safety Systems team is dedicated to ensuring... ..., and reliability of AI models and their deployment in... ...the Role As an Analytics Engineer in Safety Systems, you will play... ...trust and safety, integrity, anti-abuse, or related fields. Familiarity...Work at officeRelocation packageOpenAI
San Francisco, CA2 days ago$181.1k - $272.1k
..., United States Machine Learning and AI Apple Services Engineering (ASE) powers many AI features across... ...continuous development of automated safety benchmarking methodologies. In this role... ...AI and safety, hallucination detection, and/or model alignment concerns Ability...Work experience placementRelocation- We’re a stealth startup building AI hardware for complex manufacturers. At the intersection... ...policy, they accelerate innovation and safety in the physical world. This company... ...aerospace, and industrial manufacturers. Engineering Agent Workflows Design and implement core...H1bRemote workRelocationVisa sponsorship
$385k
...on our APIs. We work across research, engineering, product, policy, safety, and operations to deploy frontier AI systems responsibly and safely. The... ...foundations that help OpenAI understand, detect, investigate, and mitigate abuse and safety risks across our products....Relocation packageOpenAI
San Francisco, CA4 days ago$150k - $190k
...developed an artificial intelligence (AI) powered technology stack purpose-built... ...Department of Defense. The Systems and Safety Engineering team at Kodiak is seeking an... ...architecture and concept of operations (detection, isolation, response, safe-state behavior...Temporary workWork at officeVisa sponsorshipFlexible hoursKodiak
San Francisco, CA2 days ago$405k
...interpretable, and steerable AI systems. We want AI to... ...committed researchers, engineers, policy experts, and... ...to lead the Cloud Safety team. You will lead your... ...inference, classifiers, fraud detection, data management and... ...mitigating platform abuse at scale — account fraud...Full timeWork at officeVisa sponsorshipFlexible hours$208k - $312k
Vercel is seeking a Senior Software Engineer for our Trust & Safety team to build and operate systems that protect millions of developers. The role requires analyzing threat behaviors and detecting abuse patterns while working closely with various teams. Candidates should...Remote job$250k - $280k
...company and the leader in AI music. We are backed by leading... ...Suno is hiring an Engineering Manager, Trust & Safety , to lead the team responsible... ...platform and users from abuse, fraud, and harmful... ...technical work - designing detection systems, shaping evaluation...Full timeWork at officeLocal areaSUNO
San Francisco, CA3 days ago- ...Bench and pilot experiments to close the engineering uncertainties that block scale-up —... ...compatibility at temperature, dust carryover. Safety systems for reactive-gas service, in... ...interlocks, ventilation, scrubbing, leak detection, emergency response. Standard operating...
- Reflection seeks a talented individual focused on advancing AI safety. You'll own the red-teaming and adversarial evaluation pipeline,... ...a related field with deep expertise in AI Safety and software engineering. Enjoy top-tier compensation, comprehensive insurance, and a supportive...
- A leading research organization in AI is seeking a full-time fall intern to assist with projects in AI security and alignment. The position... ...with ML literature and relevant frameworks like PyTorch. Diverse candidates are encouraged to apply. #J-18808-Ljbffr Center for AI SafetyFull timeInternship
$196k - $220.5k
...and after playing games. The Safety Processing team is responsible... ...power Discord's ability to detect, review, and enforce against harmful... ...for a Senior Software Engineer who can handle complex, multi-... ...work, thinking through security, abuse scenarios, edge cases, and...Full timeWork at officeRelocation2 days per weekDiscord
San Francisco, CA2 days ago$190k - $205k
...of the grid that affect reliability and safety. Gridware's advanced Active Grid Response... ...platform uses high-precision sensors to detect potential issues early, enabling... ...electrical, and visual signals Production Engineering Write clean, scalable, well-tested Python...Live inGridware
San Francisco, CA3 days ago- A leading technology company in San Francisco is seeking a Research Engineer for the Frontier Safety Loss of Control team. The role focuses on monitoring and controlling AI to mitigate risks associated with misaligned agents. Candidates should have a Bachelor’s degree...
- A research and field-building nonprofit in San Francisco is looking for a Research Engineer to work on AI safety projects. The role involves conducting research, writing papers for top conferences, and collaborating with leading academics. Candidates should be able to read...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Safety & Abuse Detection Engineer. Be the first to apply!
Related searches
- senior ai engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- ai engineer remote San Francisco, CA
- ai engineer San Francisco, CA
- ai prompt engineer San Francisco, CA
- ai developer San Francisco, CA
- ai research engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- senior safety engineer San Francisco, CA
- safety engineer San Francisco, CA