Research Engineer, AI Safety & Abuse Detection
$350kAnthropic
A leading AI research company is looking for research engineers to drive safety methods for their models, focusing on misuse detection and model protection. Candidates should have a background in AI or ML, with skills in Python and project management. The position offers competitive annual compensation ranging from $350,000 to $850,000. All staff are expected in the office at least 25% of the time and visa sponsorship is available. #J-18808-Ljbffr Anthropic
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Research Engineer, AI Safety & Abuse Detection in San Francisco, CA vacancy
$150k - $230k
Triage is seeking a Founding Research Engineer in San Francisco to drive research for AI safety. You'll handle adversarial research, build training data infrastructure, and work on delivering effective detection systems. The role requires strong experience in LLM post-...Suggested$174k - $253k
Google DeepMind is seeking a Research-focused Software Engineer in San Francisco to drive novel research and implement solutions in artificial intelligence... ...Python. This role involves measuring risks from frontier AI models, with a competitive salary range between $174,000...Suggested$280k
Anthropic, based in San Francisco, is looking for a Research Engineer specializing in Alignment Science. This role involves building and running machine learning experiments aimed at improving AI safety, focusing on understanding and controlling the behavior of advanced...SuggestedWork at office- Anthropic is seeking a Research Engineer to join the Computer Use team in San Francisco. The role focuses on improving Claude’s software capabilities through experiments and collaborations. Candidates should have software engineering experience, proficiency in Python, and...Suggested
$174k - $253k
Research Engineer, Frontier Safety Risk Assessment, DeepMind DeepMind - Locations: San Francisco, CA, USA; London, UK; New York, NY, USA; +2 more cities... ...foundation models. Experience designing and implementing AI experiments and systems using Python. Experience...Suggested- Anthropic is seeking a Research Engineer on Alignment Science to contribute to AI safety research based in San Francisco. The role involves developing techniques for scalable oversight and creating methods for AI control, with a focus on responsible scaling. The ideal candidate...
$350k
...interpretable, and steerable AI systems, aiming for safety and benefit to users and... ...at the intersection of research and engineering, investigating safety... ...closely with account abuse, model behavior safeguards... ...investigating new methods for detecting misuse of Claude,...Visa sponsorship- ...benefit corporation, is seeking a trust and safety software engineer to develop systems that ensure user well-being and prevent misuse of AI models. The role involves building... ...analyzing user reports, and collaborating with research teams to enhance model integrity....
$224k - $336k
Staff / Principal Engineer, Technical Mitigations Research Cambridge, MA USA; London, UK; San Francisco, CA USA We’re building a talent‑dense, high‑agency AI safety team at Lila that will engage all core teams within the organization (science, model training, lab integration...- Senior Experimental Research Engineer, Electromagnetics Senior Experimental... ...that affect reliability and safety. Gridware’s advanced Active Grid... ...high-precision sensors to detect potential issues early, enabling... ..., started with the help of AI. #J-18808-Ljbffr GridwareFull time
$150k - $230k
Triage is an applied research lab building adaptive security and safety alignment infrastructure for AI systems: defending against novel attack vectors... ...'re hiring a Founding Research Engineer to drive the research agenda that makes our detection infrastructure work. Research...Full time$300k - $405k
...interpretable, and steerable AI systems. We want AI to be... ...growing group of committed researchers, engineers, policy experts, and business... ...harden systems at scale, or a detection and response professional wondering... ...perspectives on our team. Safety Note Your safety matters to...Work at officeVisa sponsorshipFlexible hours$300k - $405k
...Cybersecurity RL team within Horizons. As a Research Engineer, you'll help to safely advance the... ...interest or experience in training safe AI models. For example, you might be a... ...could help harden systems at scale, or a detection and response professional wondering how...Full timeWork at officeVisa sponsorshipFlexible hours- AI Research Engineer (On-Device ML Focus) | Bay Area | Stealth Startup We are working with a well-funded, early-stage AI company building something... ..., logs, reactive support) with an AI-native system that can detect, diagnose, and resolve issues autonomously on every device....
$250k
...Description: Transluce is a non‑profit research lab building tools for scalable, end‑to‑end oversight of AI systems. We build world‑class,... ...for strong scientists and engineers to help advance our vision of... ...that can predict and detect unexpected and subtle behaviors...Work at officeVisa sponsorship- Arena Intelligence, Inc. is looking for a Founding Abuse Engineer to lead efforts in ensuring platform integrity against misuse. The role involves developing detection systems, enforcing policies, and working with product and security teams. Ideal candidates will have...
- A leading technology company located in San Francisco is seeking a Machine Learning Research Engineer to design and develop safe AI benchmarking methodologies. This role involves collaboration with various teams to implement responsible evaluation techniques. Candidates...
$188.28k - $288.5k
Join to apply for the Staff Bioinformatics Research Engineer role at BioSpace Join to apply for the... ...biotech company developing tests to detect cancer using a standard blood draw. To do... ...directly into each article, started with the help of AI. #J-18808-Ljbffr BioSpaceFull timeLocal area- Anthropic is seeking a skilled engineer to build evaluation infrastructure for detecting AI misuse. In this role, you'll craft... ...the reliability of Claude's safety systems. Ideal candidates should... ...role emphasizes trust in automated abuse detection methods, contributing...
$350k
...interpretable, and steerable AI systems. We want AI to be... ...growing group of committed researchers, engineers, policy experts, and business... ...experimental research on AI safety, with a focus on risks from... ...safety, and automated systems to detect and mitigate potential risks...Work at officeVisa sponsorshipFlexible hours$320k
...interpretable, and steerable AI systems. We want AI to be... ...growing group of committed researchers, engineers, policy experts, and business... ...on researching and ensuring safety with self‑improving, highly... ...discovery and remediation, malware detection and management, network...Work at officeRelocationVisa sponsorshipFlexible hours$57 - $61 per hour
Join to apply for the Software Engineer, AI Safety, Mid-Level role at Jobright.ai 2 days ago... ...trust. Job Summary: OpenAI is an AI research and deployment company dedicated to... ...designing and implementing systems that detect and prevent abuse while promoting user safety. The...Full timeSummer workInternshipH1b$170k - $240k
...Type On-site Department Engineering Compensation $170K -... ...of creators. Its AI-powered platform makes... ...Software Engineer, Trust and Safety, to be on the front lines... ...and users from abuse, fraud, and harmful behaviors... ...data pipelines for bot detection and content moderation...Full timeWork at office- Obsidian is seeking experienced First-Line Supervisors of Police and Detectives to support an AI lab in advancing machine learning systems research. This role allows for independent, remote work while contributing expertise to AI research. The responsibilities include...Remote job
$196k - $294k
...behind v0, Next.js, and AI SDK, Vercel helps... ...As a Senior Software Engineer on our Trust & Safety team at Vercel, you’ll... ...developers and projects from abuse at internet scale.... ...actor behavior, detect emerging abuse patterns... ...mitigations. Research, prototype, and implement...Remote jobWork at officeWork from homeMonday to FridayFlexible hours$320k - $405k
...Digital Space LLC in San Francisco is seeking a Data Engineer for the Safeguards team. In this role, you will... ...data pipelines and infrastructure critical for AI safety. Responsibilities include creating models for abuse detection and developing dashboards for monitoring model...$200k - $370k
...re seeking a software engineer to help us build out our trust and safety capabilities. In this... ...implement systems that detect and prevent abuse, promote user safety,... ...immense potential of AI is harnessed in a responsible... ...other engineers and researchers to utilize both...$180k - $275k
...Type Full time Department Engineering Why this role matters now AI has dramatically lowered... ...accounts, and producing abusive content at scale no longer... ...models can now build detection, triage, and response systems... ...how Gamma approaches safety for the long term. Our team...Full timeWork at officeWork from home$272k - $306k
Staff Software Engineer, Machine Learning (Safety) San Francisco, CA Overview We... ...our data and AI/ML infrastructure and services... ...including adversarial abuse, harmful content detection, and evolving threat vectors... ..., Math, Operations Research, etc.). Compensation The...Full time$250k - $400k
..., operational excellence, and AI-powered workflows to deliver exceptional... ...scale both. About the Role Research velocity, measured by... ...purpose robots. As a Research Engineer, you'll work directly with world... ...evaluation systems that detect regressions and generate meaningful...Full timeVisa sponsorship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Engineer, AI Safety & Abuse Detection. Be the first to apply!
Related searches
- junior machine learning research engineer San Francisco, CA
- research programmer San Francisco, CA
- research engineer San Francisco, CA
- senior research engineer San Francisco, CA
- ai research engineer San Francisco, CA
- research assistant engineering San Francisco, CA
- research software engineer San Francisco, CA
- deep learning research engineer San Francisco, CA
- principal safety engineer San Francisco, CA
- functional safety engineer San Francisco, CA