AI Content Risk Policy Trainer: Violence & Safety
Jobtailor
Jobtailor seeks a policy evaluation professional to assess AI model responses involving violence and related content. You will determine classifications in context, distinguishing fiction, education, history, and defensive uses from real-world uplift or harm. Responsibilities include crafting concise rationales, refining prompts, and participating in calibration discussions to align with policy language. Strong written communication and attention to detail are essential. #J-18808-Ljbffr Jobtailor
$110k - $145k
Moonshot is recruiting a Head of AI Safety to lead the delivery,... ...Moonshot's expertise in violence prevention, behavioral risk, and online harms with the... ...work closely with model, policy, trust and safety, product... ...highly sensitive or graphic content (CSEA, extremist material,...PolicyRiskContentPermanent employmentFlexible hours$55 - $90 per hour
This is a non-engineering content-policy evaluation role. Applicants must... ...threat assessment, trust and safety, content moderation, or closely... ...2025, we started Handshake AI and built the fastest-growing... ...AI Policy Specialist on the Violence & Fiction team, you will help...PolicyContentMonday to FridayShift work$30 per hour
About mpathic.ai Keeping the human in AI. mpathic... ...advancing quality and safety in AI systems through expert... ...to identify risks related to financial guidance... ...AI‑generated financial content and conversations for accuracy... ...drift, escalation, and policy breakdown over time...PolicyRiskContentPart timeRemote work10 hours per week- About mpathic.ai mpathic is keeping humans safe in... ...mpathic is seeking AI Safety Experts for a temporary... ...behavior, communication, policy, education, healthcare,... ...Identifying emerging risks, behavioral patterns, and... ...systems and sensitive content Participating in...PolicyRiskContentTemporary work
$129k - $191k
...in data analytics, Trust and Safety, policy, cybersecurity, or related fields... ...and identifying policy risks. Experience using statistical... ...metrics to benchmark Generative AI issues and quantify... ...sometimes offensive/sensitive content during the course of this role...PolicyRiskContentFull time$126k - $181k
...metrics. Understanding how AI/ML can be applied to... ...of Google Ads policies, advertiser verification... ...processes, and the trust and safety landscape with the ability... ..., we work to reduce risk and fight abuse across... .... Work with sensitive content or situations and may be...PolicyRiskContentFull timeShift work$141k - $205k
...Principal Analyst, Responsible AI Governance Employment... ...About the job Trust & Safety team members are tasked... ...responsibility risks and governance processes... ...hijacking. A team of Analysts, Policy Specialists, Engineers,... .... Work with sensitive content or situations and may...PolicyRiskContentTemporary work$129.96k - $246.24k
Machine Learning Engineer, Risk Data Mining - USDS... ...Data Mining - USDS Get AI-powered advice on this... ..., including and beyond content consumers, creators, advertisers... ...security and financial safety, etc. In this team, you... ...to our data protection policies and content assurance...PolicyRiskContentFull timeTemporary workWork at officeLocal area3 days per week- Evaluate user requests and AI model responses involving violence, weapons, threats, and dark fiction in full conversation context Distinguish fictional... ...classifications for ambiguous cases and write concise policy-based rationales Write and refine adversarial or borderline...PolicyRiskContent
- Moonshot is seeking a Head of AI Safety to lead the delivery, development, and growth... ...portfolio, combining expertise in violence prevention, behavioral risk, and online harms with frontier AI... ...This senior role collaborates with policy, research, engineering and product teams...PolicyRisk
$134.5k - $265.1k
...Cyber Digital Trust and Online Safety ManagerThe Digital Trust &... ...developing, managing, and implementing policies, procedures, and strategies to... ...safety processes, including content compliance, user protection,... ...regulatory changes, manage risks, and enhance our organization’...PolicyRiskContentLocal areaVisa sponsorship- ...started Handshake AI and built the fastest... ...As an AI Model Policy Trainer focused on mental... ...detailed mental-health safety policy. Your work... ...and sensitive to risk without... ...potentially distressing content Who May Be a Good... ...hallucinations, mania, abuse, violence, substance use,...PolicyRiskContentImmediate startRelocation
- ...services focus on the broad spectrum of Risk Management, Compliance, Business Process,... ...the intersections of assets, processes, policies and people delivering value. ProSidian clients... ...| extensively researched practice | deep content and process expertise | comprehensive...PolicyRiskContentFull timeTemporary workFor contractorsWork at officeLocal areaRemote workFlexible hoursShift work
$184.87k - $324.19k
...SAP BTP, Datasphere, SAC, and AI/ML for real-time reporting, predictive... ...; strong track record in risk mitigation, issue resolution,... ...and thought leadership content at publication quality Travel... ...abilities to adhere to company policies, exercise sound judgment, effectively...PolicyRiskContentFull timeLocal area- ...businesses with the most advanced AI technology:- Combat any kinds of risks/violations issues in E-commerce scenarios... ...detect and control risks/frauds in contents/products/sellers/creators•... ...with strategy team, product managers, policy team and ops team to help define products...PolicyRiskContentWork experience placement
- ...rationale Classify images under customer policies covering sexual content, violence, hate symbols, real-person likeness,... ...prompts to test model quality and safety boundaries Identify rubric gaps,... ...technical background are not required Prior AI evaluation experience is helpful but...PolicyContentMonday to Friday
- ...Algorithm team. You will contribute to building advanced AI algorithms that detect and mitigate risks in e-commerce content, products, sellers, and creators. This internship... ...-on learning with collaboration across product, policy, and operations groups. The role is ideal for...PolicyRiskContentInternship
$75k
...DescriptionThe University’s violence prevention and response... ...members experiencing safety concerns, including... ...appropriate actions to mitigate risk and promote safety.The... ...and applying policies, protocols, rules, and... ...public regarding SafeCampus content, policies, procedures...PolicyRiskContentFull timeTemporary workWork at officeImmediate startRemote workMonday to FridayShift workWeekend workAfternoon shift$32.91 - $40.44 per hour
...collaborative, and inclusive. Our Values Safety, Mutual Respect, Service, Accountability,... ...-job training (OJT) Develop training content and training materials needed to support... ...by explaining why procedures and policies are in place to raise the knowledge and awareness...PolicyContentTraineeshipLocal areaFlexible hoursShift workWeekend work- ...currently has an opportunity available for a Safety / Quality / Training Facilitator (Senior... ...field review of safety & environmental policies and performs safety assessments per SOPs/... ...) Continuous Improvement Activities (Risk Mitigation / Visual Management) Personnel...PolicyRiskWork at office
- ...modern data platforms, and the AI systems that depend on them.... ...Varonis capabilities into reduced risk, controlled access, and safe... ...threats, cyber-attacks, and policy violationsHelp customers identify... ...knowledge base content to capture new learning for customer...PolicyRiskContent
- ...Experience Algorithm Team, the AI guardians ensuring the... ...beyond traditional risk control. We are... ...a prosperous, trusted content ecosystem and maintaining... ...interpret complex governance policies. Develop agents that... ...Content Governance, Trust & Safety, Creator Ecology, or...PolicyRiskContent
$139.8k - $164.5k
...clients modernize governance, risk, and compliance capabilities on... ...oversight, control assurance, policy compliance, audit readiness,... ...management of delivery risks.Use AI and automation tools to... ...integrating external regulatory content, risk data, control libraries,...PolicyRiskContentLocal areaImmediate startFlexible hours- ...Matter Expert (SME) to review AI-generated SEO/marketing outputs... ...expert digital marketing content, evaluating reasoning quality,... ...attribution, and compliance/claims risk; fact‑check where needed;... ...inaccuracies, brand‑risk claims, policy/compliance pitfalls, and bias;...PolicyRiskContentHourly payContract workPart timeFor contractorsImmediate startRemote work
$173k - $259k
...launch ML-driven featuresUtilize AI tools and high velocity... ...performance bottlenecks, and security risks.Adaptability in learning and... ..., recommendations, search, content understanding, image generation... ...information."Default Together" Policy at Snap: At Snap Inc. we...PolicyRiskContentFull timeLive inWork at officeLocal area$169k - $338k
...of program health, technical risks, and strategic trade-offs.Mentor... ..., cloud infrastructure, AI/ML pipelines, or equivalent domains... ...knowledge in implementing Web Content Accessibility Guidelines (WCAG... ...workplace and has a no tolerance policy regarding the use of illegal...PolicyRiskContentFull timeTemporary workPart time- Google Inc. is seeking an Associate Principal Analyst in Responsible AI Governance to lead risk review frameworks and integrate AI safety and policy across GenAI products and models. You will collaborate with engineers, PMs, and stakeholders globally to ensure responsible...PolicyRisk
$100k - $180k
...participate in security operations, risk assessments, incident... ...of the company. A passion for AI is a must. Responsibilities... ...relates to your role Adhere to policies, guidelines and procedures... ...authentication systems, log management, content filtering, etc Ability to...PolicyRiskContentWork experience placement- ...Artificial Intelligence, risk management, big data,... ...programmatically enforce safety, security and... ...emerging platforms (e.g., AI/ML workloads) with a focus... ...offer competitive vacation policies based on employee level... ...education and content on a variety of topics...PolicyRiskContentFull timeWork at office
$141.9k - $190.3k
...Disney’s sports, news, and entertainment content, across all media platforms.As part... ...measure system health and to manage risk.Kindness and pragmatic optimism.... ...Understanding and using automated tools (AI) while adhering to company policy.Available for On-Call rotations...PolicyRiskContentWork experience placementWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Content Risk Policy Trainer: Violence & Safety. Be the first to apply!
- ai trainer Seattle, WA
- content marketing lead Seattle, WA
- content strategy Seattle, WA
- content marketing part time Seattle, WA
- content marketing Seattle, WA
- content writing Seattle, WA
- content Seattle, WA
- chief content officer Seattle, WA
- local content analyst Seattle, WA
- director content marketing Seattle, WA




