Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Content Risk Policy Trainer: Violence & Safety

Jobtailor

Jobtailor seeks a policy evaluation professional to assess AI model responses involving violence and related content. You will determine classifications in context, distinguishing fiction, education, history, and defensive uses from real-world uplift or harm. Responsibilities include crafting concise rationales, refining prompts, and participating in calibration discussions to align with policy language. Strong written communication and attention to detail are essential. #J-18808-Ljbffr Jobtailor

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Content Risk Policy Trainer: Violence & Safety in Seattle, WA vacancy
  • $110k - $145k

    Moonshot is recruiting a Head of AI Safety to lead the delivery,...  ...Moonshot's expertise in violence prevention, behavioral risk, and online harms with the...  ...work closely with model, policy, trust and safety, product...  ...highly sensitive or graphic content (CSEA, extremist material,... 
    Policy
    Risk
    Content
    Permanent employment
    Flexible hours

    Moonshot

    Seattle, WA
    4 days ago
  • $55 - $90 per hour

    This is a non-engineering content-policy evaluation role. Applicants must...  ...threat assessment, trust and safety, content moderation, or closely...  ...2025, we started Handshake AI and built the fastest-growing...  ...AI Policy Specialist on the Violence & Fiction team, you will help... 
    Policy
    Content
    Monday to Friday
    Shift work

    Handshake

    Seattle, WA
    1 day ago
  • $30 per hour

    About mpathic.ai Keeping the human in AI. mpathic...  ...advancing quality and safety in AI systems through expert...  ...to identify risks related to financial guidance...  ...AI‑generated financial content and conversations for accuracy...  ...drift, escalation, and policy breakdown over time... 
    Policy
    Risk
    Content
    Part time
    Remote work
    10 hours per week

    Next Frontier Capital

    Seattle, WA
    18 hours ago
  • About mpathic.ai mpathic is keeping humans safe in...  ...mpathic is seeking AI Safety Experts for a temporary...  ...behavior, communication, policy, education, healthcare,...  ...Identifying emerging risks, behavioral patterns, and...  ...systems and sensitive content Participating in... 
    Policy
    Risk
    Content
    Temporary work

    mpathic

    Seattle, WA
    18 hours ago
  • $129k - $191k

     ...in data analytics, Trust and Safety, policy, cybersecurity, or related fields...  ...and identifying policy risks. Experience using statistical...  ...metrics to benchmark Generative AI issues and quantify...  ...sometimes offensive/sensitive content during the course of this role... 
    Policy
    Risk
    Content
    Full time

    Google

    Seattle, WA
    4 days ago
  • $126k - $181k

     ...metrics. Understanding how AI/ML can be applied to...  ...of Google Ads policies, advertiser verification...  ...processes, and the trust and safety landscape with the ability...  ..., we work to reduce risk and fight abuse across...  .... Work with sensitive content or situations and may be... 
    Policy
    Risk
    Content
    Full time
    Shift work

    Google

    Seattle, WA
    3 days ago
  • $141k - $205k

     ...Principal Analyst, Responsible AI Governance Employment...  ...About the job Trust & Safety team members are tasked...  ...responsibility risks and governance processes...  ...hijacking. A team of Analysts, Policy Specialists, Engineers,...  .... Work with sensitive content or situations and may... 
    Policy
    Risk
    Content
    Temporary work

    Google Inc.

    Seattle, WA
    2 days ago
  • $129.96k - $246.24k

    Machine Learning Engineer, Risk Data Mining - USDS...  ...Data Mining - USDS Get AI-powered advice on this...  ..., including and beyond content consumers, creators, advertisers...  ...security and financial safety, etc. In this team, you...  ...to our data protection policies and content assurance... 
    Policy
    Risk
    Content
    Full time
    Temporary work
    Work at office
    Local area
    3 days per week

    Tik Tok

    Seattle, WA
    3 days ago
  • Evaluate user requests and AI model responses involving violence, weapons, threats, and dark fiction in full conversation context Distinguish fictional...  ...classifications for ambiguous cases and write concise policy-based rationales Write and refine adversarial or borderline... 
    Policy
    Risk
    Content

    Jobtailor

    Seattle, WA
    1 day ago
  • Moonshot is seeking a Head of AI Safety to lead the delivery, development, and growth...  ...portfolio, combining expertise in violence prevention, behavioral risk, and online harms with frontier AI...  ...This senior role collaborates with policy, research, engineering and product teams... 
    Policy
    Risk

    Moonshot

    Seattle, WA
    4 days ago
  • $134.5k - $265.1k

     ...Cyber Digital Trust and Online Safety ManagerThe Digital Trust &...  ...developing, managing, and implementing policies, procedures, and strategies to...  ...safety processes, including content compliance, user protection,...  ...regulatory changes, manage risks, and enhance our organization’... 
    Policy
    Risk
    Content
    Local area
    Visa sponsorship

    Deloitte

    Seattle, WA
    5 days ago
  •  ...started Handshake AI and built the fastest...  ...As an AI Model Policy Trainer focused on mental...  ...detailed mental-health safety policy. Your work...  ...and sensitive to risk without...  ...potentially distressing content Who May Be a Good...  ...hallucinations, mania, abuse, violence, substance use,... 
    Policy
    Risk
    Content
    Immediate start
    Relocation

    Handshake

    Seattle, WA
    8 days ago
  •  ...services focus on the broad spectrum of Risk Management, Compliance, Business Process,...  ...the intersections of assets, processes, policies and people delivering value. ProSidian clients...  ...| extensively researched practice | deep content and process expertise | comprehensive... 
    Policy
    Risk
    Content
    Full time
    Temporary work
    For contractors
    Work at office
    Local area
    Remote work
    Flexible hours
    Shift work

    Prosidian Consultng

    Seattle, WA
    3 days ago
  • $184.87k - $324.19k

     ...SAP BTP, Datasphere, SAC, and AI/ML for real-time reporting, predictive...  ...; strong track record in risk mitigation, issue resolution,...  ...and thought leadership content at publication quality Travel...  ...abilities to adhere to company policies, exercise sound judgment, effectively... 
    Policy
    Risk
    Content
    Full time
    Local area

    KPMG

    Seattle, WA
    9 days ago
  •  ...businesses with the most advanced AI technology:- Combat any kinds of risks/violations issues in E-commerce scenarios...  ...detect and control risks/frauds in contents/products/sellers/creators•...  ...with strategy team, product managers, policy team and ops team to help define products... 
    Policy
    Risk
    Content
    Work experience placement

    TikTok

    Seattle, WA
    5 days ago
  •  ...rationale Classify images under customer policies covering sexual content, violence, hate symbols, real-person likeness,...  ...prompts to test model quality and safety boundaries Identify rubric gaps,...  ...technical background are not required Prior AI evaluation experience is helpful but... 
    Policy
    Content
    Monday to Friday

    Jobtailor

    Seattle, WA
    1 day ago
  •  ...Algorithm team. You will contribute to building advanced AI algorithms that detect and mitigate risks in e-commerce content, products, sellers, and creators. This internship...  ...-on learning with collaboration across product, policy, and operations groups. The role is ideal for... 
    Policy
    Risk
    Content
    Internship

    Tik Tok

    Seattle, WA
    1 day ago
  • $75k

     ...DescriptionThe University’s violence prevention and response...  ...members experiencing safety concerns, including...  ...appropriate actions to mitigate risk and promote safety.The...  ...and applying policies, protocols, rules, and...  ...public regarding SafeCampus content, policies, procedures... 
    Policy
    Risk
    Content
    Full time
    Temporary work
    Work at office
    Immediate start
    Remote work
    Monday to Friday
    Shift work
    Weekend work
    Afternoon shift

    FHLB Des Moines

    Seattle, WA
    2 days ago
  • $32.91 - $40.44 per hour

     ...collaborative, and inclusive. Our Values Safety, Mutual Respect, Service, Accountability,...  ...-job training (OJT)  Develop training content and training materials needed to support...  ...by explaining why procedures and policies are in place to raise the knowledge and awareness... 
    Policy
    Content
    Traineeship
    Local area
    Flexible hours
    Shift work
    Weekend work

    McGee Air Services

    Seattle, WA
    3 days ago
  •  ...currently has an opportunity available for a Safety / Quality / Training Facilitator (Senior...  ...field review of safety & environmental policies and performs safety assessments per SOPs/...  ...) Continuous Improvement Activities (Risk Mitigation / Visual Management) Personnel... 
    Policy
    Risk
    Work at office

    Celanese

    Seattle, WA
    3 days ago
  •  ...modern data platforms, and the AI systems that depend on them....  ...Varonis capabilities into reduced risk, controlled access, and safe...  ...threats, cyber-attacks, and policy violationsHelp customers identify...  ...knowledge base content to capture new learning for customer... 
    Policy
    Risk
    Content

    Varonis

    Seattle, WA
    4 days ago
  •  ...Experience Algorithm Team, the AI guardians ensuring the...  ...beyond traditional risk control. We are...  ...a prosperous, trusted content ecosystem and maintaining...  ...interpret complex governance policies. Develop agents that...  ...Content Governance, Trust & Safety, Creator Ecology, or... 
    Policy
    Risk
    Content

    TikTok

    Seattle, WA
    5 days ago
  • $139.8k - $164.5k

     ...clients modernize governance, risk, and compliance capabilities on...  ...oversight, control assurance, policy compliance, audit readiness,...  ...management of delivery risks.Use AI and automation tools to...  ...integrating external regulatory content, risk data, control libraries,... 
    Policy
    Risk
    Content
    Local area
    Immediate start
    Flexible hours

    West Monroe Partners

    Seattle, WA
    3 days ago
  •  ...Matter Expert (SME) to review AI-generated SEO/marketing outputs...  ...expert digital marketing content, evaluating reasoning quality,...  ...attribution, and compliance/claims risk; fact‑check where needed;...  ...inaccuracies, brand‑risk claims, policy/compliance pitfalls, and bias;... 
    Policy
    Risk
    Content
    Hourly pay
    Contract work
    Part time
    For contractors
    Immediate start
    Remote work

    YO IT Consulting

    Seattle, WA
    1 day ago
  • $173k - $259k

     ...launch ML-driven featuresUtilize AI tools and high velocity...  ...performance bottlenecks, and security risks.Adaptability in learning and...  ..., recommendations, search, content understanding, image generation...  ...information."Default Together" Policy at Snap: At Snap Inc. we... 
    Policy
    Risk
    Content
    Full time
    Live in
    Work at office
    Local area

    Snap

    Seattle, WA
    6 days ago
  • $169k - $338k

     ...of program health, technical risks, and strategic trade-offs.Mentor...  ..., cloud infrastructure, AI/ML pipelines, or equivalent domains...  ...knowledge in implementing Web Content Accessibility Guidelines (WCAG...  ...workplace and has a no tolerance policy regarding the use of illegal... 
    Policy
    Risk
    Content
    Full time
    Temporary work
    Part time

    Walmart

    Bellevue, WA
    3 days ago
  • Google Inc. is seeking an Associate Principal Analyst in Responsible AI Governance to lead risk review frameworks and integrate AI safety and policy across GenAI products and models. You will collaborate with engineers, PMs, and stakeholders globally to ensure responsible... 
    Policy
    Risk

    Google Inc.

    Seattle, WA
    1 day ago
  • $100k - $180k

     ...participate in security operations, risk assessments, incident...  ...of the company. A passion for AI is a must. Responsibilities...  ...relates to your role Adhere to policies, guidelines and procedures...  ...authentication systems, log management, content filtering, etc Ability to... 
    Policy
    Risk
    Content
    Work experience placement

    Hive

    Seattle, WA
    18 hours ago
  •  ...Artificial Intelligence, risk management, big data,...  ...programmatically enforce safety, security and...  ...emerging platforms (e.g., AI/ML workloads) with a focus...  ...offer competitive vacation policies based on employee level...  ...education and content on a variety of topics... 
    Policy
    Risk
    Content
    Full time
    Work at office

    Goldman Sachs Group, Inc.

    Seattle, WA
    2 days ago
  • $141.9k - $190.3k

     ...Disney’s sports, news, and entertainment content, across all media platforms.As part...  ...measure system health and to manage risk.Kindness and pragmatic optimism....  ...Understanding and using automated tools (AI) while adhering to company policy.Available for On-Call rotations... 
    Policy
    Risk
    Content
    Work experience placement
    Work at office

    Disney Interactive

    Seattle, WA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Content Risk Policy Trainer: Violence & Safety. Be the first to apply!