Remote AI Policy Evaluator — Violence & Fiction
Apply
Brooklyn, NY
- Remote job
Handshake is seeking an AI Policy Specialist on the Violence & Fiction team to evaluate user requests and model responses within a full conversation context, distinguishing violence in fiction from real-world uplift and ensuring precise policy application. You will read conversations, decide policy category, and explain reasoning clearly to train models. This remote role is US-based, with 8:00 AM–5:00 PM PT schedule and ongoing assignments starting 21 September 2026. #J-18808-Ljbffr Apply
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote AI Policy Evaluator — Violence & Fiction in Brooklyn, NY vacancy
$93.6k - $114.4k
...steps. Our partner is looking for an AI Safety Policy Evaluator, Violence & Threats based in United States.... ...context to distinguish legitimate fictional, educational, historical, or defensive... ...not required. Ability to work remotely in the United States on a Monday-...Remote workPolicyHourly payFull timeMonday to Friday$45 - $55 per hour
...non-engineering content-policy evaluation role. Applicants must... ...depth in violent fiction or media, military or... ...we started Handshake AI and built the fastest-... ...Policy Specialist on the Violence & Fiction team, you will... ...Role Details Location: Remote, US Compensation: $45...Remote jobPolicyMonday to FridayShift work- Handshake is seeking an AI Policy Specialist to evaluate violence-related requests and model outputs. You will distinguish fiction from real-world harm, determine policy relevance, and explain reasoning for auditable decisions. Location is onsite in Seattle, with a W-2...Policy
$55 - $90 per hour
...is a non-engineering content-policy evaluation role. Applicants must demonstrate... ...relevant depth in violent fiction or media, military or... ...In 2025, we started Handshake AI and built the fastest-growing... ...AI Policy Specialist on the Violence & Fiction team, you will help...PolicyMonday to FridayShift work- Handshake is seeking an AI Image Evaluator to assess prompts and generated images for quality, accuracy, and policy compliance. You will weigh visual details, compare outputs,... ...reasoning to help train evaluation models. Remote US role with flexible scheduling, part of...Remote jobPolicyFlexible hours
- OpenTrain AI is seeking an insurance policy operations specialist to craft high-quality reasoning data for AI evaluation. You will design realistic workflows across the policy lifecycle,... ...based feedback for improved AI behavior. Remote contractor position with flexible...Remote workPolicyFor contractorsFlexible hours
- Handshake is seeking an AI Policy Specialist on the Violence & Fiction team to help AI models distinguish between depictions of violence in fiction and real-world harm. You will read user requests, model responses, and conversation history, then determine the appropriate...Policy
- ...Audit and Controls AI Evaluator is a remote review track for evaluating AI outputs across audit workflows. Reviewers grade calculations, narrative reasoning, and policy adherence; flag compliance and reconciliation issues; and document the correct treatment so the modeling...Remote jobPolicyHourly payFor contractorsWork experience placement10 hours per week
- ...Terms of Service AI Evaluator is a remote evaluation track for reviewing terms of service ai evaluation prompts and responses against AuraOne'... ...with rationale. Tag an unsafe response with the correct policy category and severity. Audit a 50-row batch for rubric consistency...Remote jobPolicyHourly payFor contractors10 hours per week
- ...Privacy Engineering AI Evaluator is a remote review track for evaluating AI outputs in privacy law workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on...Remote jobPolicyHourly payFor contractors10 hours per week
- ...Procurement Compliance AI Evaluator is a remote review track for evaluating AI outputs in compliance workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can train on...Remote jobPolicyHourly payFor contractors10 hours per week
- ...AI Safety and Red-Team Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios,... ...prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for AI Safety and Red-Team Evaluator...Remote jobPolicyHourly payFor contractors10 hours per week
$43 - $47 per hour
...Overview Help improve how advanced AI models respond to sensitive topics in Czech. In this remote, hourly role, you will use... ...fluency and cultural judgment to evaluate model behavior and support... ...and safety, content moderation, policy evaluation, or adversarial testing...Remote jobPolicyHourly payImmediate startSaidGig
Europe1 day ago- ...Assessment Rubric AI Evaluator is a remote review track for evaluating AI outputs across assessment rubric ai specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next...Remote jobPolicyHourly payFor contractorsWork experience placement10 hours per week
- ...Healthcare Compliance AI Evaluator is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade differential... ...clinical writing Clinical review Legal reasoning Policy review Risk analysis Healthcare Compliance Work...Remote jobPolicyHourly payFor contractors10 hours per week
$100k - $110k
...Data Evaluator/Analyst MELE Associates, Inc. is seeking to add an experienced Data Evaluator... ...degree in economics, statistics, public policy, data science, or a related field (or... .... Benefits MELE Offers: ~ Hybrid remote/office work environment. ~ Employer-paid...Remote workPolicyContract workFor contractorsWork at officeMELE Associates
Washington DC3 days ago- Obsidian is seeking experienced AI Safety Practitioners to evaluate frontier AI models for safety, quality,... ...will assess responses, apply safety policies, and help improve model behavior through... ..., political persuasion, self-harm, violence, cyber, and biosecurity content...Policy
- Obsidian is seeking experienced AI Safety Practitioners to evaluate safety, quality, and alignment of frontier AI models across complex policy-sensitive topics. You will assess AI-generated... ..., political persuasion, self-harm, violence, cyber, biosecurity, and other...Policy
- Mercor seeks experienced AI Safety Practitioners to evaluate safety, quality, and alignment of frontier AI models across policy-sensitive topics. You will assess AI-generated responses... ..., political persuasion, self-harm, violence, cyber, and #J-18808-Ljbffr MercorPolicy
- We are seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive, and ambiguous ("grey-area") topics... ...misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other...PolicyWorldwide
- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...Remote workContract workTemporary workImmediate start
MERIT Beauty
New York, NY2 days ago $20 per hour
A tech company specializing in AI is hiring a Digital Web Designer. In this remote role, you will evaluate AI-generated designs and provide feedback to enhance the model’s understanding of aesthetics. An ideal candidate will have a strong background in UI/UX design and...Remote workFlexible hoursDataAnnotation
United States1 day ago$14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...Remote workHourly payPart timeFlexible hoursWelo Data
United States3 days ago$16 - $20 per hour
...for external applicants. Approval of remote and hybrid work is not guaranteed... ...of Nursing is hiring part-time research evaluators for projects focused on dementia care in... ...check(s) in accordance with University policies. CAMPUS SECURITY CRIME STATISTICS...Remote workPolicyHourly payPart timeFor contractorsSummer workPenn State University
University Park, PA1 day ago$14.5 per hour
...diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data... ...? Join our team as a Web Search Evaluator and help shape the future of search engines... ...hours and achieve work-life balance. Remote Work: Enjoy the freedom of working from...Remote workBi-weekly payHourly payPart timeImmediate startWork from homeFlexible hoursJobs for Humanity
Jacksonville, FL5 days ago- ...Seeking a full-time Remote AI Research Evaluator with a PhD in Quantitative Finance to assess and enhance AI models' capabilities in financial reasoning and quantitative analysis through flexible, contract-based work. Key responsibilities Assessing the factuality and...Remote workFull timeContract workFlexible hours
Virtual Vocations Inc
United States2 days ago - ...BAM Ventures is seeking Swedish-speaking remote annotators to evaluate AI-generated content, ensuring that it's coherent and aligns with real-world expectations. Your role will involve reviewing outputs, identifying deviations, and providing structured feedback to enhance...Remote work
BAM VENTURES LLC
New York, NY5 days ago - ...Obsidian is hiring expert Evaluators in real estate, hospitality, and events to review AI-generated work products for accuracy and quality. This is a remote position requiring strong expertise in the relevant domains. Ideal candidates should have over 5 years of professional...Remote workWork at office
Obsidian
New York, NY5 days ago $84.18k - $142.37k
...HHS webpage. Functional Title: Forensic Evaluator - State Hospital - Maximum Security Unit... ...55 competency evaluations, as well as violence risk assessments under 46C. Responsibilities... ...in accordance with agency leave policy and performs other duties as assigned....Remote workPolicyFull timeTemporary workPart timeTraineeshipInternshipWork at officeShift workRotating shift$130k - $160k
...System Security Officer (ISSO) / Control Evaluator - High/Senior to support a comprehensive... ...Washington, DC, with potential for hybrid/remote arrangements as approved. We offer... ...frameworks, federal information security policy, security assessment methodologies, and the...Remote workPolicyFull timeWork experience placementWork at officeLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Policy Evaluator — Violence & Fiction. Be the first to apply!
Related searches
- quality evaluator Brooklyn, NY
- clinical evaluator Brooklyn, NY
- work from home web search evaluator Brooklyn, NY
- evaluator Brooklyn, NY
- program evaluator Brooklyn, NY
- ai evaluator Brooklyn, NY
- education evaluator Brooklyn, NY
- social media evaluator Brooklyn, NY
- senior network engineer remote Brooklyn, NY
- document specialist remote Brooklyn, NY