Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Model Policy Trainer - Image Evaluation

Jobtailor

Evaluate generated images against prompts for adherence, composition, realism, style consistency, and technical defects Compare images side by side and select the stronger image with an evidence-based rationale Classify images under customer policies covering sexual content, violence, hate symbols, real-person likeness, intellectual property, and depictions of minors Select defensible classifications for ambiguous images and write concise rationales citing rubric language and visual details Separate prompt failure, policy violation, and personal preference judgments Write and refine prompts to test model quality and safety boundaries Identify rubric gaps, contradictions, and emerging edge cases and raise them with project leads and policy teams Participate in calibration discussions and update judgments based on stronger reasoning Apply customer policy consistently without substituting personal taste or beliefs Maintain accuracy and consistency across hundreds of visually similar evaluations Engage regularly with sensitive imagery within structured evaluation frameworks and professional guidelines Requirements Deep visual judgment from photography, illustration, concept art, art direction, retouching, photo editing, VFX, visual design, generative image tools, or visual content moderation Ability to evaluate image adherence, composition, realism, style consistency, and technical defects Familiarity with generative image tools such as Midjourney, Stable Diffusion, ComfyUI, Flux,

DALL-E

, and Ideogram Knowledge of generative image model failure modes, prompt quirks, and safety-filter bypasses Experience moderating or reviewing visual content at scale and applying policy taxonomies under time pressure Ability to identify subtle visual details such as extra fingers, mismatched shadows, brand marks, and recognizable faces Ability to maintain rubric consistency across hundreds of similar evaluations Ability to explain judgment calls clearly and precisely in writing Ability to distinguish personal taste from customer standards Maturity and sound judgment when handling sensitive imagery and difficult subject matter Ability to engage with sensitive material carefully, responsibly, and sustainably A degree and technical background are not required Prior AI evaluation experience is helpful but not required Must be authorized to work lawfully in the United States for Handshake Must work 8AM–5PM PT, Monday through Friday Core Competencies Demonstrates deep visual judgment and the ability to evaluate image adherence, composition, realism, and technical defects while applying customer policies consistently. Engages with sensitive imagery responsibly and maintains rubric consistency across evaluations. Highest-signal resume keywords Visual Judgment Generative Image Tools Content Moderation Experience Policy Application Attention to Detail Hard Skills Image Evaluation Composition Analysis Technical Defect Identification Prompt Writing Policy Classification Soft Skills Clear Communication Sound Judgment Maturity Industry Keywords Visual Content Moderation Generative Image Models Policy Taxonomies Sensitive Imagery Handling Tools & Technologies Midjourney Stable Diffusion ComfyUI Flux DALL-E Ideogram #J-18808-Ljbffr Jobtailor

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Model Policy Trainer - Image Evaluation in Seattle, WA vacancy
  • $93.6k - $114.4k

     ..., we started Handshake AI and built the fastest-growing...  ...researchers to create evaluations, publish benchmarks,...  ...labs currently improve model capabilities with...  ...About the Role As an AI Image Evaluator, you will help...  ...the customer's content policy, and if so, which... 
    Policy
    Full time

    Handshake

    Seattle, WA
    5 days ago
  • $36 - $72 per hour

     ...institutions. Handshake AI works directly with...  ...lab researchers to create evaluations, publish benchmarks, and improve AI models through human expertise....  ...About the Role As an AI Image Evaluator, you will help...  ...the customer's content policy, and if so, which category... 
    Policy
    Hourly pay
    Full time
    Monday to Friday
    Flexible hours

    Handshake

    Seattle, WA
    5 days ago
  • Handshake in Seattle, WA is seeking an AI Image Evaluator to help assess prompts and generated images for adherence, quality, and policy compliance. You will review outputs, identify...  ...-based judgments, and help calibrate models for safety and quality in Handshake AI, working... 
    Policy

    Handshake

    Seattle, WA
    2 days ago
  • Handshake is seeking an AI Image Evaluator in Seattle to assess generated images against prompts, evaluate adherence, composition, realism and...  ...pairs, determine the stronger example, classify content per policy, and document edge cases for calibration discussions. A background... 
    Policy

    Apply

    Seattle, WA
    2 days ago
  • Handshake is seeking an AI Image Evaluator to assess generated images against prompts, focusing on adherence, composition, realism, and technical...  ...with rubric-based reasoning, and classify content per policy guidelines. Strong applicants will have a trained eye for visual... 
    Policy
    Remote job

    Handshake

    Seattle, WA
    1 day ago
  • Handshake is seeking an AI Image Evaluator to assess prompts and generated images for quality, accuracy, and policy compliance. You will weigh visual details, compare outputs,...  ...explain your reasoning to help train evaluation models. Remote US role with flexible scheduling,... 
    Policy
    Remote job
    Flexible hours

    Apply

    Seattle, WA
    1 day ago
  • $93.6k - $114.4k

     ...In 2025, we started Handshake AI and built the fastest-growing...  ...AI lab researchers to create evaluations, publish benchmarks, and push...  ...Frontier AI labs currently improve model capabilities with various data...  ...About the Role As an AI Policy Specialist on the Violence & Fiction... 
    Policy
    Full time
    Shift work

    Handshake

    Seattle, WA
    5 days ago
  •  ...Talent LLC seeks a Machine Learning Engineer - Generative Imaging to own the model layer for an AI-powered image production platform. You will focus on...  ...preserving production intelligence and workflows. You will evaluate architectures quickly and craft an abstraction layer to... 

    Fuel Talent LLC

    Seattle, WA
    3 days ago
  • $35 - $100 per hour

     ...In 2025, we started Handshake AI and built the fastest-growing...  ...AI lab researchers to create evaluations, publish benchmarks, and push...  ...Frontier AI labs currently improve model capabilities with various data...  .... About the Role As an AI Policy Generalist, you will turn... 
    Policy

    Handshake

    Seattle, WA
    2 days ago
  •  ...In 2025, we started Handshake AI and built the fastest-growing...  ...AI lab researchers to create evaluations, publish benchmarks, and push...  ...AI labs currently improve model capabilities with various data...  ...About the Role As an AI Model Policy Trainer focused on mental health, you... 
    Policy
    Immediate start
    Relocation

    Handshake

    Seattle, WA
    2 days ago
  • Evaluate user requests and AI model responses involving violence, weapons, threats, and dark fiction in full conversation context Distinguish fictional...  ...classifications for ambiguous cases and write concise policy-based rationales Write and refine adversarial or... 
    Policy

    Jobtailor

    Seattle, WA
    2 days ago
  •  ...building machine learning models and systems to protect...  ...challenges: evolving policies, surging complexity in...  ...for multimodality (text/image/video/audio), Unified Understanding...  ...the frontier of AI today. This topic...  ...technologies.- Experience with evaluation of AI systems, LLM... 
    Policy
    Flexible hours
    Shift work

    TikTok

    Seattle, WA
    1 day ago
  • $100 per hour

    A leading technology firm is seeking finance experts to enhance AI models. Responsibilities include evaluating performance in capital markets and creating assessment rubrics. Candidates should have 2+ years in finance fields like investment banking and possess strong financial... 
    Remote job
    Hourly pay
    10 hours per week

    Turing

    Seattle, WA
    2 days ago
  • $200k - $300k

    Member of Technical Staff — Model Optimization and Inference (New Grad) Seattle, Washington...  ...is building photorealistic, real-time AI avatars with emotional intelligence: a full...  ...context conversations, including eviction policies, compression, and memory-efficient attention... 
    Policy
    Internship
    H1b
    Work at office
    Visa sponsorship

    Nuance Labs

    Seattle, WA
    1 day ago
  • $180k

     ...SpaceXAI's mission is to create AI systems that can accurately...  ...multimodal engineer on the Imagine Model Team, you will develop cutting...  ...and generation across image and video modalities, while also...  ...visual and audio data.  Design evaluation frameworks, metrics,... 
    Temporary work

    SpaceXAI

    Seattle, WA
    4 days ago
  • Mercor is hiring English-speaking reviewers to evaluate recorded sessions with a voice-and-camera AI assistant. You will watch each session, compare what the assistant said with what was visible, and score it against a detailed rubric. Your written comments are the deliverable... 

    Mercor

    Seattle, WA
    11 hours ago
  • $80 - $125 per hour

     ...educational institutions. Handshake AI works directly with frontier AI lab researchers to create evaluations, publish benchmarks, and improve AI models through human expertise. Role...  ...About the Role As an AI Model Policy Trainer focused on mental health, you will... 
    Policy
    Hourly pay
    Full time
    Immediate start
    Relocation
    Monday to Friday
    Flexible hours

    Handshake

    Seattle, WA
    12 days ago
  • $124k - $280k

     ...Strategy& Strategy Consulting - Business Model Reinvention - Senior Manager you will provide...  ...except as set forth within the following policy: more about how we work: only those...  ...collaborating closely with team members. We evaluate these factors thoughtfully to establish a... 
    Policy
    Full time
    H1b

    PwC

    Seattle, WA
    2 days ago
  • $99k - $232k

     ...SummaryThe OpportunityAs a Strategy& - Business Model Reinvention - Manager, you will provide...  ...except as set forth within the following policy: more about how we work: only those...  ...closely with team members. We evaluate these factors thoughtfully to establish a... 
    Policy
    Full time
    H1b

    PwC

    Seattle, WA
    2 days ago
  • $77k - $202k

     ...Strategy& - Strategy Consulting Business Model Reinvention - Senior Associate, you will...  ...except as set forth within the following policy: more about how we work: only those qualified...  ...closely with team members. We evaluate these factors thoughtfully to establish a... 
    Policy
    Full time
    H1b

    PwC

    Seattle, WA
    2 days ago
  • $155k - $410k

     ...a Strategy& Strategy Consulting Business Model Reinvention - Director, you will provide...  ...except as set forth within the following policy: more about how we work: only those qualified...  ...closely with team members. We evaluate these factors thoughtfully to establish a... 
    Policy
    Full time
    H1b

    PwC

    Seattle, WA
    3 days ago
  • $24 per hour

     ...Trainer - Full Time We offer a full benefits package, PTO, weekly pay, and more! Primary...  ...classroom and hands-on training, evaluating performance, and fostering a culture of...  ...of vacation and sick time or under a PTO policy, depending on local requirements. Benefits... 
    Policy
    Weekly pay
    Full time
    Traineeship
    Work at office
    Local area

    Securitas Security Services USA, Inc.

    Seattle, WA
    3 days ago
  • $202.16k - $368.22k

     ...performance inference, and heterogeneous hardware compilation technologies for AI foundation models. Responsibilities Design and build scalable infrastructure for large-scale model training, evaluation, and inference. Optimize distributed training systems across compute,... 
    Temporary work
    Internship
    Local area

    ByteDance

    Seattle, WA
    4 days ago
  • Research Scientist, Foundation Model, Generative AI TikTok is the leading destination for short-form mobile video. Our mission is to inspire...  ...machine learning, especially in the areas of generative AI (e.g., image, video, or 3D generation). Transfer advanced technologies to... 

    TikTok

    Seattle, WA
    3 days ago
  • $232.56k - $427.5k

    Responsibilities Design and build scalable infrastructure for large‑scale model training, evaluation, and inference. Optimize distributed training systems across compute, memory, and communication. Improve system reliability, efficiency, and observability for large‑scale... 
    Temporary work
    Local area

    ByteDance

    Seattle, WA
    4 days ago
  • $202.16k - $368.22k

     ...your resume. Building a next-generation big model as a service platform to serve hundreds...  ...: LLM post-training and alignment, model evaluation, test-time scaling, agent systems, or...  ...interest in foundation models and data-centric AI, particularly in how large models can... 
    Temporary work
    Internship
    Local area

    ByteDance

    Seattle, WA
    4 days ago
  • Research Scientist Graduate (Foundation Model, Generative AI) - 2025 Start (PhD) Join ByteDance as a Research Scientist Graduate, focusing on...  ...multimodal machine learning, especially in generative AI such as image, video, or 3D generation. Develop foundation models to... 

    ByteDance

    Seattle, WA
    11 hours ago
  • $305k

     ...interpretable, and steerable AI systems. We want AI to be safe...  ...committed researchers, engineers, policy experts, and business leaders...  ...Manager on Claude Code's model performance team, you will drive...  ...behavior, prompt engineering, and evaluation methodology Are a systems... 
    Policy
    Work at office
    Visa sponsorship
    Flexible hours

    United States Digital Space LLC

    Seattle, WA
    2 days ago
  • Handshake is seeking an AI Policy Specialist to evaluate violence-related requests and model outputs. You will distinguish fiction from real-world harm, determine policy relevance, and explain reasoning for auditable decisions. Location is onsite in Seattle, with a W-2... 
    Policy

    Handshake

    Seattle, WA
    2 days ago
  • Handshake is seeking an AI Policy Generalist in Seattle to translate complex customer policies into consistent, well-reasoned evaluations of AI model behavior. You will read user requests, model outputs, and history to determine the correct policy category and cite evidence... 
    Policy

    Apply

    Seattle, WA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Model Policy Trainer - Image Evaluation. Be the first to apply!