Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Generalist Digital Workflow Evaluator

$30 - $49 per hour

OpenTrain AI, Inc.

AI Generalist Digital Workflow Evaluator Review AI-generated outputs and workflow screenshots, apply project guidelines, and write clear feedback. This remote US contract pays $30 to $49 per hour for a flexible 1 to 3 month project. Remote Hourly · $30–$49/hr $30–$49/hr Compensation Contract, part-time Engagement Remote Location Oct 23, 2026 Posted Open to applicants in United States The work You will help evaluate AI workflows and model outputs. Your reviews will use project guidelines and written evidence to show where an output meets the requirements and where it needs improvement. Review source materials, workflow screenshots, and AI-generated outputs. Apply project rubrics and document evidence-based judgments. Explain your decisions clearly so feedback can improve model behavior. Maintain consistent, accurate quality across repeated review tasks. What it pays and takes This is remote contractor work for an entry-level project. Prior AI training experience is not required, but you should be comfortable using digital tools and reviewing work carefully. Pay: $30 to $49 per hour. Project length: 1 to 3 months with a flexible schedule. Estimated project earnings: $4,800 to $7,840 based on an OpenTrain assumption of 20 hours per week over the project period. Location: Open to candidates in the United States. A few years of professional experience in business, technology, operations, or another field. Hands-on experience using ChatGPT or similar AI tools. Strong digital literacy and confidence using online platforms and applications. Strong problem-solving, analytical, attention-to-detail, writing, and documentation skills. Comfort completing real-world purchasing and cancellation tasks with personal payment methods under approved reimbursement procedures. About AI training work AI training is the human work behind systems that learn from examples, including reviewing model responses and evaluating written outputs. Careful subject knowledge and clear feedback help improve how AI systems behave, and OpenTrain is a platform where people find this work, build a profile, and start applications. Requirements Experience: Entry level Design realistic AI evaluation tasks from procurement workflows involving suppliers, bids, contracts, and vendor risk. This flexible remote contractor role pays $45 to $90 per hour and takes less than 20 hours per week. Design challenging AI evaluation tasks based on payroll, workforce planning, HR policies, and employee lifecycle work. Pay is $45 to $90 per hour for less than 20 hours a week. Review AI-generated military and defense scenarios for accuracy, realistic assumptions, civilian protection, and sound reasoning. This part-time contractor role pays $40 to $80 per hour and requires professional defense or conflict analysis experience. Review AI-generated ground-combat scenarios, tactical plans, weapons use, and targeting for realism and alignment with military rules. This remote part-time contractor role pays $40 to $80 per hour and requires Army combat-arms experience. #J-18808-Ljbffr OpenTrain AI, Inc.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI Generalist Digital Workflow Evaluator in New York, NY vacancy
  • OpenTrain AI, Inc. is seeking an AI Generalist Digital Workflow Evaluator to review AI-generated outputs and workflow screenshots, apply project guidelines, and write clear feedback. This remote US contract offers hourly pay and a flexible 1-3 month timeline. You will assess... 
    Digital
    Remote job
    Hourly pay
    Contract work
    Flexible hours

    OpenTrain AI, Inc.

    New York, NY
    3 days ago
  • $15 - $30 per hour

    Crossing Hurdles is seeking a contractor to perform realistic digital tasks using AI assistant tools from a remote location. You will follow standardized workflows, give clear instructions to AI, and verify outputs for accuracy, with a strong emphasis on attention to detail... 
    Digital
    Remote job
    For contractors
    Flexible hours

    Crossing Hurdles

    New York, NY
    5 days ago
  • AuraOne, Inc. is seeking a Digital Designer (AI Output Evaluation) contractor to remotely review AI-generated design outputs within established creative-review workflows. You will assess craft, constraints, and tooling adherence, and document corrected approaches for model... 
    Digital
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    New York, NY
    1 day ago
  • AuraOne is seeking an Everyday AI Agent Tester specialist operations contractor for remote US-eligible work. You will review AI outputs against workflows, policy, and playbooks, grade tone and escalation, and document next steps for model training. Ideal candidates have... 
    Suggested
    Remote job
    For contractors

    Auraone

    New York, NY
    5 days ago
  • $14.5 per hour

     ...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are...  ...internet daily and familiar with online search engines and digital trends. Enjoy researching topics online and provides feedback... 
    Digital
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    10 hours per week
    Flexible hours

    Welo Data

    New York, NY
    2 days ago
  • micro1 is seeking AI Generalist Experts to contribute to customer projects focused on improving...  ...tools to complete real-world tasks, evaluate AI outputs, and provide structured...  ...feedback. Your work will involve executing digital workflows, documenting results, and identifying... 
    Digital
    Remote job

    HumanitApp

    New York, NY
    5 days ago
  •  ...accounting and advisory firm, seeks an early-career marketing generalist to own content and brand channels across social, email, and digital ads. You will support performance, SEO, and AI-enabled workflows while growing into a well-rounded marketer for our international... 
    Digital
    Remote job

    Manay CPA

    New York, NY
    2 days ago
  • micro1 Inc. is seeking a Gmail & Google Calendar AI Assistant Evaluator. You will perform everyday digital tasks and coordinate scheduling using AI tools, remotely, on a contractor basis. Your role focuses on evaluating assistant performance and providing actionable feedback... 
    Digital
    Remote job
    For contractors

    micro1 Inc.

    New York, NY
    3 days ago
  • Zekai is seeking experienced finance professionals fluent in German to train and evaluate AI agents on realistic professional tasks. You will create and review realistic work within digital workspaces, drafting tasks in German and defining success criteria grounded in... 
    Digital
    Remote job
    Hourly pay
    Part time

    Confidential

    New York, NY
    2 days ago
  • TELUS Digital is seeking a Multilingual Image & Text AI Evaluator to join the AI Community. You will participate in a two-stage visual evaluation project, assessing AI-generated images for text accuracy and correcting visual distortions across multiple languages. You will... 
    Digital

    TELUS International

    New York, NY
    4 days ago
  • Zekai is seeking Gmail & Google Calendar AI Assistant Evaluators for a 100% remote contractor project in the United States. You will perform realistic daily digital tasks and provide precise instructions to AI assistants while evaluating performance. You will grade responses... 
    Digital
    Remote job
    For contractors

    confidential

    New York, NY
    2 days ago
  • $25 - $35 per hour

    Compare original and AI-generated images, spot visual defects, and write precise feedback...  ...consistently and prioritize accurate evaluations. What it pays and takes Experience in visual...  .... Helpful experience: Photography, digital imaging, graphic design, photo editing, image... 
    Digital
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    14 hours ago
  • $25 - $35 per hour

    Assess how AI-generated versions differ from the original images and document visual errors in clear, precise...  ...; helpful background includes photography or digital imaging, graphic design or photo editing, image evaluation, data annotation, image comparison, and visual... 
    Digital
    Remote job
    Hourly pay
    Part time
    For contractors
    Flexible hours

    OpenTrain AI

    New York, NY
    3 days ago
  • Role Title: Food Delivery AI Response Evaluator Role Type : Contractor Location: Remote micro1 is engaging Food Delivery AI Response Evaluators...  ...and adhering to project guidelines. Familiarity with digital delivery platforms, apps, or AI-driven tools is advantageous... 
    Digital
    For contractors
    Remote work
    Shift work

    micro1 Inc.

    New York, NY
    3 days ago
  • $15 - $40 per hour

    The work You will evaluate AI assistant responses to realistic English teaching and classroom coordination scenarios. These may involve...  ...audience, and faithful to the instructions. Complete standardized digital tasks based on English teaching and classroom coordination.... 
    Digital
    Hourly pay
    Contract work
    Part time

    OpenTrain AI, Inc.

    New York, NY
    4 days ago
  • Role Title: Gmail & Google Calendar AI Assistant Evaluator Role Type: Contractor, Remote Location: United States only micro1 is engaging Gmail...  ...role, you'll use your everyday experience managing your digital life — email, calendars, bookings, and coordination — to help... 
    Digital
    For contractors
    Remote work

    micro1 Inc.

    New York, NY
    3 days ago
  • Generalist — U.S. Tax Workflow Evaluation Role Type: Contractor Location: Remote micro1 is engaging Generalist —...  ...expertise to help train next-generation AI systems. Your work will shape how...  ...Sheets, Drive), and ability to follow digital workflows. #J-18808-Ljbffr... 
    Digital
    Temporary work
    For contractors
    Immediate start
    Remote work

    Executive Staff Recruiters / ESR Healthcare

    New York, NY
    5 days ago
  • $18 - $45 per hour

     ...project requirements Help Shape the Future of AI in Finance Are you a finance professional...  ...(SMEs) to support a specialized AI evaluation pilot focused on the financial markets of...  ...spreadsheets, financial research tools, digital documentation, and web-based applications... 
    Digital
    Extra income
    Temporary work
    For contractors
    Freelance
    Remote work
    Flexible hours

    Volga Partners

    New York, NY
    14 hours ago
  • Remotebridge is seeking a Digital Artist contractor in the United States to evaluate and enhance AI-generated images. You will apply your artistic and technical expertise to provide high-quality feedback that informs how models learn and perform. Responsibilities include... 
    Digital
    Remote job
    For contractors

    Remotebridge

    New York, NY
    5 days ago
  • Remotebridge is seeking a Digital Artist contractor based in the United States to participate in a project evaluating AI-generated images. You will apply your visual expertise to assess, annotate, and provide precise feedback on artwork, helping to train next-generation... 
    Digital
    Remote job
    For contractors

    Remotebridge

    New York, NY
    3 days ago
  • $30 per hour

     ...Review real user interaction traces with an AI shopping assistant Identify logical...  ...quality Commit to 20+ hours per week of evaluation work on our internal platform Who Should...  ...text Familiarity with e-commerce search and digital shopping experiences Ability to commit to... 
    Digital
    Contract work
    For contractors
    Remote work

    Terac

    New York, NY
    5 days ago
  • $190 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI systems on complex personal workflows, including personal health , travel , and... 
    Remote job
    Hourly pay
    Contract work
    For contractors
    Summer work
    Trial period

    Mercor

    New York, NY
    10 days ago
  • $21 - $65 per hour

    Compare original artwork and photographs with AI-generated images, identify visual flaws, and write precise...  ...applicants in United States The work You will evaluate AI-generated images by comparing them with original digital artwork or photographs. Your reviews will help... 
    Digital
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    2 days ago
  •  ...its Welo Data program. You will work remotely to label and evaluate data for AI training, contributing to diverse linguistic tasks across Cantonese...  ...strong English proficiency, excellent attention to detail, and comfort with digital tools. #J-18808-Ljbffr Welocalize, Inc.
    Digital
    Remote job
    Flexible hours

    Welocalize, Inc.

    New York, NY
    1 day ago
  • Role Title: AI Product Evaluator Role Type: Contractor Location: India, Japan or United Kingdom, Remote Our team is engaging expert AI Product...  ...tasks within strict timeframes. Prior participation in digital product, software QA, or AI research projects is a plus. Detail... 
    Digital
    For contractors
    Remote work

    Remotebridge

    New York, NY
    5 days ago
  • C.H. Robinson is seeking a Digital Operations Analyst to analyze AI performance, validate outcomes, and optimize workflows. You will work with business and technology teams to turn data and feedback into smarter processes, improving productivity and customer outcomes. You... 
    Digital
    Remote job

    C.H. Robinson

    New York, NY
    2 days ago
  •  ...Vice President, AI Product Manager, Enterprise Platforms & Workflow Transformation About the Company Prominent global investment bank Industry...  ...minimum of 10 years' experience in product management, digital transformation, enterprise technology, or related leadership... 
    Digital

    Confidential

    New York, NY
    3 days ago
  • Synthires seeks a Krita specialist for an AI training project focused on digital art and illustration. You will create and refine digital artwork, from...  ..., while clearly documenting each step of your workflow. The role is remote as a contractor, requiring strong Krita... 
    Digital
    Remote job
    For contractors

    Synthires

    New York, NY
    2 days ago
  • AuraOne, Inc. seeks a Finance Research Expert — AI Evaluation (Remote) to review AI outputs in finance and risk workflows, ensuring accuracy and policy adherence. You will flag rounding, classification, and treatment issues, documenting corrections with citations for model... 
    Remote job

    AuraOne Human Data

    New York, NY
    5 days ago
  • AI Trainer Jobs is seeking a Calibration Technology Evaluation Specialist for a remote contractor role. You will review AI outputs against workflows, grade tone, policy adherence, and stakeholder fit using structured rubrics; flag risks and document next steps for training... 
    Remote job
    For contractors
    Work experience placement

    Auraone

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Generalist Digital Workflow Evaluator. Be the first to apply!