Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote Part-Time Evaluation Scenario Writer for AI Testing

$80 per hour

Mindrift

Wisconsin
  • Remote job

A leading AI innovation firm is seeking an Evaluation Scenario Designer to create structured test cases for LLM-based agents. This part-time role allows for flexible project work, focusing on defining gold-standard behaviors and analyzing agent performance. Candidates should hold a degree in Computer Science or related fields and possess strong analytical skills. Experience in software testing and communication in English are essential. This opportunity offers competitive rates up to $80/hour based on skills and experience. #J-18808-Ljbffr Mindrift

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote Part-Time Evaluation Scenario Writer for AI Testing in Wisconsin vacancy
  • $60 per hour

     ...shape the future of AI. About The Role...  ...realistic and structured evaluation scenarios for LLM-based agents. You'll create test cases that...  ...freelance role is fully remote so you just need a...  ...connection, time available, and enthusiasm...  ...needs Take part in a flexible, remote... 
    Part time
    Remote work
    Freelance
    Flexible hours

    Mindrift

    Brooklyn, NY
    4 days ago
  • $55 per hour

     ...with cutting-edge AI projects. We are seeking an Evaluation Scenario Writer - QA for a project...  ...validation, automated test thinking, and...  ...developers to automate parts of the review...  ...part in a flexible, remote, freelance project...  ...type: Part-time #J-18808-Ljbffr Mindrift
    Part time
    Remote work
    Freelance
    Internship
    Flexible hours

    Mindrift

    New York, NY
    4 days ago
  • $80 per hour

    A leading AI consultancy is seeking a detail-oriented individual to design evaluation scenarios for LLM-based agents. This part-time, remote role allows you to create structured test cases while working flexibly around your commitments. The ideal candidate holds a relevant... 
    Part time
    Remote work

    Mindrift

    Houston, TX
    3 days ago
  • $55 per hour

     ...technology-driven company is seeking an Evaluation Scenario Writer - QA to validate and improve evaluation scenarios for AI projects. This flexible, part-time role requires a strong QA background...  ...skills, and familiarity with test automation. Ideal for analysts or students... 
    Part time
    Remote job
    Freelance
    Flexible hours

    Mindrift

    Lansing, MI
    3 days ago
  •  ...technology company is looking for a detail-oriented individual to design structured evaluation scenarios for AI agents. This entry-level part-time role allows you to contribute remotely, creating test cases for LLM-based agents. The ideal candidate will have a background in... 
    Part time
    Remote work

    Mind Rift

    Brooklyn, NY
    1 day ago
  • $20 per hour

    A technology company specializing in AI is seeking a Copywriter to evaluate and improve AI model outputs. This role is remote, offering both full-time and part-time options with an hourly starting pay of $20+. The ideal candidate is detail-oriented, fluent in English,... 
    Part time
    Remote job
    Hourly pay
    Full time
    Contract work

    DataAnnotation

    Hartford, CT
    5 days ago
  • $80 per hour

     ...the future of AI. What We Do The...  ...for running and evaluating agent behavior....  ...actions against scenario definitions...  ...extending tools that writers and QAs use to test agents Working...  ...needs Take part in a flexible, remote, freelance project...  ...Type Part‑time Job Function Other... 
    Part time
    Remote work
    Freelance
    Flexible hours

    Mind Rift

    New York, NY
    5 days ago
  • $80 per hour

     ...and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment. What This... 
    Permanent employment
    Temporary work

    Mindrift

    San Antonio, TX
    1 day ago
  •  ...experienced cybersecurity professionals to evaluate AI-generated security content and solve...  ...offers the flexibility of a full-time or part-time REMOTE position where you can work on your...  ...experience in fields like penetration testing or incident response, along with strong... 
    Part time
    Remote job
    Full time

    DataAnnotation

    Raleigh, NC
    3 days ago
  •  ...Commitment: Part-time availability with flexibility for increased hours...  ...Review and refine AI-generated prompts, responses,...  ...Support benchmarking efforts to evaluate and compare model capabilities...  ...Strong experience with debugging, testing, and validating code Ability to... 
    Part time
    Remote work

    Crossing Hurdles

    New York, NY
    3 days ago
  • $40 per hour

     ...seeking experienced professionals to evaluate AI-generated security content and solve...  ...cybersecurity roles like penetration testing and incident response, along with strong...  .... This role is offered as a full-time or part-time remote position with hourly pay starting at... 
    Part time
    Remote job
    Hourly pay
    Full time

    DataAnnotation

    Saint Paul, MN
    3 days ago
  •  ...seeking experienced professionals to evaluate AI-generated security content and solve...  ...flexible schedule, with options for full-time or part-time remote work. Candidates should have over 2...  ...in areas such as penetration testing or incident response, strong writing... 
    Part time
    Remote work
    Full time
    Flexible hours

    DataAnnotation

    Louisiana, MO
    a month ago
  • $40 per hour

     ...to join our team to help train AI models. In this role, you will evaluate AI-generated security content, solve...  .... Benefits This is a full-time or part-time REMOTE position You’ll be able to...  ...cybersecurity (e.g., penetration testing, red teaming, incident response,... 
    Part time
    Remote work
    Hourly pay
    Full time

    DataAnnotation

    Madison, WI
    5 days ago
  • $40 per hour

    A leading AI research firm seeks a Research Scientist (Chemistry) to train AI models, evaluate outputs, and enhance model quality. The role requires...  ..., with options for full-time or part-time remote work. Responsibilities include testing AI chatbots and evaluating their... 
    Part time
    Remote job
    Hourly pay
    Full time

    DataAnnotation

    Washington DC
    3 days ago
  • $40 per hour

    A leader in AI training for cybersecurity is seeking experienced...  ...professionals to evaluate AI-generated content and solve...  ...problems. This role offers full-time or part-time remote work with the flexibility to...  ...cybersecurity areas such as penetration testing and incident response. A... 
    Part time
    Remote work
    Hourly pay
    Full time

    DataAnnotation

    Madison, WI
    3 days ago
  •  ...clients. This role is part of a strategic...  ...behind it and a test in front of it....  ...brand-specific AI writing agents...  ...at part-time hours and can flex...  ...results. Our fully remote team of...  ...engagement are a paid evaluation period. You'll do...  ...rationale to non-writers. ~ Self-... 
    Part time
    Remote work
    Full time
    Contract work
    For contractors
    Flexible hours
    Shift work

    Cro Metrics

    Remote
    8 days ago
  • $60 - $80 per hour

     ...marketing. This role is part of a strategic...  ...behind it and a test in front of it....  ...brand-specific AI writing agents...  ...at part-time hours, and which...  ...results. Our fully remote team of...  ...engagement are a paid evaluation period. You'll do...  ...rationale to non-writers. ~ Self-... 
    Part time
    Remote work
    Hourly pay
    Full time
    Contract work
    For contractors
    Flexible hours
    Shift work

    Cro Metrics

    Remote
    8 days ago
  • $70 - $110 per hour

     ...sharing a specialised part-time consulting opportunity...  ...supports current and upcoming remote consulting...  ..., quantitative readout evaluation, rubric-based assessment...  ...professionals will evaluate AI-generated work products...  ...definitions, trend analysis, A/B testing, or research reporting.... 
    Part time
    Remote work
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Work at office
    Flexible hours

    24-MAG

    Remote
    11 days ago
  • $20 per hour

    A leading AI development company in the United States seeks a Freelance Writer to assist in training AI models. As a writer, you will evaluate AI-generated content for grammar and coherence. This role...  ...contract position with remote work flexibility. #J-18808-Ljbffr... 
    Remote job
    Hourly pay
    Contract work
    Freelance

    DataAnnotation

    Lansing, MI
    1 day ago
  • $85 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...: $85/hour Location: Remote Role Responsibilities ~Use...  ...coding agents to complete and evaluate complex engineering tasks....  ...realistic mobile engineering scenarios. Qualifications ~Must-Have... 
    Part time
    Remote work
    Contract work
    Summer work

    Mercor

    Remote
    8 days ago
  • $55 per hour

    A leading technology firm is seeking an Evaluation Scenario Writer - QA to ensure the quality of evaluation scenarios for AI projects. This part-time, flexible role involves reviewing tests, spotting inconsistencies, and collaborating on automation. Ideal for those with... 
    Part time
    Remote job
    Flexible hours

    Mindrift

    New York, NY
    3 days ago
  •  ...company based in North Carolina is seeking a Marketing Copywriter to train AI models by evaluating and improving chatbot outputs. The position offers flexibility as a full-time or part-time remote role, allowing you to choose projects and work on your own schedule. Ideal... 
    Part time
    Remote job
    Full time
    Flexible hours

    DataAnnotation

    Raleigh, NC
    2 days ago
  • $20 per hour

     ...We are looking for a Content Writer to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve...  .... Benefits This is a full-time or part-time REMOTE position You’ll be able to choose... 
    Part time
    Remote work
    Hourly pay
    Full time
    Contract work

    DataAnnotation

    Lincoln, NE
    4 days ago
  • $130 - $180 per hour

    Role Description Join a leading AI research initiative focused...  ...toward training and evaluating next-generation AI models capable...  ...~Develop realistic clinical scenarios. ~Evaluate AI-generated responses...  .... Benefits ~Fully remote with 100% asynchronous work.... 
    Part time
    Remote work
    Weekly pay
    Contract work
    For contractors
    Flexible hours

    Weekday AI

    Remote
    7 days ago
  •  ...firm is seeking a Health Information Specialist to train AI models and evaluate their outputs in diverse healthcare scenarios. This independent contract position can be full-time or part-time and offers remote flexibility. Qualifications include fluency in English and... 
    Part time
    Remote work
    Hourly pay
    Full time
    Contract work
    Flexible hours

    DataAnnotation

    Florida, NY
    4 days ago
  • $60 - $75 per hour

     ...Description Join an advanced AI research initiative focused on...  ...-quality benchmark tasks that evaluate AI performance across software...  ...structured outputs. This is a fully remote, independent contractor...  ...to create authentic evaluation scenarios. ~Collaborate with research... 
    Part time
    Remote work
    Weekly pay
    Contract work
    For contractors
    Flexible hours

    Weekday AI

    Remote
    13 days ago
  • $50 - $60 per hour

    A leading AI training company in the United States is seeking a...  ...financial principles. This flexible remote position allows you to choose...  .... Responsibilities include evaluating AI outputs and ensuring the models' accuracy in diverse scenarios. Join our team to shape the... 
    Part time
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    5 days ago
  • $73 per hour

     ...shape the future of AI. What We Do The...  ...? Does an async, remote, flexible opportunity...  ...modern AI systems are tested and evaluated? About the Project...  ...complex systems, scenarios, and logical implications...  ...needs Take part in a part‑time, remote, freelance project... 
    Part time
    Remote work
    Freelance
    Flexible hours

    Mind Rift

    Denver, CO
    5 days ago
  •  ...enterprises who are building AI systems to power...  ...Please Note: This is a part-time independent contractor...  ...Your Own Device (laptop). Remote work within Canada. 12...  ...Preference-Based Tasks: Evaluate and complete tasks,...  ...to prove on our written test. Basic familiarity with... 
    Part time
    Remote work
    Hourly pay
    16 hours
    Contract work
    Temporary work
    For contractors

    Cohere

    Richmond, VA
    1 day ago
  •  ...Basis Scientific/Technical Writer Basis is a nonprofit applied AI research organization...  ...This is potentially a full-time or part-time position Hours:...  ...we will consider hybrid/remote candidates. Salary...  ...materials for both hiring evaluation and recruitment-related... 
    Part time
    Remote work
    Full time

    Basis Research

    Cambridge, MA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Part-Time Evaluation Scenario Writer for AI Testing. Be the first to apply!