Remote Part-Time Evaluation Scenario Writer for AI Testing
$80 per hourMindrift
Wisconsin
- Remote job
A leading AI innovation firm is seeking an Evaluation Scenario Designer to create structured test cases for LLM-based agents. This part-time role allows for flexible project work, focusing on defining gold-standard behaviors and analyzing agent performance. Candidates should hold a degree in Computer Science or related fields and possess strong analytical skills. Experience in software testing and communication in English are essential. This opportunity offers competitive rates up to $80/hour based on skills and experience. #J-18808-Ljbffr Mindrift
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Remote Part-Time Evaluation Scenario Writer for AI Testing in Wisconsin vacancy
$80 per hour
...shape the future of AI. What We Do The Mindrift... ...and structured evaluation scenarios for LLM-based agents. You'll create test cases that simulate human... ...project needs Take part in a flexible, remote, freelance project that... ...Employment type Part-time Job function Other...Part timeRemote workFreelanceFlexible hours$55 per hour
...with cutting-edge AI projects. We are seeking an Evaluation Scenario Writer - QA for a project... ...validation, automated test thinking, and... ...developers to automate parts of the review... ...part in a flexible, remote, freelance project... ...type: Part-time #J-18808-Ljbffr MindriftPart timeRemote workFreelanceInternshipFlexible hours$80 per hour
A leading AI consultancy is seeking a detail-oriented individual to design evaluation scenarios for LLM-based agents. This part-time, remote role allows you to create structured test cases while working flexibly around your commitments. The ideal candidate holds a relevant...Part timeRemote work$55 per hour
...technology-driven company is seeking an Evaluation Scenario Writer - QA to validate and improve evaluation scenarios for AI projects. This flexible, part-time role requires a strong QA background... ...skills, and familiarity with test automation. Ideal for analysts or students...Part timeRemote workFreelanceFlexible hoursMind Rift
United States4 days ago$20 - $50 per hour
...building careers in AI training and... ...for this remote opportunity. You... ...structured AI evaluations for advanced models... ...challenges that test whether AI... ...answers. This is part of a fast-growing... ...Sales Operations scenarios. Tasks may... ...position Part-time contractor engagement...Part timeRemote workHourly payContract workFor contractorsWorldwideFlexible hours- ...technology company is looking for a detail-oriented individual to design structured evaluation scenarios for AI agents. This entry-level part-time role allows you to contribute remotely, creating test cases for LLM-based agents. The ideal candidate will have a background in...Part timeRemote work
Mind Rift
United States4 days ago $104k
...partner is looking for a AI Evaluators: Assessing A Shopping... ...This is a sustained remote engagement suited to detail... ...real-world e-commerce scenarios. Maintain a... ...annotation, software testing, prompt engineering, or... ...States. Sustained part-time engagement requiring 2...Part timeRemote workHourly payContract work$55 per hour
...5 applicants Get AI-powered advice on... ...? Does an async, remote, flexible opportunity... ...AI systems are tested and evaluated? This is a... ...people open to a part‑time and non‑permanent... ...thinking through scenarios, implications, and... ...closely with QA, writers, or developers to...Part timeRemote workPermanent employmentFreelanceFlexible hours$80 per hour
...and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment. What This...Permanent employmentTemporary work- ...Commitment: Part-time availability with flexibility for increased hours... ...Review and refine AI-generated prompts, responses,... ...Support benchmarking efforts to evaluate and compare model capabilities... ...Strong experience with debugging, testing, and validating code Ability...Part timeRemote work
Crossing Hurdles
United States4 days ago $30 - $90 per hour
...backend services in Go while evaluating and training alpha-stage AI coding tools. This... ...engineering, and structured testing of AI-assisted coding workflows... ...Slack, providing real-time feedback and thoughtful... ...Contract role, fully remote. Part-time engagement organized...Part timeRemote workHourly payContract workFor contractorsSaidGig
United Statesmore than 2 months ago- ...clinical area supported (AI Evaluation & Monitoring) and will... ...tasks. Provides time and effort estimates based... ...performing data profiling, testing, or validation.... ...performed in an office or remote environment. Accountable... ...benefits for full time and part time positions from day...Part timeRemote workFull timeWork at officeWork from homeShift work
- ...YO IT Consulting is looking for a part-time remote Copywriting & Content Subject Matter Expert (SME) to review and create AI-generated content. You will evaluate the quality of AI outputs and provide expertise to enhance persuasive and accurate writing. The ideal candidate...Part timeRemote workImmediate start
YO IT Consulting
Houston, TX3 days ago $61.9k - $141k
...Number: R0247649 HST EW Scenario Writer The Opportunity: The... ...the exercise, ensuring timely and coherent delivery of... ...values. Full-time and part-time employees working... ...prevent fraud. Candidate AI Usage Policy AI is a part... ...on during meetings. Remote: If this position is listed...Part timeRemote workFull timeContract workWork at officeLocal area- ...original multiple-choice questions on Taiwanese or Hong Kong accounting, auditing, and tax in Chinese (Traditional) for an AI evaluation dataset. This remote role offers flexible hours and draws on your own professional expertise. Key Responsibilities Draft original...Remote workFlexible hours
SaidGig
United Statesa month ago - ...original, exam-style multiple-choice questions on Swedish law for an AI evaluation dataset, drawing on your professional legal expertise. Key... ...from professional expertise in Swedish law. Work Terms ~ Remote hourly engagement with flexible hours. Compensation ~$3...Remote workHourly payFlexible hours
SaidGig
United Statesa month ago $27.78 - $33.96 per hour
...Overview Create original, exam-style multiple-choice questions that evaluate understanding of Ukrainian law. Each item will be authored from... ...question stems and detailed worked solutions. Work Terms Remote role with flexible working hours. Hourly engagement....Remote workHourly payFlexible hoursSaidGig
United States23 days ago- ...Create original, exam-style multiple-choice questions on Finnish law for an AI evaluation dataset. This remote, flexible-hours opportunity draws on your professional legal expertise to produce rigorous assessment content in Finnish. Key Responsibilities Draft original...Remote workHourly payFlexible hours
SaidGig
United Statesa month ago - ...exam-style multiple-choice questions on Danish law to support an AI evaluation dataset. You will apply your professional legal expertise to... .... Native-level Danish proficiency. Work Terms ~ Remote, hourly engagement with flexible working hours. Compensation...Remote workHourly payFlexible hours
SaidGig
United Statesa month ago - ...exam-style multiple-choice questions on Hungarian law for an AI evaluation dataset, drawing on your professional legal expertise. Key... ...Hungary. Native-level Hungarian proficiency. Work Terms Remote hourly engagement. Flexible working hours. Compensation...Remote workHourly payFlexible hours
SaidGig
United Statesa month ago $38.59 - $47.17 per hour
...questions covering Danish accounting, auditing, and tax to support an AI evaluation dataset. Key Responsibilities Develop questions using your... .... Native-level Danish proficiency. Work Terms ~ Remote hourly engagement with flexible hours. Compensation ~...Remote workHourly payFlexible hoursSaidGig
United States23 days ago$24.26 - $29.65 per hour
...multiple-choice questions about the law of your jurisdiction for an AI evaluation dataset. The work relies on your professional legal expertise... ...in or based in an Arabic-speaking country Work Terms Remote work Flexible hours Hourly engagement Compensation 24...Remote workHourly payFlexible hoursSaidGig
United States23 days ago- ...script, focused on Taiwanese or Hong Kong law to populate an AI evaluation dataset. Each question must be grounded in your professional legal... ...choices, and be accompanied by a worked solution. This is a remote, hourly engagement with flexible scheduling. Key...Remote workHourly payFlexible hours
SaidGig
United Statesa month ago $24.26 - $29.65 per hour
...Role Overview Create original Arabic general-knowledge multiple-choice questions that support AI evaluation. This flexible, remote hourly role draws on your subject-matter expertise to produce rigorous exam-style content. Key Responsibilities Draft original general...Remote workHourly payFlexible hoursSaidGig
United Statesa month ago$39.69 - $48.51 per hour
...choice questions on Chinese accounting, auditing, and tax for an AI evaluation dataset. This role draws on your professional expertise to... ...-level proficiency in Chinese (Simplified). Work Terms ~ Remote hourly role with flexible hours. Compensation ~$39.69 to...Remote workHourly payFlexible hoursSaidGig
United Statesa month ago- ...Role Overview Create original, exam-style multiple-choice questions on Norwegian law for an AI evaluation dataset. This remote role draws on your professional legal expertise to produce clear, rigorous assessment content in Norwegian. Key Responsibilities Draft...Remote workHourly payFlexible hours
SaidGig
United Statesa month ago $39.69 - $48.51 per hour
...knowledge multiple-choice questions in Chinese (Simplified) for an AI evaluation dataset. Each item must be produced from your own expertise,... ...ten answer options, and come with a worked solution. Work remotely with flexible hours. Key Responsibilities Draft...Remote workHourly payFlexible hoursSaidGig
United Statesa month ago$15.79 - $19.29 per hour
...exam-style multiple-choice questions on Thai law to support an AI evaluation dataset. This role draws on your professional legal expertise... ...Thailand. Native-level Thai proficiency. Work Terms Remote hourly engagement. Flexible working hours. Compensation...Remote workHourly payFlexible hoursSaidGig
United Statesa month ago$24.26 - $29.65 per hour
...choice questions in Arabic on accounting, auditing, and tax for an AI evaluation dataset. Questions should reflect rules and practice in your... ...country. Native-level Arabic proficiency. Work Terms Remote engagement. Flexible hours. Hourly contract....Remote workHourly payContract workFlexible hoursSaidGig
United States23 days ago$40 - $50 per hour
...Apply your writing and analytical skills to evaluate written content and AI-generated responses, helping improve the accuracy, reliability, and overall... ...of work. Comfortable working independently in a remote setting. Work Terms Independent contractor engagement...Remote workHourly payFor contractorsImmediate startSaidGig
Remote20 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Part-Time Evaluation Scenario Writer for AI Testing. Be the first to apply!
