Remote Part-Time Evaluation Scenario Writer for AI Testing
$80 per hourPart-time
Mindrift
A leading AI innovation firm is seeking an Evaluation Scenario Designer to create structured test cases for LLM-based agents. This part-time role allows for flexible project work, focusing on defining gold-standard behaviors and analyzing agent performance. Candidates should hold a degree in Computer Science or related fields and possess strong analytical skills. Experience in software testing and communication in English are essential. This opportunity offers competitive rates up to $80/hour based on skills and experience. #J-18808-Ljbffr
Vacancy posted 18 hours ago
Similar jobs that could be interesting for youBased on the Remote Part-Time Evaluation Scenario Writer for AI Testing in Wisconsin vacancy
$55 per hour
...technology-driven company is seeking an Evaluation Scenario Writer - QA to validate and improve evaluation scenarios for AI projects. This flexible, part-time role requires a strong QA background... ...skills, and familiarity with test automation. Ideal for analysts or students...Part timeRemote workFreelanceFlexible hoursMind Rift
United States3 days ago- ...technology company is looking for a detail-oriented individual to design structured evaluation scenarios for AI agents. This entry-level part-time role allows you to contribute remotely, creating test cases for LLM-based agents. The ideal candidate will have a background in...Part timeRemote work
Mind Rift
United States3 days ago - ...Commitment: Part-time availability with flexibility for increased hours... ...Review and refine AI-generated prompts, responses,... ...Support benchmarking efforts to evaluate and compare model capabilities... ...Strong experience with debugging, testing, and validating code Ability...Part timeRemote work
Crossing Hurdles
United States3 days ago $40 - $50 per hour
...Apply professional writing and analytical judgment to evaluate written content and AI-generated responses, helping improve the accuracy,... ...and precision. Ability to work independently in a remote setting, manage time effectively, and maintain quality across a high...Remote workHourly payFor contractorsImmediate startSaidGig
Remotea month ago- ...Help evaluate natural, voice-driven interactions with an advanced AI assistant by completing everyday tasks in Brazilian Portuguese and documenting how the assistant responds. Role Overview In this remote, per-task role, you will use a specialized application on your...Remote workImmediate start
SaidGig
United States13 days ago - ...learning environments for advanced AI systems. We are looking for... ...review technical financial scenarios. What We're Researching... ...edge cases, and establishing evaluation rubrics. Your contributions will... ...You will participate in a remote session to design and author...Part timeRemote work
Terac
Remote6 days ago - ...Technical Writer A validation specialist/SME that has experience... ...of user stories and Xray testing (for this one we could... ...conversations when writing these documents) It could be a part-time w 20 hours a week or full time - 40 hrs. Most likely until Q1 2024 Remote...Part timeRemote workFull time
Cardinal Integrated
United States13 hours ago $35 per hour
...? As an Assistant App Review Writer, you'll dive into the exciting... ...and entertainment apps, testing their features and usability... ...insights with fellow users. This part-time role offers a fantastic opportunity... ...to app testing. Location: Remote work worldwide (United States...Part timeRemote workHourly payContract workFixed term contractWorldwideFlexible hoursReview Pays
New York, NY4 days ago$73 per hour
...25 applicants Get AI‑powered advice on this... ...? Does an async, remote, flexible opportunity... ...modern AI systems are tested and evaluated? Project Overview... ...People open to a part‑time and non‑permanent opportunity... ...complex systems, scenarios, and logical implications...Part timeRemote workPermanent employmentFreelanceFlexible hoursMind Rift
Virginia, MN1 day ago$70 per hour
...research problems that help evaluate advanced AI systems in scientific... ..., or self-designed scenarios. Write clear... ...correct answers. Test and calibrate tasks against... .... Work Terms Remote, hourly engagement.... ...immediate start date. Part-time commitment of at...Part timeRemote workHourly payImmediate startSaidGig
United States24 days ago$90 - $150 per hour
...experience to improve how advanced AI handles real-world contract... ...and legal risk analysis. This part-time, remote contractor role focuses on training and evaluating AI systems used in legal work,... ...evaluate AI responses to contract scenarios, providing expert feedback that...Part timeRemote workHourly payContract workFor contractorsSaidGig
United Statesa month ago$70 per hour
...computing challenges that help evaluate advanced AI systems. This remote role focuses on creating... ..., or original scenarios. Write scientific coding... ...correct answer requires. Test and calibrate tasks against... ...project duration. Part-time commitment of at least 20...Part timeRemote workHourly payImmediate startSaidGig
United States8 days ago$86.8k - $198k
...trust you to not only test, analyze, evaluate, validate, and verify... ...developing threat scenarios to support Cyber Tabletop... ...with space-based remote sensing systems or ground... ...of our values. Full-time and part-time employees... ...prevent fraud.Candidate AI Usage PolicyAI is a part...Part timeRemote workFull timeContract workWork at officeLocal area$127k - $213k
...office, 3 days remote.This role does not... ...automation and AI-enabled processes... ...to shape and test investment ideas... ...relative-value, scenario, and contribution... ...investment teams evaluate diversification,... ...producing only one-time analysis.Use... ...Compensation for Part-Time Roles: Please...Part timeRemote workFull timeTemporary workCasual workWork at office$40 - $50 per hour
...your writing and analytical judgment to evaluate written content and AI-generated responses, helping improve... ...working independently, managing time effectively, and consistently following... ...Terms Independent contractor role. Remote, available to candidates located in...Remote jobHourly payFor contractorsImmediate startSaidGig
Europe2 days ago$18 per hour
...Help improve a next-generation voice-driven AI assistant by completing everyday tasks in... ..., capturing natural interactions, and evaluating the quality of the assistant''s responses... ...reviewing work quality. Work Terms Remote, hourly engagement. Immediate start....Remote workHourly payImmediate startSaidGig
United States11 days ago- ...AI Evaluation Rubric Writer is a remote evaluation track for reviewing ai evaluation rubric writer evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling...Remote jobHourly payFor contractors10 hours per week
$70 per hour
...computing challenges that help evaluate the limits of advanced AI systems. This remote, part-time opportunity focuses on materials... ...scientific sources or original scenarios, with the goal of producing... ...correct response must include. Test and calibrate tasks against advanced...Part timeRemote workHourly payFor contractorsImmediate startSaidGig
United States24 days ago$110k - $220k
...yearType: Full time / Regular/PermanentCompany... ...Sunnyvale, CA; remote and hybrid... ...Tech Applied AI Data Science... ...(A/B testing), and ongoing performance... ...strong evaluation and monitoring:... ...and "what-if" scenario planning for Merchants... ...made available as part of the hiring...Part timeRemote workFull timeTemporary work$144.7k - $221.4k
...About the Organization The Evaluation team builds and evolves... .... We own large-scale test scenario libraries, continuous... ...approaches, including time-series data, state derivatives... ...Experience leveraging AI-assisted development... ...coverage.Hybrid/Remote: This role can be based...Remote workFull timeLocal areaWork from homeRelocationRelocation packageFlexible hours$86.8k - $198k
...trust you to not only test, analyze, evaluate, validate, and verify... ...developing threat scenarios to support Cyber Tabletop... ...with space-based remote sensing systems or ground... ...of our values. Full-time and part-time employees... ...prevent fraud.Candidate AI Usage PolicyAI is a part...Part timeRemote workFull timeContract workWork at officeLocal areaBooz Allen Hamilton
Colorado Springs, CO5 days ago$97.73k - $162.88k
...with us. If you want to be part of an inclusive,... ...and execute comprehensive test strategies, test plans,... ...disability coverage, paid time off, employee assistance... ...of the world's leading AI and digital infrastructure... ...While many positions offer remote or hybrid work options,...Remote workFull timeTemporary workWork at officeFlexible hours$80 per hour
...company is seeking contributors for a flexible part-time opportunity focused on quality assurance for autonomous AI agents. You will analyze complex systems, review... ...-oriented skills, with experience in policy evaluation or logic puzzles preferred. Compensation can reach...Part timeRemote workFlexible hoursMind Rift
United States3 days ago$40 - $80 per hour
...train next-generation AI systems through high-quality... ...-world documentation, evaluations, and feedback. Your... ...operational and administrative scenarios. Prior AI experience is... .... Design and review test materials that evaluate... ..., and collaborative remote-work practices. Work...Remote workHourly payFor contractorsSaidGig
Remotea month ago- ...realistic, complex personal finance scenarios. We need financial... ...detailed financial situations and evaluate the accuracy of existing case... ...cases. All work is conducted remotely through our text-based... ...experienced personal finance writers. Candidates must have a deep...Part timeRemote work
Terac
Remote6 days ago $14.5 per hour
A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical...Part timeRemote workHourly payFlexible hoursWelo Data
United States3 days ago$147.76k - $240.11k
...Job Summary:Join the AI Engineering team of... ...team dedicated to evaluating and validating our... ...Quality Assurance and Testing: Knowledge of... ..., speech, and real-time models; prompt engineering... ...data creation, scenario expansion, and LLM-... ...benefits also apply to part-time employeesVisa...Part timeFull timeFlexible hours$85 per hour
...Circuit Design Writer - Engineering FRQ is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards... ...reproduce failures, write the unit test the model should have written,...Remote jobFor contractors10 hours per week$55 per hour
...shape the future of AI. What we do... ...scoring criteria to evaluate the accuracy of the... ...Deep understanding of testing principles and test... ...freelance role is fully remote so, you just need a... ...connection, time available and enthusiasm... ...needs. Take part in a part-time,...Part timeRemote jobFull timeFreelanceMindrift
Remote1 day ago$50 per hour
...shape the future of AI. What we do... ...review Prompt evaluation and complex data annotation... ...with Rust testing tools (e.g., cargo... ...freelance role is fully remote so, you just need a... ...internet connection, time available and... ...needs. Take part in a part-time, remote...Part timeRemote jobFull timeFreelanceMindrift
Pennsylvania1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Part-Time Evaluation Scenario Writer for AI Testing. Be the first to apply!
