Remote AI Agent Tester: Real-World Task Evaluator
OpenTrain AI, Inc.
OpenTrain AI, Inc. is seeking individuals to remotely test two AI agents on everyday tasks using a smartphone. As a part-time contractor in the United States, you will guide agents, screen record sessions, and provide detailed feedback on completion, control, and user satisfaction.
Applicants should have a Bachelor's degree and 2–3 years of relevant experience in engineering, business, or operations. Candidates must be detail-oriented, able to follow precise instructions, and capable of clear
#J-18808-LjbffrVacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Remote AI Agent Tester: Real-World Task Evaluator in United States vacancy
- ...micro1 Operations Featured Jobs Special Referral AI Agent Tester - Real-World Tasks Remote - United States ChatGPT Muse AI agents Attention to Detail Following Instructions Screen Recording Special Referral gives your application an enhanced referral route, helping it...Remote workContract workWork at officeImmediate start
Remolity, Inc.
New York, NY3 days ago - ...AI Agent Tester - Real-World Tasks is a remote review track for evaluating AI outputs across ai agent tester real world tasks specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document...Remote jobHourly payFor contractorsWork experience placement10 hours per week
- micro1 is seeking an AI Agent Tester to evaluate real-world tasks performed by AI agents. This contractor role is US-based and requires testing from your own phone and accounts, with screen recording and detailed feedback on agent performance. You will run scenarios such...SuggestedFor contractors
$25 - $45 per hour
...Required Skills ChatGPT Muse AI agents Attention to Detail Following... ...models and agents. We provide frontier evaluations and reinforcement learning... ...and velocity. Role Title: AI Agent Tester — Real-World Tasks Role Type: Contractor Location:...SuggestedPart timeFor contractorsWork at officeImmediate startmicro1
San Francisco, CA11 days ago- ...Remolity, Inc. is seeking an AI Agent Tester to evaluate real-world tasks performed by AI agents. You will run scenarios on your own phone in the United... ...completion, quality, and user experience. This role is remote and flexible, with onboarding in 24–48 hours and compensation...Remote workFlexible hours
Remolity, Inc.
New York, NY3 days ago - Remotebridge is seeking an AI Agent Tester to evaluate real-world tasks from a user perspective. This contractor role operates fully from a smartphone, with timely onboarding and onboarding steps completed within 24-48 hours of selection. You'll run scenarios like bills...For contractors
- ...Job Description Job Description Job Title: AI Agent Tester – Real-World Tasks Role Type: Contractor Location: United States Job Summary... ...seeking detail-oriented, U.S.-based AI Agent Testers to evaluate how AI assistants handle everyday tasks. You will test...Remote jobFor contractorsFlexible hours
YO AI Labs
New York, NY9 days ago $25 - $45 per hour
...This is a fully remote position , open to candidates based in United... ...: $25–$45/hr Role Title: AI Agent Evaluator Role Type: Contractor... ...Pay: $25-45/hour Time per task: ~1.5 hours per run (evidence... ...are starting to handle real-life errands: paying bills, booking...Remote workFor contractorsWork at officeWeekend workRemoteJobsOne
United States4 days ago- YO AI Labs in the United States is seeking experienced AI Agent Power Users to contribute to an enterprise AI training project focused on evaluating and improving AI assistants in real-world business workflows. You'll test complex scenarios, document workflows, and provide...Remote job
- ...Outlier is seeking detail-oriented, English-speaking reviewers to evaluate AI-generated media from home on a flexible schedule. You will... ...to assess prompt fidelity, and explain issues in writing, all remotely and on your own timetable. Ideal candidates have strong English...Remote workFlexible hours
Outlier
College Station, TX3 days ago - Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models... ...write explanations of what’s off, all on your own schedule and remotely. Responsibilities include ranking outputs for naturalness and...Remote jobFlexible hours
- ...scientists and engineers to design and evaluate frontier AI models on real technical work, from data analysis... ...design verifications and reporting. Tasks are grounded in authentic practice... ...packages, run them through frontier AI agents, and assess outputs for accuracy,...Remote job
- ...experienced legal professionals to evaluate how frontier AI models handle real legal work, including memos,... ...analyses. You will design tasks, run them through frontier AI agents, and assess outputs against... ...professional standards in a fully remote setting. You will work with...Remote jobContract work
$15 per hour
...Outlier is an AI training platform owned and operated... ...training data to evaluating the performance of models... ...or sounded wrong, all remotely and on your own schedule... ...performs better in the real world. Responsibilities:... ...saw or heard Common tasks: Image evaluations:...Remote workHourly payContract workFor contractorsWork experience placementFreelanceInternshipNight shiftOutlier AI
Blacksburg, VA5 hours ago$15 per hour
...Outlier is an AI training platform owned and operated... ...training data to evaluating the performance of models... ...or sounded wrong, all remotely and on your own schedule... ...performs better in the real world. Responsibilities:... ...saw or heard Common tasks: Image evaluations:...Remote workHourly payContract workFor contractorsWork experience placementFreelanceInternshipNight shiftOutlier AI
Chesapeake, VA5 hours ago$15 per hour
...Outlier is an AI training platform owned and operated... ...training data to evaluating the performance of models... ...or sounded wrong, all remotely and on your own schedule... ...performs better in the real world. Responsibilities:... ...saw or heard Common tasks: Image evaluations:...Remote workHourly payContract workPart timeFor contractorsWork experience placementFreelanceInternshipWork from homeNight shiftOutlier AI
Honolulu, HI5 hours ago$15 per hour
...Outlier is an AI training platform owned and operated... ...training data to evaluating the performance of models... ...or sounded wrong, all remotely and on your own schedule... ...performs better in the real world. Responsibilities:... ...saw or heard Common tasks: Image evaluations:...Remote workHourly payContract workFor contractorsWork experience placementFreelanceInternshipNight shiftOutlier AI
Grand Rapids, MI5 hours ago$15 per hour
...Outlier is an AI training platform owned and operated... ...training data to evaluating the performance of models... ...or sounded wrong, all remotely and on your own schedule... ...performs better in the real world. Responsibilities:... ...saw or heard Common tasks: Image evaluations:...Remote workHourly payContract workFor contractorsWork experience placementFreelanceInternshipNight shiftOutlier AI
Lansing, MI5 hours ago- ...is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations... ...and access to leading LLMs. This role helps improve how AI systems reason and respond in real-world tasks. #J-18808-LjbffrRemote workWeekly payWork from homeFlexible hours
Outlier
United States3 days ago $15 per hour
...is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will hold live conversations with... ...helps shape how advanced AI systems reason and improve in real-world tasks while you work from home or #J-18808-Ljbffr...Remote workHourly payWork from homeFlexible hoursOutlier
Los Angeles, CA3 days ago$100 per hour
...physicians (MD/DO) with an active US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. You will review clinical cases,... ...0 hours per week during active phases, and earnings are task-based at about $100/hr equivalent. #J-18808-LjbffrRemote work10 hours per weekFlexible hoursMind Rift
Sitka, AK4 days ago- ...LinkedIn is seeking an AI Trainer contractor to analyze data and provide feedback to improve LLM performance... ...sector. This part-time, project-based role is remote and US-based. You will design realistic tasks, craft evaluation rubrics, and ensure that outputs reflect...Remote workPart timeFor contractors
LinkedIn
United States1 day ago - ...Outlier is an AI training platform owned and operated... ...training data to evaluating the performance of models... ...or sounded wrong, all remotely and on your own schedule... ...performs better in the real world.Responsibilities:Holding... ...you saw or heardCommon tasks:Image evaluations:...Remote workContract workFor contractorsFreelanceInternshipNight shift
Scale AI
Ann Arbor, MI1 day ago - ...detail-oriented English speakers to review AI-generated media. You will hold live... ...looked or sounded off, all on a flexible remote schedule. You will rate and justify selections... ...This role helps improve how AI systems reason and perform in real-world tasks. #J-18808-LjbffrRemote workFlexible hours
Outlier
United States3 days ago - ...detail-oriented English speakers to review AI-generated media on a fully remote, flexible-hours basis. You will roleplay live... ...improve how AI systems reason and perform in real-world tasks. Responsibilities include evaluating conversations, rating outputs for adherence...Remote workFlexible hours
Outlier
Harahan, LA3 days ago - ...detail-oriented English speakers to review AI-generated media from home, on your own... ...sounded off. Across image, video, and audio tasks, you’ll compare outputs to prompts, note... ...evidence-based explanations to help improve AI systems in real-world use. #J-18808-Ljbffr...Remote work
Outlier
Houston, TX3 days ago - ...detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You'll roleplay conversations... ...improve how advanced AI systems perform in real-world tasks. Responsibilities include evaluating images, videos, and audio, and delivering...Remote workFlexible hours
Outlier
Arizona3 days ago - ...Outlier is an AI training platform owned and operated... ...training data to evaluating the performance of models... ...or sounded wrong, all remotely and on your own schedule... ...performs better in the real world. Responsibilities:... ...saw or heard Common tasks: * Image evaluations:...Remote workWork experience placement
Scale AI
Wilmington, DE1 day ago $15 per hour
...Get paid to spot what AI-generated media gets... ...explain what’s off. Fully remote, flexible hours.... ...improve. Through Outlier's evaluation and feedback loop, your... ...performs better in the real world. $600M+ Paid to... ...or heard. Common Tasks Image evaluations:...Remote workWeekly payContract workFreelanceInternshipFlexible hoursOutlier
United States3 days ago- ...oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will hold live... ...off, helping advance AI systems in real-world use. Candidates should be fluent... ..., and pay attention to detail. Some tasks may require a Bachelor's degree or higher...Remote workFlexible hours
Outlier
United States3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Agent Tester: Real-World Task Evaluator. Be the first to apply!
Related searches
- sourcing agent United States
- final expense agent United States
- right of way agent United States
- money transfer agent United States
- recovery agent United States
- enrolled agent United States
- remote chat agent United States
- cruise agent United States
- special agent United States
- booking agent work from home United States