Remote AI Agent Tester - Real-World Tasks Scoring
Xperteez Technology Pvt Ltd
New York, NY
- Remote job
Xperteez Technology Pvt Ltd in the United States is seeking an AI Agent Tester to evaluate real-world tasks across two AI agents, using your own device and accounts. You will observe flows, record outcomes, and provide clear feedback. This contract role emphasizes attention to detail, following instructions, and practical use of AI tools in daily life. You’ll onboard quickly, work on flexible schedules, and influence how next-generation AI assistants are tested and improved. #J-18808-Ljbffr Xperteez Technology Pvt Ltd
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote AI Agent Tester - Real-World Tasks Scoring in New York, NY vacancy
- YO AI Labs is seeking U.S.-based AI Agent Testers to evaluate how AI assistants handle everyday tasks. Test two AI agents using your own accounts and... ...provide feedback to improve real-world usability.... ...points, screen-recording, and scoring outcomes. Strong attention...Remote job
$25 - $45 per hour
Zekai is seeking an AI Agent Tester to evaluate real-world AI assistants on everyday tasks. This is a 100% remote contractor role based in the United States, with pay of $25-45 per... ..., approve or stop at key steps, and score outcomes for completion, quality, control...Remote jobHourly payFor contractors- Job Title: AI Agent Tester - Real-World Tasks Role Type: Contractor Location: United States Job Summary We are seeking detail-oriented, U.S.-based AI... ...important decision points. Screen-record every task attempt. Score performance based on completion, quality, user control,...Remote jobFor contractorsFlexible hours
$25 - $45 per hour
...requirements. Time per task: ~1.5 hours per run (evidence and scoring included) Project... ...An active personal AI assistant account (Plus... ...errands with two AI agents, approve key steps,... ...starting to handle real-life errands: paying... ...or United Kingdom, Remote · Contract Alaska, United...Remote workContract workWork at officeImmediate start$25 - $45 per hour
Test two AI agents on everyday tasks such as bookings, shopping, forms, and returns using your smartphone. This remote U.S. contractor role pays $25 to $45 per... ...from start to finish. Score each run and provide precise... ...AI tools work better in real situations....Remote workHourly payContract workPart timeFor contractorsWork at office- ...AI Agent Tester - Real-World Tasks is a remote review track for evaluating AI outputs across ai agent tester real world tasks specialist operations workflows... ...or firm guidance. Maintain reviewer-quality scores in inter-rater calibration cycles. Qualifications...Remote jobHourly payFor contractorsWork experience placement10 hours per week
- micro1 is seeking an AI Agent Tester to evaluate real-world tasks performed by AI agents. This contractor role is US-based and requires testing from your... ..., making bookings, and shopping, approving steps, and scoring outcomes. No coding background is required. #J-18808-...For contractors
- OpenTrain AI, Inc. is seeking individuals to remotely test two AI agents on everyday tasks using a smartphone. As a part-time contractor in the United States, you will guide agents, screen record sessions, and provide detailed feedback on completion, control, and user...Remote jobPart timeFor contractors
$25 - $45 per hour
...Required Skills ChatGPT Muse AI agents Attention to Detail Following... ...and velocity. Role Title: AI Agent Tester — Real-World Tasks Role Type: Contractor Location:... ...task: ~1.5 hours per run (evidence and scoring included) Project kickoff: Already...Part timeFor contractorsWork at officeImmediate startmicro1
San Francisco, CA19 days ago$5,000 per month
...We are looking for U.S.-based professionals to test AI agents on everyday real-world tasks and provide structured feedback on their performance, usability... ...at key steps. Screen record each test attempt. Score each run based on completion, quality, control,...Work at office$25 - $45 per hour
...Testers put two AI agents through ordinary errands such as paying bills, shopping, travel booking and... ...steps, capture screen recordings and score each run, then write feedback. Some test... ...Listed pay: $25 to $45 per hour. Where: Remote, US only. Time: About 1.5 hours per...Remote workHourly payContract workLive in- Remotebridge is seeking an AI Agent Tester to evaluate real-world tasks from a user perspective. This contractor role operates fully from a smartphone, with timely onboarding and onboarding steps completed within 24-48 hours of selection. You'll run scenarios like bills...For contractors
$20 - $40 per hour
Put AI agents through realistic multi-step jobs and judge whether they actually finish them.... ...not earn. What you will do Write realistic task scenarios for agents that browse, use... ...guidelines and work independently Contract Remote, hourly contract (independent contractor)...Remote jobHourly payWeekly payContract workPart timeFor contractorsFlexible hours- micro1 is seeking AI Generalist Experts to contribute to customer projects focused on improving next-generation AI systems. In... ...problem-solving skills, and familiarity with AI tools to complete real-world tasks, evaluate AI outputs, and provide structured feedback. Your...Remote job
$60 per hour
...shape the future of AI. About The Role We... ...for LLM-based agents. You'll create test... ...simulate human-performed tasks and define gold‑... ...clearly defined, well‑scored, and easy to... ...scenarios based on real‑world tasks Define the golden... ...freelance role is fully remote so you just need a...Remote workPart timeFreelanceFlexible hours- PPRG Holdings, LLC is seeking an AI Engineering Intern to work on projects involving AI agents and local large language models... ...and the opportunity to work remotely or hybrid near Cape Coral, FL.... ...allowing interns to contribute to real-world applications while...Remote jobInternshipLocal areaFlexible hours
$25 - $45 per hour
...folder. This is a fully remote position open to... ...Role Title: Everyday AI Agent Tester Role Type: Contractor... ...$25-45/hour Time per task: 1.5 hours per run (evidence and scoring included) Project kickoff... ...are starting to handle real-life errands: paying bills...Remote workFull timeFor contractorsWork at officeWeekend work$60 per hour
...25 applicants Get AI-powered advice on this... ...by tapping into real-world expertise from across... ...? Does an async, remote, flexible opportunity... ...for autonomous AI agents for a new project... ...improving complex task structures, policy... ...understanding of how scoring or evaluation works...Remote workPermanent employmentPart timeFreelanceFlexible hours- Truelancer AI is seeking experienced professionals to record real-world tasks on a Mac (M-series) with clear voice narration. Tasks should showcase industry-standard... ...narration explaining steps, decisions, and reasoning. Remote work is accepted, and candidates from eligible...Remote job
$20 - $30 per hour
...Contract, hourly Location: Remote Hours: 20–30 per week... ...evaluate how well advanced AI coding agents solve real engineering problems. An agent... ...a container and a hard task, then works on its own for... ...only inefficient — these are scored differently. • Where did...Remote workHourly payFull timeContract workImmediate startBespoke Labs
Seattle, WA2 days ago$5,000 per month
...looking for US-based professionals to evaluate how AI agents perform everyday tasks from a real-user perspective. You’ll test two AI agents side by... ...experience. What You'll Do Test AI agents across real-world scenarios such as shopping, travel, bookings, forms,...- .... Cresta’s unified AI platform combines conversational AI agents, real-time human agent augmentation... ...every channel. The world’s leading companies... ...the front-office tasks that keep their... ...pipeline that scores every production conversation... ...the future Remote work setup budget...Remote workFull timeWork at officeHome officeFlexible hours
$190.9k - $334.1k
...automated a tedious task for his coworker... ...is the AI control tower for... ...Engineer, Voice AI Agent Engineering designs... ...correctly on real calls. This is not... ...model-as-judge scoring calibrated to human... ...our distributed world of work with... ...personas (flexible, remote, or required in...Remote workWork at officeLocal areaImmediate startFlexible hoursServiceNow
Santa Clara, CA2 days ago$50 per hour
.../hr as an OpenClaw Agent Builder Shape... ...OpenClaw. Freelance, remote, up to $50 USD/hr.... ...Over $200/month in AI access, included at... ...Outlier helps the world’s most innovative companies... ...optimize complex, real-world architectural... ...stage coordination tasks where data...Remote workWeekly payExtra incomeContract workFreelanceInternshipWorldwideOutlier
Memphis, TN4 days ago$62.4k - $83.2k
...and regions. Job Title: AI Intern, Enterprise Agent Development Supervisor... ...preferably, but open to US Remote for the right candidate)... ...Build capabilities such as task planning, tool calling, and... ...deploy AI Agent solutions in real-world enterprise scenarios....Remote workHourly payTemporary workInternshipFlexible hours$113.5k - $175.9k
...areMoveworks: the Agentic AI Assistant... ...and automate tasks. Powered by the world's most advanced LLMs... ...RoleMoveworks' AI agents don't just... ...tools, and change real state in enterprise... ...problem: how do you score what an agent did... ...personas (flexible, remote, or required in...Remote workContract workWork at officeFlexible hoursMoveworks
Mountain View, CA3 days ago- ...finally made it possible for AI to impact clinical care in a meaningful... ...an entire ecosystem of real-world evidence to deliver real-time,... ...-edge AI tools to scale tasks and augment insights. Key ResponsibilitiesPharma... ...position.Additionally, for remote roles open to individuals in...Remote workFull time
Tempus
New York, NY3 days ago - ...finally made it possible for AI to impact clinical care in a meaningful... ...an entire ecosystem of real-world evidence to deliver real-time,... ...-edge AI tools to scale tasks and augment insights. Key ResponsibilitiesPharma... ...position.Additionally, for remote roles open to individuals in...Remote workFull time
Tempus
New York, NY3 days ago $85 per hour
...Security Engineer (Coding Agent Experience) is a remote engineering review track... ..., and developer-facing AI outputs against real-world correctness standards.... ...security issue) with severity scores. Document recurring... ...is a plus. Example tasks Reproduce a generated...Remote jobFor contractors10 hours per week- ...teams working around the world, with over 20... ...from our offices and remotely, who truly enjoys their... ...systems behind BJAK's AI Finance Agent. This role is for engineers... ...that work in the real world, not just on diagrams... ...want isolated backend tasks. People who ignore...Remote workFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Agent Tester - Real-World Tasks Scoring. Be the first to apply!
Related searches