Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Agent Tester - Real-World Tasks

$25 - $45 per hour

Remotebridge

Role Title: AI Agent Tester — Real-World Tasks Role Type: Contractor Location: U.S based Opportunity Snapshot Pay: $25-45/hour Time per task: ~1.5 hours per run (evidence and scoring included) Project kickoff: Already active. Onboarding: Within 24–48 hours of being selected, you’ll receive the offer and complete onboarding. You’ll begin tasking as soon as tasks are assigned. You’ll need You'll need: An active personal AI assistant account (Plus tier), active Muse and Dots access, a smartphone that can screen record, and a payment card you can use for test purchases that are reimbursed afterward About the role AI agents are starting to handle real-life errands: paying bills, booking trips, doing the groceries. We want to know how well they actually do it, from the point of view of a real user. That’s you. What you’ll do Run real-life scenarios: bills, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms Approve or stop the agent at key steps Screen record every attempt Score each run on completion, quality, control issues, satisfaction, and time Share clear written feedback on the agent experience Who we’re looking for US-based, with a Bachelor’s degree Someone who already uses AI in daily life 2-3 years of experience, preferably in engineering, business management, or office/operations Detail-oriented, great at following instructions and documenting each step Clear written communication Generalists welcome, domain experts preferred No coding or AI background needed Why you’ll like it Get paid to use the AI tools you already use Work entirely from your phone, on your schedule Have a direct say in how next-generation AI agents get built and improved #J-18808-Ljbffr Remotebridge

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI Agent Tester - Real-World Tasks in New York, NY vacancy
  • Job Title: AI Agent Tester - Real-World Tasks Role Type: Contractor Location: United States Job Summary We are seeking detail-oriented, U.S.-based AI Agent Testers to evaluate how AI assistants handle everyday tasks. You will test two AI agents using your own accounts... 
    Suggested
    Remote job
    For contractors
    Flexible hours

    YO AI Labs

    New York, NY
    1 day ago
  • $25 - $45 per hour

    pay Required Skills ChatGPT Muse AI agents Attention to Detail Following Instructions Screen Recording About micro1 micro1 is...  ...ensures both quality and velocity. Role Title: AI Agent Tester — Real-World Tasks Role Type: Contractor Location: U.S based Opportunity Snapshot... 
    Suggested
    For contractors
    Work at office
    Immediate start

    Micro1

    New York, NY
    2 days ago
  • Xperteez Technology Pvt Ltd in the United States is seeking an AI Agent Tester to evaluate real-world tasks across two AI agents, using your own device and accounts. You will observe flows, record outcomes, and provide clear feedback. This contract role emphasizes attention... 
    Suggested
    Remote job
    Contract work
    Flexible hours

    Xperteez Technology Pvt Ltd

    New York, NY
    5 days ago
  • micro1 is seeking an AI Agent Tester to evaluate real-world tasks performed by AI agents. This contractor role is US-based and requires testing from your own phone and accounts, with screen recording and detailed feedback on agent performance. You will run scenarios such... 
    Suggested
    For contractors

    Micro1

    New York, NY
    2 days ago
  • YO AI Labs is seeking U.S.-based AI Agent Testers to evaluate how AI assistants handle everyday tasks. Test two AI agents using your own accounts and smartphone, assess performance, and provide feedback to improve real-world usability. Responsibilities include testing various... 
    Suggested
    Remote job

    YO AI Labs

    New York, NY
    1 day ago
  • $25 - $45 per hour

    Zekai is seeking an AI Agent Tester to evaluate real-world AI assistants on everyday tasks. This is a 100% remote contractor role based in the United States, with pay of $25-45 per hour and onboarding within 24-48 hours of selection. You will run real-life scenarios with... 
    Remote job
    Hourly pay
    For contractors

    Confidential

    New York, NY
    2 days ago
  • $25 - $45 per hour

    Test two AI agents on everyday tasks such as bookings, shopping, forms, and returns using your smartphone. This remote U.S. contractor role pays $...  ...and explain what needs to improve so AI tools work better in real situations. Requirements Experience: Entry level #J-1880... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Work at office
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    2 days ago
  • Remotebridge is seeking an AI Agent Tester to evaluate real-world tasks from a user perspective. This contractor role operates fully from a smartphone, with timely onboarding and onboarding steps completed within 24-48 hours of selection. You'll run scenarios like bills... 
    For contractors

    Remotebridge

    New York, NY
    3 days ago
  • OpenTrain AI, Inc. is seeking individuals to remotely test two AI agents on everyday tasks using a smartphone. As a part-time contractor in the United States, you will guide agents, screen record sessions, and provide detailed feedback on completion, control, and user... 
    Remote job
    Part time
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    2 days ago
  • $20 - $40 per hour

    Put AI agents through realistic multi-step jobs and judge whether they actually finish them. Your scenarios, ratings and notes show developers...  ...success it did not earn. What you will do Write realistic task scenarios for agents that browse, use apps or handle email and... 
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    Vettedlance

    New York, NY
    4 days ago
  • $85 per hour

     ...Remote — US-eligible · Contractor Everyday AI Agent Tester is a remote review track for evaluating...  ...unwritten rules that decide whether a task actually gets done. Responsibilities...  ...ai agent tester specialist operations on real teams for Everyday AI Agent Tester work.... 
    Hourly pay
    For contractors
    Work experience placement
    Remote work
    10 hours per week

    Auraone

    New York, NY
    5 days ago
  • $50 per hour

     ...To $50/hr as an OpenClaw Agent Builder Shape the...  ...~ Over $200/month in AI access, included at no extra...  ...Outlier helps the world’s most innovative companies...  ..., and optimize complex, real-world architectural workflows...  ...-stage coordination tasks where data acquisition leads... 
    Weekly pay
    Extra income
    Contract work
    Freelance
    Internship
    Remote work
    Worldwide

    Outlier

    New York, NY
    7 hours ago
  •  ...neurosymbolic foundation model for AI agents that do consequential work,...  ...where the agent has to hold a real company’s rules across...  ...how some corner of the business world operates. Solutions, implementation...  ...where you own outcomes, not task throughput. Not a support... 
    Work at office

    AUI™ (Augmented Intelligence)

    New York, NY
    14 days ago
  •  ...Job Description Job Description Role Title: Everyday AI Agent Tester Role Type: Contractor Location: United States We are seeking...  ....S.-based professionals to test AI agents performing everyday tasks. You'll evaluate two AI agents side by side, document their... 
    Remote job
    For contractors
    Work at office

    YO AI Labs

    New York, NY
    6 days ago
  •  ...About WRITER WRITER is the AI platform built for the world’s most ambitious marketing...  ...growth. With WRITER, autonomous agents work across the buyer...  ...workflows, orchestrate multi-step tasks, and extend human capacity...  ...data and services to solve real-world problems. You will... 
    Full time
    Local area
    Flexible hours

    Writer

    New York, NY
    8 days ago
  • $20 - $40 per hour

    Vettedlance is seeking detail-oriented contributors to craft realistic AI task scenarios and evaluate agent performance. You will describe steps, judge outcomes, and document failures in plain language to help developers improve automation. The role is remote, part-time... 
    Remote job
    Hourly pay
    Weekly pay
    Part time
    10 hours per week

    Vettedlance

    New York, NY
    3 days ago
  • $20 - $30 per hour

     ...Start: Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works on its own for 80 to 250 steps. A trajectory is the full... 
    Hourly pay
    Full time
    Contract work
    Immediate start
    Remote work

    Bespoke Labs

    New York, NY
    1 day ago
  • micro1 is seeking a contractor for the role of Food Delivery App User Tester in the United States. This position focuses on contributing high-quality, real-world input to train AI systems, with emphasis on clear feedback and independent remote work. You will use your existing... 
    Remote job
    For contractors

    Micro1

    New York, NY
    5 days ago
  • Vettedlance is seeking a part-time, remote contractor to craft realistic customer-support conversations for AI voice agents and assess how well AI responses handle real-world calls. You will also schedule and record outcomes of calls, including reservations and confirmations.... 
    Remote job
    Hourly pay
    Weekly pay
    Part time
    For contractors
    Shift work

    Vettedlance

    New York, NY
    4 days ago
  • $25 - $45 per hour

    Role Title: AI Agent Evaluator Role Type: Contractor Location: U.S based Opportunity Snapshot Pay: $25-45/hour Time per task: ~1.5 hours per run (evidence and scoring included) Project kickoff...  ...role AI agents are starting to handle real-life errands: paying bills, booking... 
    For contractors
    Work at office
    Weekend work

    micro1 Inc.

    New York, NY
    3 days ago
  • Описание CloudTalk is an AI-powered business phone system and AI Voice Agent platform built for sales and support teams....  ...sessions, identifying key, golden tasks for your user segment, and aligning...  ...with our resident coach. A real conversation about your career, on... 
    Work at office
    Remote work
    Work from home
    Home office
    Flexible hours
    Early shift

    CloudTalk

    New York, NY
    3 days ago
  •  ...Experience: 4+ years Focus: AI Product Engineering, Full-Stack...  ...decisions. Their AI agents automate the entire research process...  ...digital twins that simulate real customer behavior, enabling businesses...  ...products used by some of the world's most recognized technology... 
    Full time

    Nxt Level

    New York, NY
    4 days ago
  •  ...About the Role We're looking for a Senior Software Engineer (AI Agents) to build the core systems behind an intelligent automation...  ...major architectural decisions, and build technology that solves real-world operational problems at scale. What You’ll Do • Build and... 

    arcadia

    New York, NY
    a month ago
  • $290.4k - $363k

    Scale AI is the data foundation for AI, helping organizations build...  ....About the General Agents TeamThe General Agents team, part...  ...frontier agent development and real-world deployment, translating state-...  ...performance on domain-specific tasks.Interest in shaping the future... 
    Full time

    Scale AI

    New York, NY
    5 days ago
  •  ...curiosity and sharp instincts could help shape the AI tools millions of people rely on every day? We're looking for AI Chatbot Testers to engage directly with cutting‑edge AI...  ...impact — your feedback directly shapes AI that real people use every day Freelance freedom —... 
    Hourly pay
    Contract work
    Freelance
    Remote work
    Flexible hours

    Alignerr

    New York, NY
    4 days ago
  • $189k - $260k

    Secure Every Identity, from AI to HumanIdentity is the key to unlocking the potential...  ...relentless drive to solve complex challenges with real-world stakes. We are looking for builders and...  ...As a Senior Product Manager, Okta for AI Agents, you will drive the product strategy and... 
    Local area
    Worldwide
    Flexible hours

    Okta

    New York, NY
    2 days ago
  •  ...a data lab that helps AI labs & Enterprises train...  ...foundational models and agents. We provide frontier...  ...Food Delivery App User Tester Job Type: Contractor...  ...through high-quality, real-world input. No prior experience...  ...independently and managing remote tasks efficiently. Preferred... 
    For contractors
    Remote work

    Micro1

    New York, NY
    5 days ago
  • $15 - $30 per hour

     ...Grok Imagine, which you can edit and then use to generate your own video. It also runs a library of AI video prompts we've actually tested. Each one is shown with the real output clip and a note on what the model followed and what it missed. Homepage: VideoCreate... 
    Freelance
    Remote work
    Worldwide

    VideoCreate

    New York, NY
    3 days ago
  • Remotebridge is seeking a contractor to test a food delivery app by acting as a real user, generating authentic data, and documenting user journeys across platforms. Your feedback will help train AI systems to better understand user behavior in grocery and restaurant... 
    Remote job
    For contractors

    Remotebridge

    New York, NY
    5 days ago
  • $75 per hour

     ...Practitioner or Physician Assistant for a remote contractor assignment in the USA. You will test a healthcare product, follow predefined tasks, and provide structured feedback based on clinical experience. Requirements include an active NP/PA license, at least 3 years of... 
    Remote job
    Hourly pay
    For contractors
    Immediate start
    Flexible hours

    Crossing Hurdles

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Agent Tester - Real-World Tasks. Be the first to apply!