Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Agent Tester - Real-World Tasks

$25 - $45 per hour

Remotebridge

Role Title: AI Agent Tester — Real-World Tasks Role Type: Contractor Location: U.S based Opportunity Snapshot Pay: $25-45/hour Time per task: ~1.5 hours per run (evidence and scoring included) Project kickoff: Already active. Onboarding: Within 24–48 hours of being selected, you’ll receive the offer and complete onboarding. You’ll begin tasking as soon as tasks are assigned. You’ll need You'll need: An active personal AI assistant account (Plus tier), active Muse and Dots access, a smartphone that can screen record, and a payment card you can use for test purchases that are reimbursed afterward About the role AI agents are starting to handle real-life errands: paying bills, booking trips, doing the groceries. We want to know how well they actually do it, from the point of view of a real user. That’s you. What you’ll do Run real-life scenarios: bills, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms Approve or stop the agent at key steps Screen record every attempt Score each run on completion, quality, control issues, satisfaction, and time Share clear written feedback on the agent experience Who we’re looking for US-based, with a Bachelor’s degree Someone who already uses AI in daily life 2-3 years of experience, preferably in engineering, business management, or office/operations Detail-oriented, great at following instructions and documenting each step Clear written communication Generalists welcome, domain experts preferred No coding or AI background needed Why you’ll like it Get paid to use the AI tools you already use Work entirely from your phone, on your schedule Have a direct say in how next-generation AI agents get built and improved #J-18808-Ljbffr Remotebridge

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Agent Tester - Real-World Tasks in New York, NY vacancy
  • Remotebridge is seeking an AI Agent Tester to evaluate real-world tasks from a user perspective. This contractor role operates fully from a smartphone, with timely onboarding and onboarding steps completed within 24-48 hours of selection. You'll run scenarios like bills... 
    Suggested
    For contractors

    Remotebridge

    New York, NY
    1 day ago
  •  ...Basis is seeking an Atlas FDE to embed with cross-functional teams and build AI agents that offload real work. You will become the world’s expert in applying AI to a specific domain, learn workflows, and design autonomous software factories that push code to production... 
    Suggested

    Better Tomorrow Ventures

    New York, NY
    1 day ago
  •  ...Role Title: Everyday AI Agent Tester Role Type: Contract Location: U.S based About the role AI agents are starting to handle real-life errands: paying bills, booking trips, doing the groceries...  ...Opportunity Snapshot Time per task: ~1.5 hours per run (evidence and scoring... 
    Suggested
    Contract work
    Work at office
    Remote work
    Weekend work

    Xperteez Technology Pvt Ltd

    New York, NY
    4 days ago
  • $45 per hour

    # Everyday AI Agent Tester$45per hourContractor Remote Last verified 21 Jul 2026Listed on micro1...  ...About the RoleOpportunity Snapshot Time per task: ~1.5 hours per run (evidence and...  ...Monday, October 12## What You'll Do* Run real-life scenarios: bills, returns, email follow... 
    Suggested
    Remote work

    AI Work Expert

    New York, NY
    2 days ago
  • $25 - $45 per hour

     ...Required Skills ChatGPT Muse AI agents Attention to Detail...  ...Role Title: Everyday AI Agent Tester Role Type: Contractor Location...  ...Snapshot Pay: $25-45/hour Time per task: ~1.5 hours per run (evidence...  ...agents are starting to handle real-life errands: paying bills, booking... 
    Suggested
    For contractors
    Work at office
    Weekend work

    Aitrainer

    New York, NY
    2 days ago
  •  ...Role Title: Everyday AI Agent Tester Role Type: Contractor Location: United States We are seeking detail-oriented, U.S.-based professionals to test AI agents performing everyday tasks. You'll evaluate two AI agents side by side, document their performance, and... 
    For contractors
    Work at office
    Remote work

    YO AI Labs

    New York, NY
    4 days ago
  •  ...Remolity, Inc. is seeking a US-based tester to evaluate two AI agents by performing real-life scenarios on your phone. You’ll use your own accounts and report on what worked, what didn’t, and how it felt. Responsibilities include running bills, travel bookings, shopping... 
    Flexible hours

    Remolity, Inc.

    New York, NY
    4 days ago
  • The Zeal Company is seeking an applied AI professional in New York to deploy agent systems in production, solving real customer problems across a portfolio. You will own scoping, architecture, building, and production deployment, working closely with customers to ensure... 

    tz

    New York, NY
    3 days ago
  • $15 per hour

     ...Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts work...  ...into AI that performs better in the real world. Responsibilities: Holding a live...  ...points to what you saw or heard Common tasks: Image evaluations: Compare two AI-generated... 
    Hourly pay
    Contract work
    For contractors
    Work experience placement
    Freelance
    Internship
    Remote work
    Night shift

    Scale AI

    New York, NY
    2 days ago
  • $200k - $300k

     ...Real-Time Voice AI Agent Systems Engineer Company: HireNow Staffing (Direct Placement Partner) HireNow Snapshot HireNow Staffing is actively...  ...will own the technical foundation behind millions of real-world AI voice interactions—from LiveKit architecture and... 
    Permanent employment
    Full time
    Relocation
    Visa sponsorship

    HireNow Staffing

    New York, NY
    4 days ago
  •  ...Himalayas is seeking an Everyday AI Agent Tester on a contract basis in the United States. You will evaluate two AI agents by running everyday errands, using your personal accounts, and documenting results with screen recordings and scores. You should have a Bachelor’s... 
    Contract work
    Remote work
    Flexible hours

    Xperteez Technology Pvt Ltd

    New York, NY
    4 days ago
  •  ...seeking an Offensive Security Agent Engineer to build the systems...  ..., offensive security, and AI agents, building the harnesses...  ...and exploit vulnerabilities in real-world applications. This is an engineering...  ...multi-step offensive security tasks involving reconnaissance,... 

    PensarAI, Inc.

    New York, NY
    4 days ago
  •  ...leading security-first enterprise AI company. We build cutting-edge...  ...products that are designed to solve real-world business problems. We’re...  ...-generating LLMs and autonomous agents are revolutionizing how software is built and tasks are automated. At Cohere, we’re... 
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere Inc.

    New York, NY
    3 days ago
  • $205k - $257k

    Scale has been the leading AI data foundry, helping...  ...reliable AI systems for the world’s most important...  ...Finance vertical within our Agents Data & Reinforcement Learning...  ..., decide what financial tasks are worth modeling, how...  ...AI agents to perform real financial work, and you’... 
    Full time

    Scale AI

    New York, NY
    8 days ago
  • $150k - $300k

     ...Member of Technical Staff – AI Agents & Internal Platforms Location...  ...themselves. These systems do real work today. Every advance in model...  ...of applying agents to real‑world problems The team is particularly...  ...systems and complete complex tasks end‑to‑end. The company is... 
    Full time
    H1b
    Work at office
    Immediate start
    Visa sponsorship

    Morgan Pinnacle Group

    New York, NY
    2 days ago
  • $150k - $250k

     ...About Distyl AI Distyl is an applied AI technology...  ...partnering with the world's most ambitious institutions...  ...systems that deliver real business value. This role...  ...Investigate how agents reason, coordinate, recover...  ...measure agent behavior, task completion, reliability,... 
    Work at office
    Flexible hours
    3 days per week

    Distyl

    New York, NY
    4 days ago
  •  ...Mirage is an AI video company focused on making creation dramatically...  ...by building multimodal agents that turn creative direction into...  ...tools, and execute creative tasks reliably at scale Integrate...  ..., evaluation frameworks, and real-world feedback to guide iteration... 
    Full time
    Currently hiring
    Local area
    Night shift

    Mirage

    New York, NY
    2 days ago
  • $160k - $300k

     ...Front-end Engineer, Agents About Hebbia The user...  ...tackle even the most complex tasks, citing answers over any...  ...to collaborate with AI on each step and validate...  ...customers all over the world. We want to build a product...  ...streaming agent output, real-time progress over long-... 
    Work at office

    Hebbia

    New York, NY
    3 days ago
  •  ...is to accelerate how the world engineers new hardware....  ...include Anduril, Shield AI, Hermeus, Albedo, Shinkei...  ...applications, and agents that accelerate innovators...  ...and simulations, where real test results are the ground...  ...grounded in real hardware tasks. Invent new... 
    Permanent employment

    Nominal

    New York, NY
    20 hours ago
  • $193.4k - $290k

     ...combining frontier agentic AI, an enterprise-grade...  ...product-market fit and world-class investor support....  ...defining a new category in real time. The work is ambitious...  ...As a Software Engineer, Agents, you'll build the...  ...practical evaluations to drive task completion quality and... 

    Harvey AI

    New York, NY
    4 days ago
  •  ...Basis is seeking a design leader to shape how humans and AI agents co-create work in real time. You will design accountant-facing screens and the invisible UI toolbox agents use to assemble those screens, building toward Basis 2027 with iterative prototypes. You’ll work... 

    getbasis.ai

    New York, NY
    3 days ago
  • $152k - $240k

     ...accelerate operations, gain real-time visibility, and...  ...spend effortlessly. Brex’s AI-native automation and world-class service eliminate manual expense and accounting tasks for customers so they can focus...  ...you’ll doWe're building AI agents to automate and augment internal... 
    Work at office
    Remote work
    Work from home

    Brex

    New York, NY
    6 days ago
  • $185k - $235k

     ...Senior Software Engineer, Agent Engineering $185000 -...  ...We combine frontier AI, deep public-sector expertise...  ...Own outcomes, not just tasks. Identify what needs to...  ...with understanding the real problem. Work across...  .... Build for the real world. Our systems must perform... 
    Permanent employment
    Full time
    Work at office
    Local area

    Australia-Employment

    New York, NY
    4 days ago
  • $160k - $350k

     ...HebbiaThe AI platform for investors and bankers that...  ..., and 40% of the world's largest asset managers...  ...meaningful use cases. The Agents team builds everything from...  ...for long running agentic tasks.The world's most powerful...  ...solutions that solve real customer needs.Unlock O(... 
    Work experience placement

    Hebbia

    New York, NY
    4 days ago
  •  ...human intelligence to power the AI economy. We're a leading AI...  ...benchmark family measures AI's real-world impact on professional work. Mercor...  ...expertise directly back into agents.Mercor is creating a new...  ...platform for RL environments and tasks. We build harnesses, agents,... 
    Work at office
    Relocation package

    Mercor Inc

    New York, NY
    1 day ago
  • $290.4k - $363k

    Scale AI is the data foundation for AI, helping organizations build...  ....About the General Agents TeamThe General Agents team, part...  ...frontier agent development and real-world deployment, translating state-...  ...performance on domain-specific tasks.Interest in shaping the future... 
    Full time

    Scale AI

    New York, NY
    8 days ago
  •  ...Senior Software Engineer, Agent Engineering New York...  ...bring together frontier AI, deep public-sector...  ...outcomes, not just assigned tasks. Identify what needs to...  ...decisions begin with the real problem. Work across...  .... Build for the real world. Our systems must perform... 
    Full time
    Work at office

    Helios

    New York, NY
    4 days ago
  • $180k - $220k

     ...About Actively AI Actively AI is defining a new category...  ...power Actively’s GTM AI agents. These agents continuously reason over real-time customer and...  ...nuanced, long-running real-world scenarios — multi-step workflows...  ...own outcomes, not just tasks, and see directly how... 
    Full time
    Work at office
    Shift work

    Actively Inc

    New York, NY
    3 days ago
  • $250k - $300k

     ...StaffML Engineer, AI Agents – Wealth Management Infrastructure San Francisco Bay Area (Hybrid...  ..., embedded into how some of the world’s largest financial institutions serve clients...  ...multi-tenant deployment infrastructure with real enterprise constraints Bridging new LLM... 
    Live in
    Relocation

    Storm2

    New York, NY
    4 days ago
  •  ...neurosymbolic foundation model for AI agents that do consequential work,...  ...where the agent has to hold a real company’s rules across...  ...how some corner of the business world operates. \n \n Solutions...  ...role where you own outcomes, not task throughput. \n Not a support... 
    Work at office

    AUI™ (Augmented Intelligence)

    New York, NY
    21 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Agent Tester - Real-World Tasks. Be the first to apply!