Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Everyday AI Agent Experience Tester

$25 - $45 per hour

OpenTrain AI, Inc.

The Work


You will test two AI agents side by side on a smartphone while they handle realistic everyday errands. You will use personal accounts, supervise important actions, and document what happens during each attempt.

Scenarios may include bill payments, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms.


  • Run realistic everyday scenarios with two AI agents.

  • Approve or stop agent actions at important points.

  • Screen record every attempt and preserve interaction evidence.

  • Score completion, quality, control issues, satisfaction, and time.

  • Write clear feedback about what worked, what failed, and how the experience felt.

What It Pays And Takes


This is a remote contractor role for candidates based in the United States. You will work from a smartphone on your own schedule, with each run taking about 1.5 hours, including evidence collection and scoring.


  • Pay: $25 to $45 per hour.

  • Location: Open to candidates in the United States.

  • Work arrangement: Remote, part-time contract work.

  • Language: Fluent English for written feedback and documentation.

  • Education: Bachelor's degree required.

  • Experience: Two to three years preferred, especially in engineering, business management, office work, or operations.

  • Regular experience using AI tools in daily life.

  • Strong attention to detail and careful instruction following.

  • Thorough step-by-step documentation and clear written communication.

  • A smartphone with screen-recording capability.

  • Access to the personal AI accounts needed for assignments.

  • No coding or prior AI background is required. Generalists are welcome.

About AI Training Work


AI training work is the human side of building artificial intelligence. People test systems, review their results, and provide examples or feedback that help AI tools become more useful, accurate, and easier to control.

#J-18808-Ljbffr
Vacancy posted 56 minutes ago
Similar jobs that could be interesting for youBased on the Everyday AI Agent Experience Tester in Kentucky vacancy
  •  ...micro1 is a data lab that helps AI labs and enterprises train foundational models and agents. We’re hiring an Everyday AI Agent Tester to run real-life scenarios, record outcomes,...  ...ll compare two AI agents, document the experience, and rate performance across completion... 
    Suggested

    Aitrainer

    Kentucky
    56 minutes ago
  • Firecrawl is seeking an Agent Experience Engineer to own how agents discover, understand, and use Firecrawl. You’ll ship fast, run rigorous A...  ...minded experimentation, with equity and generous benefits in a fast-paced AI company environment. #J-18808-Ljbffr AI Chopping Block
    Suggested

    AI Chopping Block

    Eastern, KY
    5 days ago
  • $25 - $45 per hour

     ...Required Skills ChatGPT Muse AI agents Attention to Detail Following Instructions...  ...can screen record Your tasks: Run everyday errands with two AI agents, approve key...  ...clear written feedback on the agent experience Who we’re looking for ~ US-based... 
    Suggested
    For contractors
    Work at office
    Weekend work

    Aitrainer

    Kentucky
    56 minutes ago
  •  ...Role Title: AI Agent Evaluator Role Type: Contractor Location: U.S based Required...  ...can screen record Your tasks: Run everyday errands with two AI agents, approve key...  ...Share clear written feedback on the agent experience Who we’re looking for: ~ US-based,... 
    Suggested
    Contract work
    For contractors
    Work at office
    Remote work
    Weekend work

    Dover

    Kentucky
    3 days ago
  • $60k - $65k

     ...If you aspire to be the best, and work with the best, this is where you belong. About the Role The Hospitality Workplace Experience Agent is a key frontline ambassador for Latham’s Workplace Experience team, serving as a primary point of contact for all personnel... 
    Suggested
    Work at office
    Monday to Friday

    Careers

    Eastern, KY
    1 day ago
  • $200k - $250k

     ...Safer World. TRM Labs provides AI-powered intelligence solutions...  ...-edge tools in the LLM and agent space - including open-source...  ...background with deep experience in backend or systems work (Python...  ...and invest in getting better everyday. Inspiring Colleague: We add... 
    Local area
    Remote work
    Worldwide

    TRM Labs

    Kentucky
    10 hours ago
  • $20 - $30 per hour

     ...per week Pay: $20–30/hour, based on experience and language coverage Start:...  ...ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent...  ...failures, and containers. • Workflow — Everyday Git, diffs, pull requests, and issue tracking... 
    Hourly pay
    Full time
    Contract work
    Immediate start
    Remote work

    Bespoke Labs

    Lexington, KY
    4 days ago
  • $200k - $250k

     ...Safer World. TRM Labs provides AI-powered intelligence solutions...  ...-edge tools in the LLM and agent space — including open-source...  ...background with deep experience in backend or systems work (Python...  ...promise shows up in how we work everyday. TRM moves quickly. We are... 
    Local area
    Remote work
    Worldwide

    Aimlroles

    Kentucky
    4 days ago
  •  ...agentic identity, delegated authorization, runtime attribution, and policy engines across client deployments. This senior role requires hands-on leadership, a proven track record with distributed systems, and strong cloud experience across AWS, #J-18808-Ljbffr vibehackers

    vibehackers

    Eastern, KY
    6 days ago
  •  ...contributor to lead the design, development, and adoption of enterprise AI agent capabilities, AI harness platforms, RAG-based knowledge base...  ..., similar technical field of study or equivalent practical experience.- Experience working with two or more of the following: web... 
    Overseas

    ByteDance

    Eastern, KY
    4 days ago
  •  ...We are seeking an Offensive Security Agent Engineer to build the systems that power autonomous...  ...engineering, offensive security, and AI agents, building the harnesses, tools,...  ..., and exploitation behavior Design experiments around prompts, models, tools, context strategies... 

    Abstraction Capital

    Kentucky
    4 days ago
  •  ...organize expert human knowledge to advance the AI economy. Handshake AI works directly with...  ...Staff to help define how frontier coding agents are benchmarked and improved. This is a...  ...least one of the following: Previous experience working on a Coding benchmark.... 
    Full time
    Work at office
    Flexible hours

    Apply

    Kentucky
    3 days ago
  • Angi is seeking a Senior Data Scientist to help build the AI agent suite for Pros. The first product is an AI voice and SMS agent that...  ...You’ll shape agent behavior, build evaluation systems, design experiments, and model lead-to-job conversion. Work with engineers,... 

    Angi

    Eastern, KY
    6 days ago
  •  ...happens and turns it into a living asset that helps people and AI agents do their best work. We're growing fast, since our founding in...  ...Engineering Team , which powers some of the most essential experiences at Scribe: document viewing and editing, embedding and exporting... 
    Full time
    Temporary work
    Work at office
    Home office
    Flexible hours
    3 days per week

    Scribe

    Eastern, KY
    6 days ago
  • $186.07k - $218.9k

     ...surges. learn more about working at Coinbase. Agent Verification builds systems that help Coinbase safely ship software in an AI-native development environment. The team...  ..., or other high-reliability control planes. Experience with Go, GitHub integrations, AWS, Kubernetes... 
    Local area

    Coinbase

    Eastern, KY
    4 days ago
  • $150k - $250k

     ...by combining software, manufacturing, and AI in one stack.   We're hiring an engineer to build, run and manage a team of AI agents to help us innovate faster, improve performance...  ...help them perform.   Requirements Experience building agents that run on their own and... 
    Remote work
    Relocation package

    Sticker Mule

    Lexington, KY
    4 days ago
  • $160k - $300k

    Front-end Engineer, Agents About Hebbia The user interface for universal knowledge capture...  ...empowers users to collaborate with AI on each step and validate responses instead...  ...understanding capabilities to co-piloting experiences for matrix and deep, multi-source research... 
    Work at office

    Hebbia

    Eastern, KY
    2 days ago
  •  ...Source: web3.career Software Engineer, Agents United States - Remote Engineering - Software...  ...the UK, EU, Canada, and Australia. AI is the default operating mode here. It’s...  ...apply for this role if they do not have experience in 100% of these areas. Please know that... 
    Full time
    Work at office
    Remote work
    Home office
    Flexible hours

    The Bitcoin Street Journal

    Eastern, KY
    5 days ago
  • $243.87k - $286.9k

     ...working at Coinbase We're hiring a Group Product Manager to lead the Compliance Agent Experience product team within our EAA organization. This team builds the internal tooling and AI-powered investigation experiences used by Compliance Operations to execute Coinbase... 
    Local area

    Leyla

    Kentucky
    3 days ago
  • $186.07k - $218.9k

     ...rewrite of Coinbase's retail mobile app from React Native to native Swift and Kotlin, using AI-assisted code generation to deliver a dramatically faster, higher-quality experience for millions of customers. You'll bring deep iOS or Android expertise to build core app... 
    Local area
    Immediate start
    Remote work

    ContentBuffer

    Kentucky
    2 days ago
  • $193.4k - $290k

     ...services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep...  ...Role Overview As a Software Engineer, Agents, you'll build the systems that make our...  ...(post-BS/MS) of software engineering experience. We are hiring for this role across Mid... 

    Harvey, Inc.

    Kentucky
    4 days ago
  • $154.45k - $205k

    ## Lead Software Engineer, AI Agents & OrchestrationApply: Carmel, IN: Remote Location United States: Full time: Posted Today: JR37633...  ...Orchestration with strong software engineering skills and demonstrated experience building and operating production generative AI systems to... 
    Full time
    Temporary work
    Remote work
    Flexible hours

    Allegion Canada Inc.

    Eastern, KY
    6 days ago
  • $51.63k - $124.72k

     ...Border Patrol Agent (BPA) With more than 69,000 employees, U.S. Customs and Border Protection...  ...your education OR prior general or experience in public safety, security, military...  ...Basic Operation of a Motor Vehicle (e.g., everyday use of vehicles, parallel parking) Other... 
    Full time
    Work experience placement
    Immediate start
    Night shift

    Customs and Border Protection

    Pembroke, KY
    3 days ago
  • $51.63k - $124.72k

     ...Border Patrol Agent (BPA) With more than 69,000 employees, U.S. Customs and Border Protection...  ...your education OR prior general or experience in public safety, security, military...  ...Basic Operation of a Motor Vehicle (e.g., everyday use of vehicles, parallel parking) Other... 
    Full time
    Work experience placement
    Immediate start
    Night shift

    Customs and Border Protection

    Adairville, KY
    2 days ago
  • $30k - $60k

     ...Position Overview State Farm Insurance Agent located in Louisville, KY is seeking an...  ...and personal/sick days) Valuable experience Growth potential/Opportunity for advancement...  ...in helping people manage the risks of everyday life, recover from the unexpected, and... 
    Work at office

    Jonathan Gray Insurance Agency

    Louisville, KY
    a month ago
  • $16 per hour

     ...Clint Conrad is an award-winning State Farm Agent looking to grow our excellent,...  ...mission is to help people manage the risks of everyday life, recover from the unexpected and realize...  ...Auditory • Self-Motivated • Experience in Marketing • Achievements in... 
    Base plus commission
    Hourly pay
    For contractors
    Work experience placement
    Internship
    Work at office
    Local area
    Immediate start
    Monday to Friday

    State Farm

    Lexington, KY
    3 days ago
  • $15 per hour

     ...Intern - State Farm Agent Team Member Adam Worrell - State Farm Agent is seeking an...  ...required to efficiently manage the customer experience Collect customer and prospective...  ...mission is to help people manage the risks of everyday life, recover from the unexpected and... 
    Hourly pay
    For contractors
    Internship
    Flexible hours

    Adam Worrell - State Farm Agent

    Hebron, KY
    2 days ago
  • Sierra is hiring a Software Engineer, Agent - Travel & Hospitality in San Francisco. You will build production AI agents for booking, recommendations, maps, payments, voice, chat, and text experiences, connecting our platform to airlines, hotels, rental brands, and travel... 
    Worldwide

    Vacations Worldwide

    Eastern, KY
    5 days ago
  • $253.9k - $298.7k

     ...both iOS and Android on their teams using AI-driven agentic translation at...  ...a novel, world-class mobile development experience. What you'll do Define the technical...  ...reusable AI-automation paradigms such as agent swarms, automated dual-repo synchronization... 
    Local area
    Remote work
    Shift work

    ContentBuffer

    Kentucky
    2 days ago
  • $143.2k - $243.4k

     ...they could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform...  ...product taste and are obsessed with delivering exceptional experiences for end users. Entrepreneurial Grit: You lean into ambiguity,... 
    Work at office
    Immediate start
    Remote work
    Flexible hours
    Day shift

    ServiceNow

    Eastern, KY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Everyday AI Agent Experience Tester. Be the first to apply!