Everyday AI Agent Experience Tester
$25 - $45 per hourOpenTrain AI, Inc.
The Work
You will test two AI agents side by side on a smartphone while they handle realistic everyday errands. You will use personal accounts, supervise important actions, and document what happens during each attempt.
Scenarios may include bill payments, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms.
- Run realistic everyday scenarios with two AI agents.
- Approve or stop agent actions at important points.
- Screen record every attempt and preserve interaction evidence.
- Score completion, quality, control issues, satisfaction, and time.
- Write clear feedback about what worked, what failed, and how the experience felt.
What It Pays And Takes
This is a remote contractor role for candidates based in the United States. You will work from a smartphone on your own schedule, with each run taking about 1.5 hours, including evidence collection and scoring.
- Pay: $25 to $45 per hour.
- Location: Open to candidates in the United States.
- Work arrangement: Remote, part-time contract work.
- Language: Fluent English for written feedback and documentation.
- Education: Bachelor's degree required.
- Experience: Two to three years preferred, especially in engineering, business management, office work, or operations.
- Regular experience using AI tools in daily life.
- Strong attention to detail and careful instruction following.
- Thorough step-by-step documentation and clear written communication.
- A smartphone with screen-recording capability.
- Access to the personal AI accounts needed for assignments.
- No coding or prior AI background is required. Generalists are welcome.
About AI Training Work
AI training work is the human side of building artificial intelligence. People test systems, review their results, and provide examples or feedback that help AI tools become more useful, accurate, and easier to control.
#J-18808-Ljbffr- ...micro1 is a data lab that helps AI labs and enterprises train foundational models and agents. We’re hiring an Everyday AI Agent Tester to run real-life scenarios, record outcomes,... ...ll compare two AI agents, document the experience, and rate performance across completion...Suggested
- Firecrawl is seeking an Agent Experience Engineer to own how agents discover, understand, and use Firecrawl. You’ll ship fast, run rigorous A... ...minded experimentation, with equity and generous benefits in a fast-paced AI company environment. #J-18808-Ljbffr AI Chopping BlockSuggested
$25 - $45 per hour
...Required Skills ChatGPT Muse AI agents Attention to Detail Following Instructions... ...can screen record Your tasks: Run everyday errands with two AI agents, approve key... ...clear written feedback on the agent experience Who we’re looking for ~ US-based...SuggestedFor contractorsWork at officeWeekend work- ...Role Title: AI Agent Evaluator Role Type: Contractor Location: U.S based Required... ...can screen record Your tasks: Run everyday errands with two AI agents, approve key... ...Share clear written feedback on the agent experience Who we’re looking for: ~ US-based,...SuggestedContract workFor contractorsWork at officeRemote workWeekend work
$60k - $65k
...If you aspire to be the best, and work with the best, this is where you belong. About the Role The Hospitality Workplace Experience Agent is a key frontline ambassador for Latham’s Workplace Experience team, serving as a primary point of contact for all personnel...SuggestedWork at officeMonday to Friday$200k - $250k
...Safer World. TRM Labs provides AI-powered intelligence solutions... ...-edge tools in the LLM and agent space - including open-source... ...background with deep experience in backend or systems work (Python... ...and invest in getting better everyday. Inspiring Colleague: We add...Local areaRemote workWorldwide$20 - $30 per hour
...per week Pay: $20–30/hour, based on experience and language coverage Start:... ...ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent... ...failures, and containers. • Workflow — Everyday Git, diffs, pull requests, and issue tracking...Hourly payFull timeContract workImmediate startRemote work$200k - $250k
...Safer World. TRM Labs provides AI-powered intelligence solutions... ...-edge tools in the LLM and agent space — including open-source... ...background with deep experience in backend or systems work (Python... ...promise shows up in how we work everyday. TRM moves quickly. We are...Local areaRemote workWorldwide- ...agentic identity, delegated authorization, runtime attribution, and policy engines across client deployments. This senior role requires hands-on leadership, a proven track record with distributed systems, and strong cloud experience across AWS, #J-18808-Ljbffr vibehackers
- ...contributor to lead the design, development, and adoption of enterprise AI agent capabilities, AI harness platforms, RAG-based knowledge base... ..., similar technical field of study or equivalent practical experience.- Experience working with two or more of the following: web...Overseas
- ...We are seeking an Offensive Security Agent Engineer to build the systems that power autonomous... ...engineering, offensive security, and AI agents, building the harnesses, tools,... ..., and exploitation behavior Design experiments around prompts, models, tools, context strategies...
- ...organize expert human knowledge to advance the AI economy. Handshake AI works directly with... ...Staff to help define how frontier coding agents are benchmarked and improved. This is a... ...least one of the following: Previous experience working on a Coding benchmark....Full timeWork at officeFlexible hours
- Angi is seeking a Senior Data Scientist to help build the AI agent suite for Pros. The first product is an AI voice and SMS agent that... ...You’ll shape agent behavior, build evaluation systems, design experiments, and model lead-to-job conversion. Work with engineers,...
- ...happens and turns it into a living asset that helps people and AI agents do their best work. We're growing fast, since our founding in... ...Engineering Team , which powers some of the most essential experiences at Scribe: document viewing and editing, embedding and exporting...Full timeTemporary workWork at officeHome officeFlexible hours3 days per week
$186.07k - $218.9k
...surges. learn more about working at Coinbase. Agent Verification builds systems that help Coinbase safely ship software in an AI-native development environment. The team... ..., or other high-reliability control planes. Experience with Go, GitHub integrations, AWS, Kubernetes...Local area$150k - $250k
...by combining software, manufacturing, and AI in one stack. We're hiring an engineer to build, run and manage a team of AI agents to help us innovate faster, improve performance... ...help them perform. Requirements Experience building agents that run on their own and...Remote workRelocation package$160k - $300k
Front-end Engineer, Agents About Hebbia The user interface for universal knowledge capture... ...empowers users to collaborate with AI on each step and validate responses instead... ...understanding capabilities to co-piloting experiences for matrix and deep, multi-source research...Work at office- ...Source: web3.career Software Engineer, Agents United States - Remote Engineering - Software... ...the UK, EU, Canada, and Australia. AI is the default operating mode here. It’s... ...apply for this role if they do not have experience in 100% of these areas. Please know that...Full timeWork at officeRemote workHome officeFlexible hours
$243.87k - $286.9k
...working at Coinbase We're hiring a Group Product Manager to lead the Compliance Agent Experience product team within our EAA organization. This team builds the internal tooling and AI-powered investigation experiences used by Compliance Operations to execute Coinbase...Local area$186.07k - $218.9k
...rewrite of Coinbase's retail mobile app from React Native to native Swift and Kotlin, using AI-assisted code generation to deliver a dramatically faster, higher-quality experience for millions of customers. You'll bring deep iOS or Android expertise to build core app...Local areaImmediate startRemote work$193.4k - $290k
...services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep... ...Role Overview As a Software Engineer, Agents, you'll build the systems that make our... ...(post-BS/MS) of software engineering experience. We are hiring for this role across Mid...$154.45k - $205k
## Lead Software Engineer, AI Agents & OrchestrationApply: Carmel, IN: Remote Location United States: Full time: Posted Today: JR37633... ...Orchestration with strong software engineering skills and demonstrated experience building and operating production generative AI systems to...Full timeTemporary workRemote workFlexible hours$51.63k - $124.72k
...Border Patrol Agent (BPA) With more than 69,000 employees, U.S. Customs and Border Protection... ...your education OR prior general or experience in public safety, security, military... ...Basic Operation of a Motor Vehicle (e.g., everyday use of vehicles, parallel parking) Other...Full timeWork experience placementImmediate startNight shift$51.63k - $124.72k
...Border Patrol Agent (BPA) With more than 69,000 employees, U.S. Customs and Border Protection... ...your education OR prior general or experience in public safety, security, military... ...Basic Operation of a Motor Vehicle (e.g., everyday use of vehicles, parallel parking) Other...Full timeWork experience placementImmediate startNight shift$30k - $60k
...Position Overview State Farm Insurance Agent located in Louisville, KY is seeking an... ...and personal/sick days) Valuable experience Growth potential/Opportunity for advancement... ...in helping people manage the risks of everyday life, recover from the unexpected, and...Work at office$16 per hour
...Clint Conrad is an award-winning State Farm Agent looking to grow our excellent,... ...mission is to help people manage the risks of everyday life, recover from the unexpected and realize... ...Auditory • Self-Motivated • Experience in Marketing • Achievements in...Base plus commissionHourly payFor contractorsWork experience placementInternshipWork at officeLocal areaImmediate startMonday to Friday$15 per hour
...Intern - State Farm Agent Team Member Adam Worrell - State Farm Agent is seeking an... ...required to efficiently manage the customer experience Collect customer and prospective... ...mission is to help people manage the risks of everyday life, recover from the unexpected and...Hourly payFor contractorsInternshipFlexible hours- Sierra is hiring a Software Engineer, Agent - Travel & Hospitality in San Francisco. You will build production AI agents for booking, recommendations, maps, payments, voice, chat, and text experiences, connecting our platform to airlines, hotels, rental brands, and travel...Worldwide
$253.9k - $298.7k
...both iOS and Android on their teams using AI-driven agentic translation at... ...a novel, world-class mobile development experience. What you'll do Define the technical... ...reusable AI-automation paradigms such as agent swarms, automated dual-repo synchronization...Local areaRemote workShift work$143.2k - $243.4k
...they could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform... ...product taste and are obsessed with delivering exceptional experiences for end users. Entrepreneurial Grit: You lean into ambiguity,...Work at officeImmediate startRemote workFlexible hoursDay shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Everyday AI Agent Experience Tester. Be the first to apply!





