Everyday AI Agent Tester - Remote
YO AI Labs
Role Title: Everyday AI Agent Tester
Role Type: Contractor
Location: United States
We are seeking detail-oriented, U.S.-based professionals to test AI agents performing everyday tasks. You'll evaluate two AI agents side by side, document their performance, and provide feedback to improve user experience and reliability.
Key Responsibilities
- Test AI agents on everyday tasks, including bookings, shopping, travel, emails, bill payments, and forms.
- Approve or stop agents at key decision points.
- Screen-record each testing session.
- Evaluate task completion, quality, user control, satisfaction, and time.
- Provide clear written feedback on agent performance and usability.
Required Qualifications
- Based in the United States with a bachelor's degree.
- Regularly use AI tools in daily life.
- 2–3 years of experience, preferably in engineering, business management, or office operations.
- Strong attention to detail and ability to follow instructions.
- Excellent written communication and documentation skills.
- An active personal AI account (Free, Go, or Plus; not Pro) and a smartphone capable of screen recording.
Preferred: Domain expertise in relevant everyday workflows. No coding or AI development experience is required.
Selection Process
- Attend a brief interview (15–30 minutes).
- Complete profile review and onboarding.
Availability: Onboarding is scheduled before the project kickoff, with tasks expected to begin on Monday, October 12.
#J-18808-LjbffrVacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the Everyday AI Agent Tester - Remote in New York, NY vacancy
- ...Everyday AI Agent Tester is a remote review track for evaluating AI outputs across everyday ai agent tester specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next...Remote jobHourly payFor contractorsWork experience placement10 hours per week
$25 - $45 per hour
...step is done. If you do not see it check your spam folder. This is a fully remote position open to candidates based in United States. Pay: $25$45/hr Role Title: Everyday AI Agent Tester Role Type: Contractor Location: U.S based Opportunity Snapshot...Remote workFull timeFor contractorsWork at officeWeekend work- micro1 Operations Featured Jobs Special Referral AI Agent Tester - Real-World Tasks Remote - United States ChatGPT Muse AI agents Attention to Detail Following Instructions Screen Recording Special Referral gives your application an enhanced referral route, helping it...Remote workContract workWork at officeImmediate start
- ...Job Description Job Description Job Title: AI Agent Tester – Real-World Tasks Role Type: Contractor Location: United States... ...-based AI Agent Testers to evaluate how AI assistants handle everyday tasks. You will test two AI agents using your own accounts and...Remote jobFor contractorsFlexible hours
- ...partner company, an early-stage startup building an AI coworker: an agent that lives inside a team's everyday tools and actually gets work done. They need a Head... ...Later, you'll hire the team around it. The role is remote-friendly anywhere in the US, and hours that overlap...Remote workPrice workContract work
$40 - $120 per hour
...AI Chatbot Tester $40-120/hr Remote Freelance GENERAL About the Role What if your curiosity and critical eye could help shape the future of... ...in conversations spanning a wide range of topics — from everyday questions to complex or creative scenarios Evaluate...Remote workHourly payContract workFreelanceWorldwideFlexible hoursAlignerr
United States1 day ago- ...instincts could help shape the AI tools millions of people rely... ...We're looking for AI Chatbot Testers to engage directly with cutting... ...Type: Hourly Contract Location: Remote Commitment: 10-40 hours/week... ...a wide range of topics - from everyday questions to creative and complex...Remote workHourly payContract workFreelanceFlexible hours
Alignerr Corp.
New York, NY2 days ago - ...RemoteJobsOne is seeking an AI Agent Evaluator for fully remote work in the United States. You will run everyday errands with two AI agents, record results on your phone, and provide detailed feedback. The role requires a Bachelor's degree and 2–3 years of relevant...Remote work
RemoteJobsOne
Houston, TX7 hours ago $140k - $190k
...a Senior Software Engineer – Agent Team based in the United States... ...quality, and performance. This remote opportunity offers meaningful... ...support personal well-being and everyday needs. Remote work support:... ...Jobgether works: We use an AI-powered matching process to...Remote workFull timeTemporary workWork from homeWorldwideHome officeVisa sponsorshipFlexible hours$25 - $45 per hour
...This is a fully remote position , open to candidates based in United States. Pay: $25–$45/hr Role Title: AI Agent Evaluator Role Type: Contractor Location: U.S based... ...can screen record Your tasks: Run everyday errands with two AI agents, approve key...Remote workFor contractorsWork at officeWeekend workRemoteJobsOne
Houston, TX7 hours ago- ...YO AI Labs is seeking an Everyday AI Agent Tester based in the United States to evaluate AI agents performing common tasks. You will compare two agents side by side, document results, and provide actionable feedback to improve user experience and reliability. Responsibilities...
YO AI Labs
New York, NY7 hours ago $18 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Contract Compensation: $16-$18/hour Location: Remote Duration: 1-2 hours total Role Responsibilities Complete 10 test calls with the CX agent, following the prompts and scenarios provided...Remote jobContract workSummer workImmediate start- micro1 is seeking an AI Agent Tester to evaluate real-world tasks performed by AI agents. This contractor role is US-based and requires testing from your own phone and accounts, with screen recording and detailed feedback on agent performance. You will run scenarios such...For contractors
- Remotebridge is seeking an AI Agent Tester to evaluate real-world tasks from a user perspective. This contractor role operates fully from a smartphone, with timely onboarding and onboarding steps completed within 24-48 hours of selection. You'll run scenarios like bills...For contractors
$161.3k - $274.2k
...we areMoveworks: the Agentic AI Assistant platform that empowers... ...the Fortune 500, to automate everyday tasks and streamline business... ...DescriptionThe RoleMoveworks' AI agents don't just generate text —... ...trust. Work personas (flexible, remote, or required in office) are categories...Remote workContract workWork at officeFlexible hoursMoveworks
Mountain View, CA5 days ago- ...using digital innovation, data science, and AI to reimagine how life-changing therapies... ...group as a Digital Operations Associate Tester and help us deliver reliable, high-... ...require as-needed travel (0-20%). Location: Remote US. Relocation assistance is NOT provided....Remote workWork at officeRelocation package
$185k - $260k
...AI Product Manager, Agents & Orchestration This is a fully remote opportunity and can be worked from any location in the United States. About Us 1mind is building the next generation of revenue teams. We are creating a new category of enterprise software: Autonomous...Remote workFull time- ...IQ Media Agent bietet eine zu 100% remote arbeitende Nebenbeschäftigung mit flexibler Zeiteinteilung. Der monatliche Zusatzverdienst kann bis zu 5.5... ...Einsatz und Erfolg. Du arbeitest eigenverantwortlich mit AI-Tools, baust dein eigenes Online-Business auf und...Remote work
IQ Mediengruppe LLC
Sheridan, WY7 hours ago $50 per hour
...Earn Up To $50/hr as an OpenClaw Agent Builder Shape the future of autonomous agents like OpenClaw. Freelance, remote, up to $50 USD/hr. Weekly payments. Trusted by 10,0... ...completely free ~ Over $200/month in AI access, included at no extra cost. Overview...Remote workWeekly payExtra incomeContract workFreelanceInternshipWorldwideOutlier
Las Vegas, NV1 day ago- ...AI Agent Evaluation Specialist This project aims to test and evaluate one AI agent in the development stage. By asking questions and... ...content to the end users and make it safer. This role is fully remote, full-time with a duration of several months (depending on the...Remote workFull time
tsmg
United States2 days ago $25 - $45 per hour
...Required Skills ChatGPT Muse AI agents Attention to Detail Following Instructions... ...and velocity. Role Title: AI Agent Tester — Real-World Tasks Role Type:... ...reimbursed afterward Your tasks: Run everyday errands with two AI agents, approve key...Part timeFor contractorsWork at officeImmediate startmicro1
San Francisco, CA5 days ago$125.3k - $154.1k
...applications and next steps. Our partner is looking for a Senior AI Product Manager (Agent Platform) based in the United States. The Senior AI... ...physical, financial, and professional well-being. Remote work: A full-time remote position based in the United States...Remote workFull timeFlexible hours- ...using digital innovation, data science, and AI to reimagine how life-changing therapies... ...group as a Digital Operations Associate Tester and help us deliver reliable, high-... ...require as-needed travel (0-20%). Location: Remote US. Band 5. Relocation assistance is NOT...Remote workWork experience placementWork at officeRelocation package
$20 - $30 per hour
...Type: Contract, hourly Location: Remote Hours: 20–30 per week Pay: $20–30/hour... ...ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent... ..., and containers. • Workflow — Everyday Git, diffs, pull requests, and issue tracking...Remote workHourly payFull timeContract workImmediate startBespoke Labs
Kennesaw, GA3 days ago- ...company is looking for a detail-oriented individual to design structured evaluation scenarios for AI agents. This entry-level part-time role allows you to contribute remotely, creating test cases for LLM-based agents. The ideal candidate will have a background in...Remote workPart time
Mind Rift
Brooklyn, NY5 days ago $165k - $200k
...Job Description Senior Technical Product Manager - AI Agents, Evals & Reliability, Artificial Intelligence (AI) Required, Work From Home... ...are required for this position. This position is 100% Remote. MUST BE WILLING TO TAKE A 60 MINUTE CODING ASSESSMENT. Senior...Remote workFull timeWork from home- ...AI Chatbot Tester MCI is one of the fastest-growing tech-enabled business services companies in the USA, with a strong call center footprint... .... Our contact centers are powered by both on-site and remote agents, leveraging advanced technologies to enhance customer...Remote workTemporary workWork at officeLocal area
AI Support Positions
United States2 days ago - AI Agent Power User AI Agent Power User Role Type: Contractor Location: Remote (US, CA, UK, IE, AU, NZ) Scope of Work: Run complex, multi-step business scenarios using AI assistants such as ChatGPT and Claude, reflecting genuine professional workflows. Document each step...Remote workContract workFor contractors
- Chainguard is seeking a Senior Product Manager for AI CI/CD to lead product direction for developer-focused tooling in a security-conscious... ...with cross-functional partners. This role centers on building agent-centric CI/CD experiences, coordinating with engineering, UX, and...Remote job
- GenScript Biotech Corporation is seeking an AI Intern to develop and optimize enterprise AI Agents. You will design, test, and deploy agent solutions, integrating them with ERP, CRM, and supply chain systems to automate cross-system workflows. The role requires a Master...Remote jobInternship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Everyday AI Agent Tester - Remote. Be the first to apply!
Related searches
- tsa agent New York, NY
- operations agent New York, NY
- freight agent no experience New York, NY
- right of way agent New York, NY
- commissioning agent New York, NY
- cruise agent New York, NY
- agent assistant New York, NY
- remote chat agent New York, NY
- work from home chat agent New York, NY
- executive protection agent New York, NY