Everyday AI Agent Tester - Remote
YO AI Labs
Role Title: Everyday AI Agent Tester Role Type: Contractor Location: United States We are seeking detail-oriented, U.S.-based professionals to test AI agents performing everyday tasks. You'll evaluate two AI agents side by side, document their performance, and provide feedback to improve user experience and reliability. Key Responsibilities Test AI agents on everyday tasks, including bookings, shopping, travel, emails, bill payments, and forms. Approve or stop agents at key decision points. Screen-record each testing session. Evaluate task completion, quality, user control, satisfaction, and time. Provide clear written feedback on agent performance and usability. Required Qualifications Based in the United States with a bachelor's degree. Regularly use AI tools in daily life. 2–3 years of experience, preferably in engineering, business management, or office operations. Strong attention to detail and ability to follow instructions. Excellent written communication and documentation skills. An active personal AI account (Free, Go, or Plus; not Pro) and a smartphone capable of screen recording. Preferred: Domain expertise in relevant everyday workflows. No coding or AI development experience is required. Selection Process Attend a brief interview (15–30 minutes). Complete profile review and onboarding. Availability: Onboarding is scheduled before the project kickoff, with tasks expected to begin on Monday, October 12. #J-18808-Ljbffr
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Everyday AI Agent Tester - Remote in New York, NY vacancy
- ...Himalayas is seeking an Everyday AI Agent Tester on a contract basis in the United States. You will evaluate two AI agents by running everyday... ...experience, and strong written communication. The role is remote-friendly and phone-based, with flexible scheduling. #J-1880...Remote workContract workFlexible hours
Xperteez Technology Pvt Ltd
New York, NY4 days ago - ...Role Title: Everyday AI Agent Tester Role Type: Contract Location: U.S based About the role AI agents are starting to handle real-life errands: paying bills, booking trips, doing the groceries. We want to know how well they actually do it, from the point of view of a...Remote workContract workWork at officeWeekend work
Xperteez Technology Pvt Ltd
New York, NY4 days ago $45 per hour
# Everyday AI Agent Tester$45per hourContractor Remote Last verified 21 Jul 2026Listed on micro1 micro1.aiApplyAffiliate disclosureWork Expert (WE) is an independent publishing and referral website. We are not a recruiter, hiring manager, agent or employer, and we are...Remote work- ...Everyday AI Agent Tester is a remote review track for evaluating AI outputs across everyday ai agent tester specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next...Remote jobHourly payFor contractorsWork experience placement10 hours per week
$25 - $45 per hour
...step is done. If you do not see it check your spam folder. This is a fully remote position open to candidates based in United States. Pay: $25$45/hr Role Title: Everyday AI Agent Tester Role Type: Contractor Location: U.S based Opportunity Snapshot...Remote workFull timeFor contractorsWork at officeWeekend work$25 - $45 per hour
pay Required Skills ChatGPT Muse AI agents Attention to Detail Following Instructions Screen Recording About micro1 micro... ...system ensures both quality and velocity. Role Title: Everyday AI Agent Tester Role Type: Contractor Location: U.S based Opportunity Snapshot...For contractorsWork at officeWeekend work- ...OpenTrain AI, Inc. is seeking a detail‑oriented contractor to run live tests with two AI agents on a smartphone. You will supervise workflows, approve or stop actions at key... ...Each session lasts about 1.5 hours, with remote, part‑time scheduling. Candidates should have...Remote workPart timeFor contractors
OpenTrain AI, Inc.
Brooklyn, NY3 days ago - micro1 is a data lab that helps AI labs and enterprises train foundational models and agents. We’re hiring an Everyday AI Agent Tester to run real-life scenarios, record outcomes, and provide actionable feedback from a user perspective. You’ll compare two AI agents, document...
$15 per hour
...Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts work... ...what looked or sounded wrong, all remotely and on your own schedule. At Outlier,... ...communication and comfortable with natural, everyday conversational speech Strong attention...Remote workHourly payContract workFor contractorsWork experience placementFreelanceInternshipNight shiftScale AI
New York, NY2 days ago- ...partner company, an early-stage startup building an AI coworker: an agent that lives inside a team's everyday tools and actually gets work done. They need a... ...time once it's clearly working for both sides. It is remote-friendly anywhere in the US, and hours that overlap...Remote workFull timeContract work
- ...partner company, an early-stage startup building an AI coworker: an agent that lives inside a team's everyday tools and actually gets work done. They need a Head... ...Later, you'll hire the team around it. The role is remote-friendly anywhere in the US, and hours that overlap...Remote workPrice workContract work
- ...HELP SHAPE THE FUTURE OF AI BY EVALUATING HOW WELL AI ASSISTANTS UNDERSTAND USERS, USE... ...DELIVER HELPFUL CONVERSATIONS. Location: Remote Type: Independent contractor / Part-time... ...HAVE Experience using AI assistants for everyday questions, planning, or research. Previous...Remote workPart timeFor contractors
OpenKrill
New York, NY20 hours ago - ...instincts could help shape the AI tools millions of people rely... ...We're looking for AI Chatbot Testers to engage directly with cutting... ...Type: Hourly Contract Location: Remote Commitment: 10-40 hours/week... ...a wide range of topics - from everyday questions to creative and...Remote workHourly payContract workFreelanceFlexible hours
$140k - $190k
...a Senior Software Engineer – Agent Team based in the United States... ...quality, and performance. This remote opportunity offers meaningful... ...support personal well-being and everyday needs. Remote work support:... ...Jobgether works: We use an AI-powered matching process to...Remote workFull timeTemporary workWork from homeWorldwideHome officeVisa sponsorshipFlexible hours- ...coordinate with an integration engineer to configure the product for everyday needs and ensure clean handoffs when engineering is needed.... ...onboard new customers, test flows end-to-end, and fix issues within US business hours from a fully remote location. #J-18808-LjbffrRemote work
Logoslabs
United States3 days ago - ...Remolity, Inc. is seeking a US-based tester to evaluate two AI agents by performing real-life scenarios on your phone. You’ll use your own accounts and report on what worked, what didn’t, and how it felt. Responsibilities include running bills, travel bookings, shopping...Flexible hours
Remolity, Inc.
New York, NY4 days ago $18 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Contract Compensation: $16-$18/hour Location: Remote Duration: 1-2 hours total Role Responsibilities Complete 10 test calls with the CX agent, following the prompts and scenarios provided...Remote jobContract workSummer workImmediate start- ...AI Trainer Jobs is seeking a remote contractor to perform adversarial evaluation of AI models, crafting prompts and documenting failures with reproduction steps and policy violations. You will score defenses and triage new attack vectors, contributing rigorous patches...Remote workHourly payFor contractors
AuraOne
New York, NY4 days ago $25 - $45 per hour
Role Title: AI Agent Tester — Real-World Tasks Role Type: Contractor Location: U.S based Opportunity Snapshot Pay: $25-45/hour Time per task: ~1.5 hours per run (evidence and scoring included) Project kickoff: Already active. Onboarding: Within 24-48 hours of being selected...For contractorsWork at officeImmediate start- Remotebridge is seeking an AI Agent Tester to evaluate real-world tasks from a user perspective. This contractor role operates fully from a smartphone, with timely onboarding and onboarding steps completed within 24-48 hours of selection. You'll run scenarios like bills...For contractors
- ...United States Digital Space LLC is seeking a remote, full-time tester for an AI agent evaluation project. You will interact with the agent by requesting prompts and monitoring responses in a controlled training environment. The role requires fluent German, strong English...Remote workFull timeContract work
United States Digital Space LLC
New York, NY1 day ago $161.3k - $274.2k
...we areMoveworks: the Agentic AI Assistant platform that empowers... ...the Fortune 500, to automate everyday tasks and streamline business... ...DescriptionThe RoleMoveworks' AI agents don't just generate text —... ...trust. Work personas (flexible, remote, or required in office) are categories...Remote workContract workWork at officeFlexible hoursMoveworks
Mountain View, CA6 days ago- ...Alignerr is seeking AI chatbot testers to engage with cutting-edge AI systems, providing human feedback to improve safety, usefulness, and accuracy. This remote, hourly-contract role offers flexible scheduling and independent work, with opportunities to influence AI behavior...Remote workHourly payContract workFlexible hours
Alignerr Corp.
United States2 days ago - ...Alignerr Corp. is seeking AI Chatbot Testers to interact with cutting-edge AI systems, test across a wide range of topics, and provide human... ...feedback to improve safety, usefulness, and reliability. This remote hourly contract offers the freedom to work on your own...Remote workHourly payContract workFlexible hours
Alignerr Corp.
New York, NY9 hours ago - ...Delan Associates, Inc. is seeking an AI Agentic Tester in Denver, MO (Remote) to validate AI agent workflows and end-to-end AI applications. The role emphasizes testing of LLM responses, tool calls, and RAG pipelines, with an emphasis on accuracy and hallucination metrics...Remote work
Delan Associates Inc
Denver, MO4 days ago - ...Lionbridge AI is seeking Irish speakers for a remote, part-time AI testing project. You will help test and improve an AI tool by following simple instructions and reporting results with clear feedback. Ideal candidates are proficient in Irish and English, comfortable...Remote workPart timeFlexible hours3 days per week1 day per week
Lionbridge AI
United States20 hours ago - ...AI Tester AI & Generative AI Quality Engineering Denver, CO (Zip Code-80221)- REMOTE Contract Role We are seeking a detail oriented AI Tester to ensure the quality, reliability, safety, and correctness of AIenabled applications, including systems that use machine...Remote workContract work
Volto Consulting
United States3 days ago - ...AI Agent Builder Right hand to the CEO | ClearDesk + incubated companies | Full-time ClearDesk is a California-based global staffing... ..., reporting, inbox and calendar triage, sales follow-up, QA on remote team members’ output Stand up the AI stack for each new...Remote workFull timeWork at office
ClearDesk
San Diego, CA2 days ago - ...Legion Technologies provides an AI-driven workforce management platform that maximizes... ...and engagement for hourly workers. It is a remote, mission-driven company with a collaborative... ...culture. The role involves owning agent scope, prototyping prompts, diagnosing failures...Remote workHourly payFlexible hours
Legion Technologies
United States2 days ago - ...Chainguard is seeking a Senior Product Manager for AI CI/CD to lead product direction for developer-focused tooling in a security-conscious... ...with cross-functional partners. This role centers on building agent-centric CI/CD experiences, coordinating with engineering, UX, and...Remote work
Chainguard
United States4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Everyday AI Agent Tester - Remote. Be the first to apply!
Related searches
- work from home chat agent New York, NY
- gate agent New York, NY
- telemarketer - state farm agent team member New York, NY
- executive protection agent New York, NY
- agent assistant New York, NY
- commissioning agent New York, NY
- registered agent New York, NY
- transfer agent New York, NY
- sourcing agent New York, NY
- state farm agent work from home New York, NY