Mobile AI Agent Evaluator (US-Based Contractor)
$25 - $45 per hourmicro1 Inc.
micro1 Inc. is seeking an AI Agent Evaluator contractor based in the United States. You will run real-life scenarios using two AI agents, screen record, and score results, providing detailed written feedback to help improve next‑gen AI agents. Onboarding is available today through Sunday, with start on Monday, October 10. You will work from your phone, require an active AI account and smartphone, and earn $25–$45 per hour for about 1.5 hours per run. #J-18808-Ljbffr micro1 Inc.
$25 - $45 per hour
Role Title: AI Agent Evaluator Role Type: Contractor Location: U.S based Opportunity Snapshot Pay: $25-45/hour Time per task: ~1.5 hours per run (evidence and scoring... ..., using your own accounts on your phone, and tell us what worked, what didn't, and how it felt. What you...For contractorsWork at officeWeekend work- HELP SHAPE THE FUTURE OF AI BY EVALUATING HOW WELL AI ASSISTANTS UNDERSTAND USERS, USE PERSONAL... .... Location: Remote Type: Independent contractor / Part-time Project duration: up to 3... ...all verification questions accurately based on your actual, current usage. Provide...For contractorsPart timeRemote work
$21 - $35 per hour
...United States, Remote Posted 2 days ago Role Title:AI Image Specialist (US Based) Role Type:Contractor Location:United States, Remote the team is looking... ..., high-quality images for AI model development and evaluation. Graphic Design AI Evaluation Photo Editing Retouching...For contractorsRemote work- ...Role Title: AI Agent Evaluator Role Type: Contractor Location: United States We are seeking detail-oriented professionals to evaluate AI agents... ...and usability. Required Qualifications ~ Based in the United States with a bachelors degree. ~ Regularly...For contractorsFull timeWork at officeRemote work
$60 per hour
A leading project-based AI consultancy is seeking legal consultants to evaluate AI systems and improve their reasoning. This non-permanent role requires a law degree and at least 2 years of experience in US law. Candidates must have strong written English skills and a...SuggestedPermanent employmentPart timeFreelanceFlexible hours- ...countries) Type: Independent contractor Remote Contract... ...Explosives Engineering AI Safety Hazmat Safety What... ...client project, not by us, and we do not know them... ...the Role AI Safety Evaluation Project | Remote | Contract... ...of a specific degree Based in the US, Canada, the...For contractorsHourly payContract workRemote work
- Mindrift (Toloka) is seeking US-licensed physicians to evaluate clinical EHR vignettes for a medical AI evaluation project. You will review written cases, score... ...write concise rationales. This is a task-based, independent contractor role with fully self-scheduled...For contractorsRemote jobFlexible hours
- AuraOne, Inc. is seeking a Learning Progression AI Evaluator to remotely review outputs within our specialist operations workflows... ...and stakeholder fit using a structured rubric. Flexible US-based remote contractor role with at least 10 hours per week. You will help flag...For contractorsRemote job10 hours per weekFlexible hours
- YO AI Labs in the United States is seeking a native English-speaking contractor to contribute to language data and AI training projects. You will evaluate audio content for nativeness, fluency, and pronunciation, and provide structured written feedback to improve AI models...For contractorsRemote job
- Misinformation Context AI Evaluator is a remote evaluation track for reviewing... ...Model output evaluation Rubric-based annotation Severity tagging Inter... ...Context Work model Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants...For contractorsHourly payRemote work10 hours per week
- ...Content/Marketing Strategist & Short Video Editor (Remote, US-based) Get AI-powered advice on this job and more exclusive features. We’re looking for someone who knows how to make content pop. You’ve created or helped create viral short‑form videos before — you...Full timePart timeFreelanceRemote workFlexible hours
- Role Title: Gmail & Google Calendar AI Assistant Evaluator Role Type: Contractor, Remote Location: United States only our partner is engaging Gmail &... ...standards. Required Skills and Qualifications: Are based in the US, have an iPhone with iMessage, and have a Facebook...For contractorsContract workRemote work
- ...ptBR US-based Medical Translators needed Remote freelance contractor position for English into ptBR translators. Join LILT AI's Translator Community to translate life sciences, medical, and clinical trials content. What We Are Looking For We are interested in translators...For contractorsFreelanceRemote work
- CNTXT, Inc. is seeking a fully remote hourly contractor to support AI data and language projects. You will work on prompts, voice samples, data annotation, LLM evaluation, and localization QA for American English content. The ideal candidate is a native American English...For contractorsRemote jobHourly pay
- ..., Inc. is seeking a Digital Designer (AI Output Evaluation) contractor to remotely review AI-generated design... ...The role emphasizes consistent rubric-based judgments, clear written explanations,... ...for at least 10 hours per week from a US-based location. #J-18808-Ljbffr AuraOne...For contractorsRemote job10 hours per week
- AuraOne, Inc. is seeking an AI Product Evaluator for a remote contractor role. You will review prompts and model outputs, apply a versioned rubric, and provide structured feedback to retrain the model. The work involves tagging issues, labeling edge cases, and maintaining...For contractorsRemote job10 hours per week
- Create and evaluate datasets to enhance large language... ...model performance. About Us Based in San Francisco,... ...accelerator for frontier AI labs and a trusted partner... ...multilinguality, multimodality, and agents; and second, by... ...to 40 hrs/week Type: Contractor (no medical/paid leave)...For contractorsFlexible hours
- Remotebridge is seeking an AI Agent Tester to evaluate real-world tasks from a user perspective. This contractor role operates fully from a smartphone, with timely onboarding... ...to improve AI agents. Candidates should be US-based, hold a Bachelor’s degree, and have 2-3...For contractors
$21 - $35 per hour
Contribute original images, compare them with AI-generated images, and explain visual differences for image model evaluation. This remote, part-time contractor role pays $21 to $35 per hour in the US. Remote Hourly · $21-$35/hr $21-$35/hr Compensation Contract, part...For contractorsHourly payContract workPart timeRemote work- micro1 is seeking an AI Agent Tester to evaluate real-world tasks performed by AI agents. This contractor role is US-based and requires testing from your own phone and accounts, with screen recording and detailed feedback on agent performance. You will run scenarios such...For contractors
$8 - $65 per hour
Video Production Specialist (US) - Freelance AI Trainer Project United... ...our prompt engineering and evaluation metrics. A bachelor’s or master... ...into the creative knowledge base for tomorrow’s AI? Apply today... ...pay range listed above. As a contractor you’ll supply a secure...For contractorsHourly payContract workFreelanceImmediate startRemote work$25 - $45 per hour
Role Title: AI Agent Tester — Real-World Tasks Role Type: Contractor Location: U.S based Opportunity Snapshot Pay: $25-45/hour Time per task: ~1.5 hours per run (evidence... ...on the agent experience Who we’re looking for US-based, with a Bachelor’s degree Someone who already...For contractorsWork at officeImmediate start- Remotebridge is seeking a Food Delivery AI Response Evaluator for a remote, contract-based role. You will review AI-generated interactions in food delivery, assess quality, relevance, and accuracy, and provide actionable feedback to improve model performance. Ideal candidates...For contractorsRemote jobContract work
$30 - $50 per hour
Careful English-language evaluators rate and improve AI responses across everyday topics. Open to residents of the US and Canada. What you will do Rate AI answers for accuracy... ...Contract Remote, hourly contract (independent contractor) Part-time, flexible: 10-40 hrs/week...For contractorsHourly payWeekly payContract workPart timeRemote workFlexible hours- Anyone AI is seeking multilingual coding experts to evaluate AI-generated responses. This part-time remote contract lasts... ...and provide clear feedback based on project guidelines. What we're... ...models. This is a part-time, remote contractor opportunity focused on improving...For contractorsRemote jobContract workPart time
- ...seeking a remote CRM data reviewer to evaluate CRM agent evaluation outputs against a quality rubric... ...document recurring failure modes. This contractor role requires strong written reasoning,... ...availability. The work is remote, US-eligible, and paid hourly after the interview...For contractorsRemote jobHourly pay
- Create challenging prompts and evaluate large language model responses... ...execution to assess how well AI handles management-related topics... ...clear, detailed, evidence-based feedback to support measurable... ...and takes This is a part-time contractor role with a commitment of 20 or...For contractorsContract workPart timeRemote workWorldwide
$30 per hour
Business Analyst, Educational Rater and Evaluator Review and improve AI-generated educational responses through research, fact checking, and clear written explanations. This remote US contractor project pays $30 per hour, requires 20 hours weekly, and allows up to 40 hours...For contractorsHourly payContract workPart timeRemote work- ...Milestone Localization (UK) Ltd., seeks specialists to evaluate AI-generated answers on FDA submission pathways,... ...regulations and guidance documents, ensuring accuracy for US regulatory inquiries. As an independent contractor, you are paid only for accepted work and must work...For contractors
- AuraOne, Inc. seeks a remote Historical Reasoning AI Evaluator to review prompts and responses, applying AuraOne's quality... ...through precise rationale. The role supports a contractor arrangement with remote, US-eligible work and requires strong writing skills to name...For contractorsRemote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Mobile AI Agent Evaluator (US-Based Contractor). Be the first to apply!

