Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Mobile AI Agent Evaluator (US-Based Contractor)

$25 - $45 per hour

micro1 Inc.

micro1 Inc. is seeking an AI Agent Evaluator contractor based in the United States. You will run real-life scenarios using two AI agents, screen record, and score results, providing detailed written feedback to help improve next‑gen AI agents. Onboarding is available today through Sunday, with start on Monday, October 10. You will work from your phone, require an active AI account and smartphone, and earn $25–$45 per hour for about 1.5 hours per run. #J-18808-Ljbffr micro1 Inc.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Mobile AI Agent Evaluator (US-Based Contractor) in New York, NY vacancy
  • $25 - $45 per hour

    Role Title: AI Agent Evaluator Role Type: Contractor Location: U.S based Opportunity Snapshot Pay: $25-45/hour Time per task: ~1.5 hours per run (evidence and scoring...  ..., using your own accounts on your phone, and tell us what worked, what didn't, and how it felt. What you... 
    For contractors
    Work at office
    Weekend work

    micro1 Inc.

    New York, NY
    1 day ago
  • HELP SHAPE THE FUTURE OF AI BY EVALUATING HOW WELL AI ASSISTANTS UNDERSTAND USERS, USE PERSONAL...  .... Location: Remote Type: Independent contractor / Part-time Project duration: up to 3...  ...all verification questions accurately based on your actual, current usage. Provide... 
    For contractors
    Part time
    Remote work

    OpenKrill

    New York, NY
    6 days ago
  • $21 - $35 per hour

     ...United States, Remote Posted 2 days ago Role Title:AI Image Specialist (US Based) Role Type:Contractor Location:United States, Remote the team is looking...  ..., high-quality images for AI model development and evaluation. Graphic Design AI Evaluation Photo Editing Retouching... 
    For contractors
    Remote work

    Softechub

    New York, NY
    4 days ago
  •  ...Role Title: AI Agent Evaluator Role Type: Contractor Location: United States We are seeking detail-oriented professionals to evaluate AI agents...  ...and usability. Required Qualifications ~ Based in the United States with a bachelors degree. ~ Regularly... 
    For contractors
    Full time
    Work at office
    Remote work

    YO AI Labs

    New York, NY
    28 days ago
  • $60 per hour

    A leading project-based AI consultancy is seeking legal consultants to evaluate AI systems and improve their reasoning. This non-permanent role requires a law degree and at least 2 years of experience in US law. Candidates must have strong written English skills and a... 
    Suggested
    Permanent employment
    Part time
    Freelance
    Flexible hours

    Mindrift

    New York, NY
    6 days ago
  •  ...countries) Type: Independent contractor Remote Contract...  ...Explosives Engineering AI Safety Hazmat Safety What...  ...client project, not by us, and we do not know them...  ...the Role AI Safety Evaluation Project | Remote | Contract...  ...of a specific degree Based in the US, Canada, the... 
    For contractors
    Hourly pay
    Contract work
    Remote work

    Pasiflora AI LLC

    New York, NY
    6 days ago
  • Mindrift (Toloka) is seeking US-licensed physicians to evaluate clinical EHR vignettes for a medical AI evaluation project. You will review written cases, score...  ...write concise rationales. This is a task-based, independent contractor role with fully self-scheduled... 
    For contractors
    Remote job
    Flexible hours

    Mindrift (Toloka)

    New York, NY
    3 days ago
  • AuraOne, Inc. is seeking a Learning Progression AI Evaluator to remotely review outputs within our specialist operations workflows...  ...and stakeholder fit using a structured rubric. Flexible US-based remote contractor role with at least 10 hours per week. You will help flag... 
    For contractors
    Remote job
    10 hours per week
    Flexible hours

    AuraOne, Inc.

    New York, NY
    3 days ago
  • YO AI Labs in the United States is seeking a native English-speaking contractor to contribute to language data and AI training projects. You will evaluate audio content for nativeness, fluency, and pronunciation, and provide structured written feedback to improve AI models... 
    For contractors
    Remote job

    YO AI Labs

    New York, NY
    4 days ago
  • Misinformation Context AI Evaluator is a remote evaluation track for reviewing...  ...Model output evaluation Rubric-based annotation Severity tagging Inter...  ...Context Work model Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants... 
    For contractors
    Hourly pay
    Remote work
    10 hours per week

    AuraOne, Inc.

    New York, NY
    2 days ago
  •  ...Content/Marketing Strategist & Short Video Editor (Remote, US-based) Get AI-powered advice on this job and more exclusive features. We’re looking for someone who knows how to make content pop. You’ve created or helped create viral short‑form videos before — you... 
    Full time
    Part time
    Freelance
    Remote work
    Flexible hours

    Edensign

    New York, NY
    3 days ago
  • Role Title: Gmail & Google Calendar AI Assistant Evaluator Role Type: Contractor, Remote Location: United States only our partner is engaging Gmail &...  ...standards. Required Skills and Qualifications: Are based in the US, have an iPhone with iMessage, and have a Facebook... 
    For contractors
    Contract work
    Remote work

    confidential

    New York, NY
    5 days ago
  •  ...ptBR US-based Medical Translators needed Remote freelance contractor position for English into ptBR translators. Join LILT AI's Translator Community to translate life sciences, medical, and clinical trials content. What We Are Looking For We are interested in translators... 
    For contractors
    Freelance
    Remote work

    LILT AI

    New York, NY
    3 days ago
  • CNTXT, Inc. is seeking a fully remote hourly contractor to support AI data and language projects. You will work on prompts, voice samples, data annotation, LLM evaluation, and localization QA for American English content. The ideal candidate is a native American English... 
    For contractors
    Remote job
    Hourly pay

    CNTXT, Inc.

    New York, NY
    4 days ago
  •  ..., Inc. is seeking a Digital Designer (AI Output Evaluation) contractor to remotely review AI-generated design...  ...The role emphasizes consistent rubric-based judgments, clear written explanations,...  ...for at least 10 hours per week from a US-based location. #J-18808-Ljbffr AuraOne... 
    For contractors
    Remote job
    10 hours per week

    AuraOne Human Data

    New York, NY
    4 days ago
  • AuraOne, Inc. is seeking an AI Product Evaluator for a remote contractor role. You will review prompts and model outputs, apply a versioned rubric, and provide structured feedback to retrain the model. The work involves tagging issues, labeling edge cases, and maintaining... 
    For contractors
    Remote job
    10 hours per week

    AuraOne Human Data

    New York, NY
    5 days ago
  • Create and evaluate datasets to enhance large language...  ...model performance. About Us Based in San Francisco,...  ...accelerator for frontier AI labs and a trusted partner...  ...multilinguality, multimodality, and agents; and second, by...  ...to 40 hrs/week Type: Contractor (no medical/paid leave)... 
    For contractors
    Flexible hours

    Turing

    New York, NY
    3 days ago
  • Remotebridge is seeking an AI Agent Tester to evaluate real-world tasks from a user perspective. This contractor role operates fully from a smartphone, with timely onboarding...  ...to improve AI agents. Candidates should be US-based, hold a Bachelor’s degree, and have 2-3... 
    For contractors

    Remotebridge

    New York, NY
    6 days ago
  • $21 - $35 per hour

    Contribute original images, compare them with AI-generated images, and explain visual differences for image model evaluation. This remote, part-time contractor role pays $21 to $35 per hour in the US. Remote Hourly · $21-$35/hr $21-$35/hr Compensation Contract, part... 
    For contractors
    Hourly pay
    Contract work
    Part time
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    4 days ago
  • micro1 is seeking an AI Agent Tester to evaluate real-world tasks performed by AI agents. This contractor role is US-based and requires testing from your own phone and accounts, with screen recording and detailed feedback on agent performance. You will run scenarios such... 
    For contractors

    Micro1

    New York, NY
    5 days ago
  • $8 - $65 per hour

    Video Production Specialist (US) - Freelance AI Trainer Project United...  ...our prompt engineering and evaluation metrics. A bachelor’s or master...  ...into the creative knowledge base for tomorrow’s AI? Apply today...  ...pay range listed above. As a contractor you’ll supply a secure... 
    For contractors
    Hourly pay
    Contract work
    Freelance
    Immediate start
    Remote work

    Meridial

    New York, NY
    6 days ago
  • $25 - $45 per hour

    Role Title: AI Agent Tester — Real-World Tasks Role Type: Contractor Location: U.S based Opportunity Snapshot Pay: $25-45/hour Time per task: ~1.5 hours per run (evidence...  ...on the agent experience Who we’re looking for US-based, with a Bachelor’s degree Someone who already... 
    For contractors
    Work at office
    Immediate start

    Remotebridge

    New York, NY
    6 days ago
  • Remotebridge is seeking a Food Delivery AI Response Evaluator for a remote, contract-based role. You will review AI-generated interactions in food delivery, assess quality, relevance, and accuracy, and provide actionable feedback to improve model performance. Ideal candidates... 
    For contractors
    Remote job
    Contract work

    Remotebridge

    New York, NY
    4 days ago
  • $30 - $50 per hour

    Careful English-language evaluators rate and improve AI responses across everyday topics. Open to residents of the US and Canada. What you will do Rate AI answers for accuracy...  ...Contract Remote, hourly contract (independent contractor) Part-time, flexible: 10-40 hrs/week... 
    For contractors
    Hourly pay
    Weekly pay
    Contract work
    Part time
    Remote work
    Flexible hours

    Vettedlance

    New York, NY
    3 days ago
  • Anyone AI is seeking multilingual coding experts to evaluate AI-generated responses. This part-time remote contract lasts...  ...and provide clear feedback based on project guidelines. What we're...  ...models. This is a part-time, remote contractor opportunity focused on improving... 
    For contractors
    Remote job
    Contract work
    Part time

    Anyone AI Inc.

    New York, NY
    1 day ago
  •  ...seeking a remote CRM data reviewer to evaluate CRM agent evaluation outputs against a quality rubric...  ...document recurring failure modes. This contractor role requires strong written reasoning,...  ...availability. The work is remote, US-eligible, and paid hourly after the interview... 
    For contractors
    Remote job
    Hourly pay

    AuraOne Human Data

    New York, NY
    3 days ago
  • Create challenging prompts and evaluate large language model responses...  ...execution to assess how well AI handles management-related topics...  ...clear, detailed, evidence-based feedback to support measurable...  ...and takes This is a part-time contractor role with a commitment of 20 or... 
    For contractors
    Contract work
    Part time
    Remote work
    Worldwide

    OpenTrain AI, Inc.

    New York, NY
    6 days ago
  • $30 per hour

    Business Analyst, Educational Rater and Evaluator Review and improve AI-generated educational responses through research, fact checking, and clear written explanations. This remote US contractor project pays $30 per hour, requires 20 hours weekly, and allows up to 40 hours... 
    For contractors
    Hourly pay
    Contract work
    Part time
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    1 day ago
  •  ...Milestone Localization (UK) Ltd., seeks specialists to evaluate AI-generated answers on FDA submission pathways,...  ...regulations and guidance documents, ensuring accuracy for US regulatory inquiries. As an independent contractor, you are paid only for accepted work and must work... 
    For contractors

    Grayder

    New York, NY
    3 days ago
  • AuraOne, Inc. seeks a remote Historical Reasoning AI Evaluator to review prompts and responses, applying AuraOne's quality...  ...through precise rationale. The role supports a contractor arrangement with remote, US-eligible work and requires strong writing skills to name... 
    For contractors
    Remote job

    AuraOne, Inc.

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Mobile AI Agent Evaluator (US-Based Contractor). Be the first to apply!