Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Data Annotation & Evaluation Specialist

$30 - $50 per hour

Rex.zone

New York, NY
  • Remote job

A technology firm specializing in data annotation is seeking a remote AI Data Annotation Specialist. The role involves executing high-quality data labeling and annotation for NLP and computer vision datasets. Ideal candidates will have mid-senior experience, strong written English skills, and familiarity with LLM evaluation concepts. Compensation ranges from $30 to $50 per hour, depending on complexity, and the work environment requires strong QA practices and asynchronous communication. #J-18808-Ljbffr Rex.zone

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote AI Data Annotation & Evaluation Specialist in New York, NY vacancy
  • $60 per hour

    Prolific is seeking Computer Science Specialists to join our Expert Network to train and evaluate AI models. You’ll complete a quick 10- to 15-minute test and, if...  ...depending on skills and experience. This role offers remote work and the opportunity to contribute to high‑... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    New York, NY
    10 hours ago
  • $110k - $138k

     ...scale intelligent AI, digital, cybersecurity...  ...Computer Vision Specialist is a member of WWT...  ..., part of AI & Data Solutions, focused...  ...dataset curation, annotation, and synthetic data...  ...models will be evaluated, optimized for edge...  ...Opportunity Employer. LI-DP2 LI-Remote... 
    Remote work
    Full time
    Work experience placement
    Flexible hours
    Shift work

    World Wide Technology

    Detroit, MI
    4 days ago
  • $20 - $60 per hour

    AI Question and Answer Evaluation Specialist Create research-backed questions and answers, test AI model responses, and improve evaluation content remotely for $20 to $60 per hour equivalent, paid per task. $20-$60/hr equivalent, paid per accepted task Compensation... 
    Remote work
    Hourly pay
    Contract work
    Part time
    For contractors

    OpenTrain AI, Inc.

    New York, NY
    1 day ago
  • $21 - $35 per hour

    Crossing Hurdles is seeking an Image Evaluation Expert (Visual Arts / Photography) on a remote contract basis. You will upload photos, compare AI-generated images with real photographs, and assess lighting, perspective, and textures to ensure visual accuracy. You will... 
    Remote job
    Hourly pay
    Contract work

    Crossing Hurdles

    New York, NY
    10 hours ago
  • Crossing Hurdles is seeking an Image Evaluation Expert for a remote contract role in the United States. You will upload photographs, compare real images with AI outputs, and assess lighting, perspective, and textures to ensure accuracy. You will provide clear, evidence-... 
    Remote job
    Contract work
    10 hours per week

    Crossing Hurdles

    New York, NY
    2 days ago
  • $30 - $50 per hour

    AI Privacy, Safety And Evaluation Specialist Test personal AI agents and review responses for privacy...  ...$30 to $50 per hour. Remote Hourly · $30-$50/hr $30-...  ...disclosures, data-protection risks, and other...  ...and English AI responses, annotate text, and compare long-form... 
    Remote work
    Hourly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    OpenTrain AI, Inc.

    New York, NY
    1 day ago
  • YO AI Labs seeks a former U.S. Consular Officer or Passport Specialist to evaluate AI-generated guidance on passport and citizenship matters. This remote, contractor role asks for 20-30 hours per week and leverages your State Department experience to ensure accuracy and... 
    Remote job
    For contractors

    YO AI Labs

    New York, NY
    3 days ago
  • $50 per hour

    The work You will evaluate AI-generated SQL queries, database designs, and data-processing logic. Your reviews...  ...and takes This is a remote, part-time contractor...  ...AI data training, annotation, or evaluation of AI-generated...  ...answers and code. Specialists review examples,... 
    Remote work
    Hourly pay
    Part time
    For contractors

    OpenTrain AI, Inc.

    Brooklyn, NY
    2 days ago
  • $41.6k

     ...sourcing independent Search Engine Evaluation Specialists to provide their expertise for an AI benchmark evaluation project. As...  ...robust, expert-crafted training data. The objective of this project is...  ...Type: Freelance / Independent Contractor Workplace Type: Remote... 
    Remote work
    Hourly pay
    Contract work
    For contractors
    Freelance

    Meridial

    Remote
    4 days ago
  • OpenTrain AI, Inc. is seeking an Employment and Labor Law AI Evaluation Expert to review AI-generated answers to U.S. employment law scenarios, assess legal accuracy...  ..., and write feedback to improve models. This 100% remote, part-time freelance role requires a U.S. law... 
    Remote job
    Part time
    Freelance

    OpenTrain AI, Inc.

    New York, NY
    4 days ago
  • AuraOne, Inc. is seeking a Domain Contributor Evaluation Specialist for a remote contractor role in the United States. You will review AI outputs against workflows, policy, and...  ...asynchronously for at least 10 hours per week are required. #J-18808-Ljbffr AuraOne Human Data
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    New York, NY
    2 days ago
  • $8 - $65 per hour

    Philosophy Specialist - Freelance AI Trainer Project United States of America Are...  ...With high‑quality training data, tomorrow’s AI can...  ...our prompt engineering and evaluation metrics. A master’s or PhD...  ...: Contract Workplace type: Remote Seniority level: Mid‑Senior... 
    Remote job
    Hourly pay
    Contract work
    For contractors
    Freelance
    Immediate start

    Meridial

    New York, NY
    4 days ago
  • $21 - $35 per hour

     ...Compare your original images with the AI-generated versions Spot...  ...artifacts to composition problems Fully remote and flexible, no fixed shifts, no...  ...AI experience needed. Experience evaluating AI-generated images, annotating visual data, labeling data, checking image quality... 
    Remote job
    Hourly pay
    Part time
    For contractors
    Flexible hours

    OpenTrain AI

    New York, NY
    2 days ago
  • AuraOne is seeking an AI Agent Evaluator to remotely review and label ai agent evaluation prompts and responses against AuraOne's quality rubric. You will compare outputs, identify edge cases, and provide structured feedback to support retraining. The role focuses on auditing... 
    Remote job

    Auraone

    New York, NY
    3 days ago
  • $30 - $40 per hour

    211 Specialist, Government Services AI Evaluator Use your experience helping people find public benefits and community...  ...role pays $30 to $40 per hour. Remote Hourly · $30-$40/hr $30-$40/hr...  ...Korean and English AI responses, annotate text, and compare long-form content... 
    Remote work
    Hourly pay
    Contract work
    Part time
    For contractors
    Flexible hours

    OpenTrain AI, Inc.

    New York, NY
    2 days ago
  • $30 per hour

    Zekai is seeking a curious, clear writer to help evaluate AI assistants on realistic everyday tasks. You’ll craft short requests, interact...  ...the results against a professional standard. This is a 100% remote contract in the United States, about 10 hours per week, paying... 
    Remote job
    Hourly pay
    Contract work
    10 hours per week
    Flexible hours

    Confidential

    New York, NY
    2 days ago
  • Evaluate audio-based conversational AI in realistic customer support scenarios. Contribute to high-quality datasets for advanced AI models. Work remotely as a freelance independent contractor. Responsibilities: Design and conduct role-play scenarios across travel, finance... 
    Remote job
    Hourly pay
    For contractors
    Freelance
    Flexible hours

    Jobgether

    New York, NY
    2 days ago
  •  ...customer service role-plays in travel, finance, and tech support. Evaluate AI audio responses using structured criteria for accuracy,...  ...compensation of $6-$65 based on experience and location. Fully remote freelance work with flexible scheduling. Meaningful impact on... 
    Remote job
    Hourly pay
    Freelance
    Flexible hours

    Jobgether

    New York, NY
    2 days ago
  •  ...role Meridial seeks independent Audio Evaluation Specialists for an AI benchmark evaluation project. You...  ...evaluation frameworks, create training data, and audit AI outputs for realistic customer...  ...do not apply Work environment is remote; no office required #J-18808-Ljbffr... 
    Remote work
    Hourly pay
    For contractors
    Freelance
    Work at office
    Worldwide

    remote work

    New York, NY
    2 days ago
  • $104k - $208k

     ...Why Join Exadel We’re an AI-first global tech company with 25+ years...  ...features, research publications, data pipelines, and experimental prototypes Evaluate privacy risks and recommend practical...  ...Advanced Work Type: Remote Location: United States Working... 
    Remote work
    Full time
    Contract work
    Work experience placement
    Local area

    Exadel

    Remote
    8 days ago
  • Role Title: Evaluation Specialist/Recent Grad Role Type: Contractor Location: Remote our partner is engaging Evaluation Specialists/Recent Grads to contribute to a high-...  ...apply your expertise to help train next-generation AI systems. Your work will shape how models learn,... 
    Remote work
    Contract work
    For contractors
    Worldwide

    confidential

    New York, NY
    1 day ago
  • $140k - $160k

     ...are seeking a Lead Specialist, Applied AI Systems Engineer , to...  ...engineers and the AI Data & Knowledge Architect...  ...outputs must be rigorously evaluated against ground truth,...  ...building expert-annotated datasets,...  ...the impact you can make. #LI-P1#LI-Remote... 
    Remote work
    Full time

    Pearson

    Remote
    9 days ago
  • Zekai is seeking a Video Annotation Specialist for a 100% remote, contract role. You will review video and audio content...  ...precise annotations, and help train AI models with high-quality feedback. The ideal candidate has experience in data annotation or content moderation,... 
    Remote job
    Contract work

    Confidential

    New York, NY
    2 days ago
  • $70 - $120 per hour

    Gridnaut Recruiting is hiring a remote Architectural & Interior Visualization Specialist (AI Evaluation) contractor (pay $70-$120/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: Guide research teams to close knowledge gaps and improve AI model... 
    Remote work
    Contract work
    For contractors

    Gridnaut Recruiting

    Remote
    7 days ago
  • $70 - $120 per hour

     ...Architectural & Interior Visualization Specialist (AI Evaluation) is a remote review track for evaluating AI outputs across architectural interior visualization specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit... 
    Remote job
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    3 days ago
  • Hippocratic AI seeks registered nurses with at least five years of clinical experience to join our remote data annotation team evaluating AI-driven clinical agents. You will review conversations spanning primary care, chronic disease management, care management, medication... 
    Remote job
    Contract work
    Flexible hours

    Openkrill

    New York, NY
    2 days ago
  • $50 per hour

     ...Entry-Level Image Evaluation Specialist is a remote evaluation track for reviewing image ai trainer evaluation prompts and responses...  ...Why this role matters AI data reviewers help turn image ai trainer...  ...Prior evaluation, annotation, or human-rater experience on... 
    Remote job
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    a month ago
  •  ...Hurdles is seeking a detail-oriented data annotator to work remotely on a flexible hourly contract. You...  ...following project guidelines and evaluating AI outputs for clarity and accuracy. Ideal...  ...have prior experience with data annotation, strong independent-work skills, and... 
    Remote job
    Hourly pay
    Contract work
    Flexible hours

    Crossing Hurdles

    New York, NY
    1 day ago
  • $30 - $50 per hour

    Rex.zone is looking for a remote, full-time role in the United States...  ...on developing high-quality annotation workflows for AI/ML. Responsibilities include owning training data quality metrics, designing...  ...schemas, and implementing QA evaluation programs. The candidate should... 
    Remote job
    Hourly pay
    Full time

    Rex.zone

    New York, NY
    1 day ago
  • $70 - $120 per hour

     ...Gridnaut Recruiting is hiring a remote Music Producer & Audio Post Specialist (AI Evaluation) contractor (pay $70–$120/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: Guide research teams to close knowledge gaps and improve AI model performance... 
    Remote work
    Contract work
    For contractors

    Gridnaut Recruiting

    Remote
    7 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Data Annotation & Evaluation Specialist. Be the first to apply!