Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Data Labeling & Evaluation Specialist

Rex

New York, NY
  • Remote job

Rex.zone is seeking a Remote Data Labeling Specialist to work from anywhere within the United States. You will label and review multi-modal data for AI training, including text, images, audio, and video, and perform NLP tasks such as classification and named entity recognition. The role also covers computer vision annotation with bounding boxes and segmentation, content safety labeling, and RLHF-style evaluation tasks. #J-18808-Ljbffr REX

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Remote AI Data Labeling & Evaluation Specialist in New York, NY vacancy
  • $30 - $50 per hour

    A leading AI training company is seeking a Remote Annotator to support human-in-the-loop AI training...  ...This role involves reviewing labeled datasets, performing evaluations for helpfulness and safety, and...  ...ensuring quality in training data. Strong written English and attention... 
    Remote job
    Data
    Hourly pay

    Rex.zone

    New York, NY
    2 days ago
  • $1,750 - $2,150 per month

     ...technical talent with leading AI research labs. Headquartered in...  ...task Location: Remote Role Responsibilities Review and evaluate AI-generated outputs related...  ...testing reports. Annotate, label, and validate data across cybersecurity use cases... 
    Remote work
    Data
    Hourly pay
    Full time
    Contract work
    Summer work

    Mercor

    Remote
    13 hours ago
  • $30 - $50 per hour

    A tech company specializing in AI solutions is searching for a remote, full-time candidate to support AI/ML training workflows. In this role, you will perform high-accuracy data labeling, execute RLHF evaluation, and ensure training data quality. Candidates should have... 
    Remote job
    Data
    Hourly pay
    Full time

    REX

    New York, NY
    2 days ago
  • $68k - $113k

     ...You Will Do: Support the design and implementation of program evaluation and performance measurement activities for public health...  ...Collect, organize, maintain, and validate program and evaluation data to support analysis and reporting efforts. Analyze and visualize... 
    Remote work
    Data
    Temporary work
    Flexible hours

    Guidehouse

    McLean, VA
    3 days ago
  • $35 per hour

     ...pharmacy expertise to improve AI-powered prior...  ...related clinical content and evaluating AI-generated responses...  ...source materials, and labeling guidelines. Review...  ...review, or healthcare data annotation ~340B or medication...  ...Terms Location: Remote. Employment type:... 
    Remote work
    Data
    Hourly pay

    SaidGig

    United States
    8 days ago
  • Rex.zone is hiring a Senior Data Annotator to produce and review...  ...-quality training data for AI systems across NLP, computer vision, and multimodal evaluation. This is a Remote, full-time role focused on...  ...compliance, content safety labeling, and evaluation workflows that... 
    Remote job
    Data
    Full time

    Rex.zone

    Seattle, WA
    2 days ago
  • Rex.zone is hiring a Remote Data Labeling Specialist to produce high-quality training data for AI/ML systems. You will complete data labeling, RLHF preference ranking, QA evaluation audits, prompt evaluation, and content safety labeling to support LLM training pipelines... 
    Remote job
    Data

    Rex.zone

    Austin, TX
    3 days ago
  • $75k - $90k

     ...therapies. The Specialist I, Quality Assurance...  ...materials, equipment, and labeling, including...  ...documentation, assisting in the evaluation of batch release data. Collaborate with...  ...by law. For remote-based positions, this...  ...artificial intelligence (AI) tools to support... 
    Remote work
    Data
    Full time
    Local area
    Weekend work

    Orca Bio

    Sacramento, CA
    4 days ago
  • $8 - $65 per hour

     ...Health Sciences Specialist - Freelance AI Trainer Project United States of America...  ...With high-quality training data, tomorrow's AI can...  ...our prompt engineering and evaluation metrics. A bachelor's or...  ...: Contract Workplace type: Remote Seniority level: Mid-Senior... 
    Remote work
    Data
    Hourly pay
    Contract work
    For contractors
    Freelance
    Immediate start

    Meridial

    United States
    2 days ago
  • $8 - $65 per hour

     ...Healthcare Specialist (Fluent in French) – Freelance AI Trainer Project Large‑scale language models...  ...high‑quality training data, tomorrow’s AI can...  ...to prompt engineering and evaluation metrics. Qualifications Master...  ...Contract Workplace type: Remote Seniority level: Mid‑Senior... 
    Remote work
    Data
    Hourly pay
    Contract work
    For contractors
    Freelance

    Meridial

    Cedar Grove, WI
    1 day ago
  •  ...collaborative, and highly motivated Program Evaluation Specialist to lead program evaluation and support...  ...models, performance indicators, and data-collection protocols for educational...  ...that are eligible for hybrid or mobile/remote work mode are at the discretion of the... 
    Remote work
    Data
    Full time
    Temporary work
    Part time
    Work at office
    Worldwide
    Flexible hours
    Afternoon shift
    3 days per week
    Early shift

    University of Michigan

    Ann Arbor, MI
    1 day ago
  • YO AI Labs seeks a Video Annotation Specialist to review and label videos of robotic arms performing tasks. This remote contractor role emphasizes precise data labeling to support AI, ML and robotics projects, with emphasis on accuracy and thoroughness. You will use annotation... 
    Remote job
    Data
    For contractors

    YO AI Labs

    New York, NY
    1 day ago
  •  ...Anthropology Specialist - Freelance AI Trainer Project United States of America...  ...With high-quality training data, tomorrow's AI can...  ...our prompt engineering and evaluation metrics. A master's or PhD...  ...: Contract Workplace type: Remote Seniority level: Mid-Senior... 
    Remote work
    Data
    Hourly pay
    Contract work
    For contractors
    Freelance
    Immediate start

    Meridial

    United States
    2 days ago
  • YO AI Labs is seeking a detail-oriented Video Annotation Specialist to review and annotate robotic-arm video tasks. This contractor role is remote, offering flexible hours and the chance to contribute...  ...experience with video annotation or data labeling is preferred, and... 
    Remote job
    Data
    For contractors
    Flexible hours

    YO AI Labs

    Austin, TX
    1 day ago
  • YO AI Labs is seeking a meticulous Video Annotation Specialist to review and label videos of robotic arms for AI and machine-learning projects. This remote contractor role emphasizes accuracy, consistency, and structured data annotation following project guidelines. You... 
    Remote job
    Data
    For contractors

    YO AI Labs

    New York, NY
    4 days ago
  • $50 per hour

     ...Tagalog Audio Evaluation Specialist is a remote evaluation track for reviewing tagalog generalist evaluation...  ...rubric. Reviewers compare paired outputs, label edge cases, and write the kind of...  ...retrain. Why this role matters AI data reviewers help turn tagalog generalist... 
    Remote job
    Data
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    9 days ago
  • $70k - $140k

    Program Evaluation Specialist - Department of State The Position: We are seeking driven, thoughtful...  ...evaluation tools to develop models, analyze data, and interpret results Prepare...  ...vacation and sick leave, flexible and remote work opportunities, and tuition and training... 
    Remote work
    Data
    Full time
    Work at office
    Work from home
    Flexible hours

    Censeo Consulting Group

    Washington DC
    1 day ago
  •  ...Position Summary This is a fully remote, hourly contractor role supporting AI data and language projects on a...  ...diverse topics. Data annotation: labeling, classifying, and structuring documents...  ...AI training datasets. LLM evaluation: reviewing AI-generated... 
    Remote work
    Data
    Hourly pay
    For contractors
    Flexible hours

    CNTXT AI

    Brooklyn, NY
    15 days ago
  • $34 per hour

     ...Data Labeling Associate Welo Data is looking for sharp, curious, and detail-oriented...  ...be working directly with cutting-edge AI systems — evaluating outputs, identifying gaps, and helping...  ...: This is a 100% onsite position — remote work is not available for this role.... 
    Remote work
    Data
    Full time
    Contract work
    Visa sponsorship

    Welocalize

    New York, NY
    1 day ago
  • $55k - $65k

    Technology Specialist - Help Desk & AI Solutions Department:IT Solutions Location...  ...& Service Desk Provide remote and in-person technical support...  ...AI technologies and evaluate opportunities to improve business...  ..., Information Technology, Data Science, or a related field... 
    Remote work
    Data
    Full time
    Work experience placement
    Internship
    Work from home
    Home office
    Flexible hours

    Sevan Multi-Site Solutions

    Downers Grove, IL
    5 days ago
  • $26 - $28 per hour

     ...Description OverviewWelo Data is looking for detail-...  ...join our team as Data Labeling Analysts, supporting speech and voice AI systems.This is a high-impact...  ...execution-focused than evaluation-heavy roles, it still...  ...100% onsite position — remote work is not available for... 
    Remote work
    Data
    Full time
    Visa sponsorship

    Welocalize

    California
    27 days ago
  •  .... IBTCI specializes in monitoring, evaluation, research, and learning (MERL) and...  ...Title: Team Leader / Senior Evaluation Specialist Department/Location: Remote, with potential travel to Ethiopia,...  ..., mixed-methods designs, sampling, data sources, instrument packages,... 
    Remote work
    Data
    Temporary work
    Part time
    Local area

    Integrated Business & Technical Consultants

    Vienna, VA
    22 days ago
  •  ...Analytical Chemistry Specialist - AI Trainer, New Grad (Remote) Join to apply for the Analytical Chemistry Specialist...  ...expertise to enhance AI training data for scientific discovery....  ...improvements to our prompt engineering and evaluation metrics Qualifications: Required: •... 
    Remote work
    Data
    Full time
    Contract work
    Freelance
    H1b
    Worldwide

    jobright.com

    United States
    1 day ago
  • $90 - $140 per hour

     ...UX Designer Specialist $90 - $140/hour pay Required...  ...Heuristic Evaluation Information Architecture...  ...Contractor   Location: Remote   micro1 is...  ...train next-generation AI systems. Your work will...  ...Analyze user research data to identify patterns, user... 
    Remote work
    Data
    Temporary work
    For contractors

    ESR Healthcare

    New York, NY
    18 days ago
  • $80 - $150 per hour

     ...Prolific is seeking Medical Doctors in Las Vegas to help train and evaluate AI models. Successful candidates will join as Domain Expert...  ...extended periods. Prolific provides a unique opportunity to influence AI development with ethically sourced human data. #J-18808-Ljbffr... 
    Remote work
    Data
    Hourly pay
    Flexible hours

    Prolific

    Las Vegas, NV
    1 day ago
  • $65 per hour

     ...Registered Nurses - AI Training Prolific is not just another player in the AI space...  ...building the biggest pool of quality human data in the world. Over 35,000 AI developers, researchers...  ...for Registered Nurses to help train and evaluate cutting‑edge AI models. If you have the... 
    Remote work
    Data
    Self employment
    Work from home
    Flexible hours

    Prolific

    Omaha, NE
    3 days ago
  • $70 - $110 per hour

     ...Help evaluate and improve AI systems by applying practical project management expertise to AI-generated...  ...of experience as a Project Management Specialist, Project Manager, Technical Project...  ...communication skills. Work Terms Remote, hourly engagement. Immediate start... 
    Remote work
    Hourly pay
    Immediate start

    SaidGig

    United States
    2 days ago
  • YO AI Labs is seeking experienced Producers across film, television, digital, or live events to support an AI evaluation project in a fully remote capacity. You will craft realistic industry scenarios, evaluate AI outputs, and develop benchmarks that reflect real-world... 
    Remote work

    YO AI Labs

    Austin, TX
    4 days ago
  • $35 - $120 per hour

     ...technical talent with leading AI research labs. Headquartered in...  .... Position: Code-Data Eval Author — Software Engineer...  ...$120/hour Location: Remote Commitment: 30+ hours...  ...through structured review. Evaluate the accuracy and depth of AI-... 
    Remote work
    Data
    Full time
    Contract work
    Summer work

    Mercor

    Remote
    13 hours ago
  • $90 - $140 per hour

     ...please make sure to complete the AI interview as well. Step 1...  ...: Contractor Location: Remote micro1 is engaging expert...  ...# Analyze user research data to identify patterns, user needs...  ...insights. # Conduct heuristic evaluations and UX audits to assess product... 
    Remote work
    Data
    For contractors

    Prointegrate LLC

    Myrtle Point, OR
    9 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Data Labeling & Evaluation Specialist. Be the first to apply!