Remote AI Data Annotation & Evaluation Specialist
$30 - $50 per hourRex.zone
- Remote job
A technology firm specializing in data annotation is seeking a remote AI Data Annotation Specialist. The role involves executing high-quality data labeling and annotation for NLP and computer vision datasets. Ideal candidates will have mid-senior experience, strong written English skills, and familiarity with LLM evaluation concepts. Compensation ranges from $30 to $50 per hour, depending on complexity, and the work environment requires strong QA practices and asynchronous communication. #J-18808-Ljbffr Rex.zone
$60 per hour
Prolific is seeking Computer Science Specialists to join our Expert Network to train and evaluate AI models. You’ll complete a quick 10- to 15-minute test and, if... ...depending on skills and experience. This role offers remote work and the opportunity to contribute to high‑...Remote jobWork from homeFlexible hours$110k - $138k
...scale intelligent AI, digital, cybersecurity... ...Computer Vision Specialist is a member of WWT... ..., part of AI & Data Solutions, focused... ...dataset curation, annotation, and synthetic data... ...models will be evaluated, optimized for edge... ...Opportunity Employer. LI-DP2 LI-Remote...Remote workFull timeWork experience placementFlexible hoursShift work$20 - $60 per hour
AI Question and Answer Evaluation Specialist Create research-backed questions and answers, test AI model responses, and improve evaluation content remotely for $20 to $60 per hour equivalent, paid per task. $20-$60/hr equivalent, paid per accepted task Compensation...Remote workHourly payContract workPart timeFor contractors$21 - $35 per hour
Crossing Hurdles is seeking an Image Evaluation Expert (Visual Arts / Photography) on a remote contract basis. You will upload photos, compare AI-generated images with real photographs, and assess lighting, perspective, and textures to ensure visual accuracy. You will...Remote jobHourly payContract work- Crossing Hurdles is seeking an Image Evaluation Expert for a remote contract role in the United States. You will upload photographs, compare real images with AI outputs, and assess lighting, perspective, and textures to ensure accuracy. You will provide clear, evidence-...Remote jobContract work10 hours per week
$30 - $50 per hour
AI Privacy, Safety And Evaluation Specialist Test personal AI agents and review responses for privacy... ...$30 to $50 per hour. Remote Hourly · $30-$50/hr $30-... ...disclosures, data-protection risks, and other... ...and English AI responses, annotate text, and compare long-form...Remote workHourly payContract workPart timeFor contractorsFlexible hours- YO AI Labs seeks a former U.S. Consular Officer or Passport Specialist to evaluate AI-generated guidance on passport and citizenship matters. This remote, contractor role asks for 20-30 hours per week and leverages your State Department experience to ensure accuracy and...Remote jobFor contractors
$50 per hour
The work You will evaluate AI-generated SQL queries, database designs, and data-processing logic. Your reviews... ...and takes This is a remote, part-time contractor... ...AI data training, annotation, or evaluation of AI-generated... ...answers and code. Specialists review examples,...Remote workHourly payPart timeFor contractors$41.6k
...sourcing independent Search Engine Evaluation Specialists to provide their expertise for an AI benchmark evaluation project. As... ...robust, expert-crafted training data. The objective of this project is... ...Type: Freelance / Independent Contractor Workplace Type: Remote...Remote workHourly payContract workFor contractorsFreelance- OpenTrain AI, Inc. is seeking an Employment and Labor Law AI Evaluation Expert to review AI-generated answers to U.S. employment law scenarios, assess legal accuracy... ..., and write feedback to improve models. This 100% remote, part-time freelance role requires a U.S. law...Remote jobPart timeFreelance
- AuraOne, Inc. is seeking a Domain Contributor Evaluation Specialist for a remote contractor role in the United States. You will review AI outputs against workflows, policy, and... ...asynchronously for at least 10 hours per week are required. #J-18808-Ljbffr AuraOne Human DataRemote jobFor contractors10 hours per week
$8 - $65 per hour
Philosophy Specialist - Freelance AI Trainer Project United States of America Are... ...With high‑quality training data, tomorrow’s AI can... ...our prompt engineering and evaluation metrics. A master’s or PhD... ...: Contract Workplace type: Remote Seniority level: Mid‑Senior...Remote jobHourly payContract workFor contractorsFreelanceImmediate start$21 - $35 per hour
...Compare your original images with the AI-generated versions Spot... ...artifacts to composition problems Fully remote and flexible, no fixed shifts, no... ...AI experience needed. Experience evaluating AI-generated images, annotating visual data, labeling data, checking image quality...Remote jobHourly payPart timeFor contractorsFlexible hours- AuraOne is seeking an AI Agent Evaluator to remotely review and label ai agent evaluation prompts and responses against AuraOne's quality rubric. You will compare outputs, identify edge cases, and provide structured feedback to support retraining. The role focuses on auditing...Remote job
$30 - $40 per hour
211 Specialist, Government Services AI Evaluator Use your experience helping people find public benefits and community... ...role pays $30 to $40 per hour. Remote Hourly · $30-$40/hr $30-$40/hr... ...Korean and English AI responses, annotate text, and compare long-form content...Remote workHourly payContract workPart timeFor contractorsFlexible hours$30 per hour
Zekai is seeking a curious, clear writer to help evaluate AI assistants on realistic everyday tasks. You’ll craft short requests, interact... ...the results against a professional standard. This is a 100% remote contract in the United States, about 10 hours per week, paying...Remote jobHourly payContract work10 hours per weekFlexible hours- Evaluate audio-based conversational AI in realistic customer support scenarios. Contribute to high-quality datasets for advanced AI models. Work remotely as a freelance independent contractor. Responsibilities: Design and conduct role-play scenarios across travel, finance...Remote jobHourly payFor contractorsFreelanceFlexible hours
- ...customer service role-plays in travel, finance, and tech support. Evaluate AI audio responses using structured criteria for accuracy,... ...compensation of $6-$65 based on experience and location. Fully remote freelance work with flexible scheduling. Meaningful impact on...Remote jobHourly payFreelanceFlexible hours
- ...role Meridial seeks independent Audio Evaluation Specialists for an AI benchmark evaluation project. You... ...evaluation frameworks, create training data, and audit AI outputs for realistic customer... ...do not apply Work environment is remote; no office required #J-18808-Ljbffr...Remote workHourly payFor contractorsFreelanceWork at officeWorldwide
$104k - $208k
...Why Join Exadel We’re an AI-first global tech company with 25+ years... ...features, research publications, data pipelines, and experimental prototypes Evaluate privacy risks and recommend practical... ...Advanced Work Type: Remote Location: United States Working...Remote workFull timeContract workWork experience placementLocal area- Role Title: Evaluation Specialist/Recent Grad Role Type: Contractor Location: Remote our partner is engaging Evaluation Specialists/Recent Grads to contribute to a high-... ...apply your expertise to help train next-generation AI systems. Your work will shape how models learn,...Remote workContract workFor contractorsWorldwide
$140k - $160k
...are seeking a Lead Specialist, Applied AI Systems Engineer , to... ...engineers and the AI Data & Knowledge Architect... ...outputs must be rigorously evaluated against ground truth,... ...building expert-annotated datasets,... ...the impact you can make. #LI-P1#LI-Remote...Remote workFull time- Zekai is seeking a Video Annotation Specialist for a 100% remote, contract role. You will review video and audio content... ...precise annotations, and help train AI models with high-quality feedback. The ideal candidate has experience in data annotation or content moderation,...Remote jobContract work
$70 - $120 per hour
Gridnaut Recruiting is hiring a remote Architectural & Interior Visualization Specialist (AI Evaluation) contractor (pay $70-$120/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: Guide research teams to close knowledge gaps and improve AI model...Remote workContract workFor contractors$70 - $120 per hour
...Architectural & Interior Visualization Specialist (AI Evaluation) is a remote review track for evaluating AI outputs across architectural interior visualization specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit...Remote jobFor contractorsWork experience placement10 hours per week- Hippocratic AI seeks registered nurses with at least five years of clinical experience to join our remote data annotation team evaluating AI-driven clinical agents. You will review conversations spanning primary care, chronic disease management, care management, medication...Remote jobContract workFlexible hours
$50 per hour
...Entry-Level Image Evaluation Specialist is a remote evaluation track for reviewing image ai trainer evaluation prompts and responses... ...Why this role matters AI data reviewers help turn image ai trainer... ...Prior evaluation, annotation, or human-rater experience on...Remote jobFor contractors10 hours per week- ...Hurdles is seeking a detail-oriented data annotator to work remotely on a flexible hourly contract. You... ...following project guidelines and evaluating AI outputs for clarity and accuracy. Ideal... ...have prior experience with data annotation, strong independent-work skills, and...Remote jobHourly payContract workFlexible hours
$30 - $50 per hour
Rex.zone is looking for a remote, full-time role in the United States... ...on developing high-quality annotation workflows for AI/ML. Responsibilities include owning training data quality metrics, designing... ...schemas, and implementing QA evaluation programs. The candidate should...Remote jobHourly payFull time$70 - $120 per hour
...Gridnaut Recruiting is hiring a remote Music Producer & Audio Post Specialist (AI Evaluation) contractor (pay $70–$120/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: Guide research teams to close knowledge gaps and improve AI model performance...Remote workContract workFor contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Data Annotation & Evaluation Specialist. Be the first to apply!
- ai data scientist New York, NY
- ai scientist New York, NY
- data specialist New York, NY
- data operations specialist New York, NY
- data management specialist New York, NY
- data conversion specialist New York, NY
- data visualization specialist New York, NY
- research data specialist New York, NY
- oncology data specialist New York, NY
- data migration specialist New York, NY

