Remote AI Evaluation & Annotation Specialist
Auraone
New York, NY
- Remote job
AuraOne is seeking a remote Consumer Reviewer to evaluate prompts and responses against our quality rubric. You will compare outputs, label edge cases, and craft structured feedback to help retrain the model. This contractor role requires strong written reasoning, attention to detail, and the ability to work asynchronously for at least 10 hours per week. Prior experience with multi-page rubrics and calibration cycles is a plus. #J-18808-Ljbffr Auraone
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Remote AI Evaluation & Annotation Specialist in New York, NY vacancy
- ...Remote Video Annotation Specialist — AI Model Evaluation is a remote evaluation track for reviewing video annotation evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured...Remote jobHourly payFor contractors10 hours per week
$21 - $35 per hour
...Compare your original images with the AI-generated versions Spot... ...artifacts to composition problems Fully remote and flexible, no fixed shifts, no commute... ...No AI experience needed. Experience evaluating AI-generated images, annotating visual data, labeling data, checking...Remote jobHourly payPart timeFor contractorsFlexible hours$30 - $50 per hour
AI Privacy, Safety And Evaluation Specialist Test personal AI agents and review responses for privacy risks in a... ...project paying $30 to $50 per hour. Remote Hourly · $30-$50/hr $30-$50/hr... ...Korean and English AI responses, annotate text, and compare long-form content...Remote workHourly payContract workPart timeFor contractorsFlexible hours$30 - $40 per hour
211 Specialist, Government Services AI Evaluator Use your experience helping people find public benefits and community... ...role pays $30 to $40 per hour. Remote Hourly · $30-$40/hr $30-$40/hr... ...Korean and English AI responses, annotate text, and compare long-form content...Remote workHourly payContract workPart timeFor contractorsFlexible hours$60 per hour
Prolific is seeking Computer Science Specialists to join our Expert Network to train and evaluate AI models. You’ll complete a quick 10- to 15-minute test and, if... ...depending on skills and experience. This role offers remote work and the opportunity to contribute to high‑...Remote jobWork from homeFlexible hours$21 - $35 per hour
Crossing Hurdles is seeking an Image Evaluation Expert (Visual Arts / Photography) on a remote contract basis. You will upload photos, compare AI-generated images with real photographs, and assess lighting, perspective, and textures to ensure visual accuracy. You will...Remote jobHourly payContract work- YO AI Labs is seeking a detail-oriented Video Annotation Specialist to review and annotate videos of robotic arms performing tasks. The role focuses on precise labeling... ...datasets to support AI/ML projects. As a remote contractor, you will review footage, apply project...Remote jobFor contractors
- AuraOne is seeking a remote contractor to evaluate 360° video recorder outputs against our quality rubric and to provide structured feedback for retraining. Reviewers compare paired results, label edge cases, and write rationale to support improvements. Role focuses on...Remote jobFor contractors
- AuraOne is seeking a Swiss German Transcription Expert for a remote evaluation track. You will review German generalist outputs, compare paired responses, and label edge cases against AuraOne's quality rubric. As a contractor, you will provide structured feedback and rationales...Remote jobFor contractors
- Crossing Hurdles is seeking an Image Evaluation Expert for a remote contract role in the United States. You will upload photographs, compare real images with AI outputs, and assess lighting, perspective, and textures to ensure accuracy. You will provide clear, evidence-...Remote jobContract work10 hours per week
$40 per hour
A dynamic technology company is seeking a Remote Visual Annotation Expert. This role involves analysing video clips and images to produce structured annotations, requiring strong attention to detail and excellent communication skills. The ideal candidate will have experience...Remote jobHourly pay10 hours per week- AuraOne, Inc. is seeking a Domain Contributor Evaluation Specialist for a remote contractor role in the United States. You will review AI outputs against workflows, policy, and stakeholder-fit using a structured rubric, and document the next steps for model training. Responsibilities...Remote jobFor contractors10 hours per week
$41.6k
...Overview We are sourcing independent Search Engine Evaluation Specialists to provide their expertise for an AI benchmark evaluation project. As AI models... ...PTO do not apply. Engagement Type: Freelance / Independent Contractor Workplace Type: Remote...Remote workHourly payContract workFor contractorsFreelance- Zekai is seeking a Video Annotation Specialist for a 100% remote, contract role. You will review video and audio content, provide precise annotations, and help train AI models with high-quality feedback. The ideal candidate has experience in data annotation or content moderation...Remote jobContract work
- AuraOne seeks a French Transcription Expert (Canada) for a remote evaluation track. Reviewers compare paired outputs against a quality rubric, label edge cases, and generate structured feedback for retraining the model. Role emphasizes attention to detail, written reasoning...Remote jobHourly payFor contractorsFlexible hours
$8 - $65 per hour
Philosophy Specialist - Freelance AI Trainer Project United States of America Are you a philosophy expert... ...to our prompt engineering and evaluation metrics. A master’s or PhD in philosophy... ...type: Contract Workplace type: Remote Seniority level: Mid‑Senior Level Apply...Remote jobHourly payContract workFor contractorsFreelanceImmediate start- ...About the role Meridial seeks independent Audio Evaluation Specialists for an AI benchmark evaluation project. You will design evaluation frameworks... ...contractor engagement; company benefits do not apply Work environment is remote; no office required #J-18808-Ljbffr...Remote workHourly payFor contractorsFreelanceWork at officeWorldwide
remote work
New York, NY18 hours ago - OpenTrain AI, Inc. is seeking an Employment and Labor Law AI Evaluation Expert to review AI-generated answers to U.S. employment law scenarios, assess legal accuracy... ..., and write feedback to improve models. This 100% remote, part-time freelance role requires a U.S. law...Remote jobPart timeFreelance
$30 per hour
Zekai is seeking a curious, clear writer to help evaluate AI assistants on realistic everyday tasks. You’ll craft short requests, interact... ...the results against a professional standard. This is a 100% remote contract in the United States, about 10 hours per week, paying...Remote jobHourly payContract work10 hours per weekFlexible hours- AuraOne is seeking an AI Agent Evaluator to remotely review and label ai agent evaluation prompts and responses against AuraOne's quality rubric. You will compare outputs, identify edge cases, and provide structured feedback to support retraining. The role focuses on auditing...Remote job
$30 - $50 per hour
A technology firm specializing in data annotation is seeking a remote AI Data Annotation Specialist. The role involves executing high-quality data labeling and... ...written English skills, and familiarity with LLM evaluation concepts. Compensation ranges from $30 to $50 per...Remote jobHourly pay- ...customer service role-plays in travel, finance, and tech support. Evaluate AI audio responses using structured criteria for accuracy,... ...compensation of $6-$65 based on experience and location. Fully remote freelance work with flexible scheduling. Meaningful impact on...Remote jobHourly payFreelanceFlexible hours
$30 - $50 per hour
Rex.zone is looking for a remote, full-time role in the United States focused on developing high-quality annotation workflows for AI/ML. Responsibilities include owning training data... ...labeling schemas, and implementing QA evaluation programs. The candidate should have over...Remote jobHourly payFull time- Evaluate audio-based conversational AI in realistic customer support scenarios. Contribute to high-quality datasets for advanced AI models. Work remotely as a freelance independent contractor. Responsibilities: Design and conduct role-play scenarios across travel, finance...Remote jobHourly payFor contractorsFreelanceFlexible hours
$20 - $30 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...$20$30/hour Location: Remote Role Responsibilities Evaluate the accuracy of captions for egocentric... ...~ Prior experience in video annotation data labeling content moderation QA...Remote workFull timeContract workSummer work- ...Pavement Condition Index (PCI) Survey & Annotation Specialist – Freelance AI Trainer Project at Meridial Back... ...AI Trainer Project World Wide - Remote Are you a pavement professional... ...on your expertise to help train and evaluate next-generation AI models. In this...Remote workHourly payContract workPart timeFor contractorsFreelance
Invisible Technologies
San Francisco, CAa month ago $110k - $138k
...and scale intelligent AI, digital, cybersecurity... ...The Computer Vision Specialist is a member of WWT’s Global... ...on dataset curation, annotation, and synthetic data,... ...on how models will be evaluated, optimized for edge... ...Equal Opportunity Employer. LI-DP2 LI-Remote...Remote workFull timeWork experience placementFlexible hoursShift workWorld Wide Technology
Independence, MO4 days ago- AI Trainer Jobs seeks a Music Production Expert - English to remotely review prompts and responses against AuraOne's rubric. You will compare paired outputs... ...retrain the model. Ideal candidates have prior evaluation or annotation experience in music production English,...Remote jobFor contractors10 hours per week
- AuraOne is seeking a French Audio Recording Expert (Canada) for remote evaluation. You will review prompts and responses, compare outputs, and... ...-quality data labeling. Role requires prior evaluation or annotation experience with French content, strong attention to detail,...Remote job
- ...Inc. Nepali Bilingual Expert role is a fully remote contractor position focused on reviewing Nepali bilingual evaluation prompts and responses against AuraOne's quality... .... Ideal candidates have prior evaluation or annotation experience, strong written reasoning,...Remote jobFor contractors10 hours per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Evaluation & Annotation Specialist. Be the first to apply!
Related searches
- ai data scientist New York, NY
- ai scientist New York, NY
- graphic design remote New York, NY
- remote scrum master New York, NY
- remote document review New York, NY
- remote recruiter New York, NY
- remote infrastructure engineer New York, NY
- genetic counselor remote New York, NY
- remote appointment scheduler New York, NY
- junior angular developer remote New York, NY