TOS AI Evaluator: Remote Annotation & Quality Auditor
AuraOne
New York, NY
- Remote job
AuraOne is seeking a remote contractor to evaluate terms of service AI outputs against our quality rubric. You will review paired model responses, label edge cases, and write structured feedback the modeling team can use to retrain. Ideal candidates have strong attention to detail, can apply rubrics consistently across multi-page prompts, and provide clear reasoning that names the issue and the rubric clause. #J-18808-Ljbffr AuraOne
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the TOS AI Evaluator: Remote Annotation & Quality Auditor in New York, NY vacancy
- ...zone is seeking a Senior AI data annotator to perform data labeling and evaluation for NLP tasks, RLHF... ...to improve training data quality and model performance. This is a US-based remote, full-time role aligned... ...senior background in data annotation and familiarity with RLHF...Remote jobFull time
- AuraOne is seeking an AI Data Annotation Expert for a remote contractor role focused on evaluating AI data annotation outputs against a versioned rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain the model. Responsibilities...Remote jobFor contractors
- AuraOne seeks a VFX Quality Evaluator to review AI outputs across vfx review workflows. Reviewers grade craft, constraints, and tooling adherence;... ...corrected approach so the modeling team can train on it. This remote contractor role requires clear written reasoning, multi-...Remote jobFor contractors10 hours per week
$40 per hour
A leading data annotation service is seeking a Biology Expert to train AI models. The role involves measuring AI progress, evaluating chatbot outputs, and ensuring quality improvement. Ideal candidates will have... ...contract position offers remote work with flexible...Remote workHourly payContract workFlexible hoursDataAnnotation
Iowa, LA3 days ago- Rex.zone is seeking Senior Data Annotation professionals to support AI/ML training workflows with high-quality labeled data, RLHF judgments, and QA signals for LLM evaluation and computer vision annotation. This is a remote, full-time role aligned to Boston hiring demand...Remote workFull time
$35 - $40 per hour
A leading evaluation organization seeks a Generalist Evaluator Expert for a remote, flexible contract role. This position involves designing prompts for language model evaluations... ...and critical thinking skills, familiarity with AI tools like ChatGPT, and a BS or BA degree. This...Remote jobContract workFlexible hours$40 per hour
A data annotation company is seeking professionals in quantitative fields to enhance AI development. This fully remote role allows individuals to set flexible schedules while evaluating AI-generated analyses and solving complex quantitative problems. Candidates should...Remote workHourly payFlexible hoursDataAnnotation
Oregon, WI2 days ago$23 per hour
...freelance online tasks that train and improve AI. As an annotator, you may be invited to... ...such as rating AI-generated content, evaluating factual accuracy, or comparing responses... ...earn up to $23 per hour equivalent. #J-18808-Ljbffr Mindrift Data Annotation ProjectsRemote jobHourly payFreelance- Turing is seeking graduate students or professionals for a remote role in evaluating AI-generated research reports. Responsibilities include reading, annotating, and scoring reports on a 1-5 scale, alongside providing written justifications. Candidates must possess strong...Remote job
- Alignerr is seeking a Population Health Informaticist for AI training, focusing on evaluating and annotating health data analyses produced by AI systems. This remote, hourly contract role offers flexible hours (10-40 per week) and the chance to influence population health...Remote jobHourly payContract workFlexible hours
- Alignerr is seeking a Population Health Informaticist to annotate and evaluate AI-generated health content. This remote, hourly-contract role leverages your domain expertise in population health to improve AI reasoning on health data, epidemiology, and public health analytics...Remote jobHourly payContract work10 hours per week
- **Job Title: AI Trainer || Image Quality Evaluator || English** **Location**: Remote | Work from Home **Employment Type:** Project-based | Contract We are looking... ...Quality Evaluator for a multilingual AI data Annotation and Transcription Specialists with strong...Remote workContract workWork from homeMonday to FridayDay shift
iMerit Technology
Louisianaa month ago $40 per hour
A leading data annotation company is seeking a Statistician to join their team. This remote role involves training AI models by posing complex mathematical problems, evaluating outputs, and assessing the model's performance. Candidates must be detail-oriented and proficient...Remote workHourly payDataAnnotation
New York, NY3 days ago- ...AI Trainer & Evaluator In this role, you'll apply your expertise to help... ..., and perform through high-quality, real-world input. Key Responsibilities... ...diverse subject areas. # Annotate and categorize data sets to... ...collaboratively in a fully remote environment....Remote work
micro1
United States4 days ago - ...Summary This is a fully remote, hourly contractor role supporting AI data and language... ...generation: writing high-quality prompts and model responses... ...diverse topics. Data annotation: labeling, classifying,... ...datasets. LLM evaluation: reviewing AI-generated...Remote workHourly payFor contractorsFlexible hours
CNTXT AI
Brooklyn, NY8 days ago - AuraOne is seeking a remote Spoken Instruction Conversation Evaluator to review prompts and responses against its quality rubric. You will compare outputs, label edge cases, and provide... ..., you will evaluate model outputs, annotate according to rubric, tag severities, and...Remote jobHourly payContract workFor contractors
- AI Agent Development & Evaluation Primary Care, Acute Symptom Triage & Travel Health |... ...safety. This is a part-time, remote contract position (1099)... ...reasoning. Score and annotate agent performance using structured... ...used in ongoing agent quality assurance. Qualifications...Remote workHourly payContract workPart time10 hours per weekFlexible hours
- YO IT Consulting is seeking an AI Trainer & Evaluator for a remote contract role. You will evaluate AI outputs, annotate data, and provide feedback to improve model performance across business, finance, marketing, healthcare, and legal domains. Strong attention to detail...Remote jobContract work
- YO IT Consulting is seeking an AI Trainer & Evaluator for a remote contract role. You will apply your domain expertise... ..., reason, and perform through high-quality real-world input. Responsibilities include scoring AI outputs, annotating data sets, reviewing content for...Remote jobContract work
- CNTXT AI is seeking a fully remote, hourly contractor to support AI data and language projects on a flexible, project-based schedule. The role involves content generation, data annotation, LLM evaluation, and localization QA across diverse topics. Ideal candidates are native...Remote jobHourly payFor contractorsFlexible hours
- YO IT Consulting is seeking an AI Trainer & Evaluator for a remote contract role. You will train AI systems by evaluating outputs, annotating data, and providing actionable feedback to... ...content areas while maintaining high-quality annotations. The ideal candidate has...Remote jobContract work
- YO IT Consulting is seeking an AI Trainer & Evaluator for a remote contract role. You will train next-generation... ...AI systems by providing high-quality real-world input and precise scoring... .... This position emphasizes data annotation, rubric refinement, and clear, actionable...Remote jobContract work
- Feitong Buke is hiring a Lead AI Trainer to oversee and enhance the quality of AI model dialogues with users. The... ...Candidates should have experience in annotation for conversational AI and a keen... ...conversational responses. This is a remote full-time position offering...Remote jobFull time
- AuraOne is seeking a Brand Design Quality Evaluator to remotely assess design quality prompts and model outputs. You will compare paired responses, apply a versioned rubric, and provide structured feedback for retraining the modeling team. Responsibilities include labeling...Remote jobFor contractors
- Alignerr is seeking a Population Health Informaticist for AI training. Work remotely on projects at the intersection of public health, data... ...and supporting health decisions at scale. You will evaluate outputs, annotate datasets, and translate concepts into structured...Remote jobFlexible hours
- ...Hiring PhD-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content, craft relevant questions, and evaluate model responses in a flexible contract role. Key responsibilities Assessing the factuality and...Remote workFull timeContract workFlexible hours
Virtual Vocations Inc
United States4 days ago $14.5 per hour
...AI Web Search Evaluator Unlock the Power of the Internet! Are you curious, tech-savvy, and passionate... ...and achieve work-life balance. Remote Work: Enjoy the freedom of working from... ...your analytical, research, and quality assessment skills. ~ Exclusive Perks...Remote workBi-weekly payHourly payPart timeImmediate startWork from homeFlexible hoursJobs for Humanity
United States18 hours ago$40 per hour
A cybersecurity training company is seeking experienced professionals to evaluate AI-generated security content and solve technical problems. This is a remote role offering flexibility in project selection and scheduling. Ideal candidates will have over 2 years of cybersecurity...Remote workHourly payDataAnnotation
Lincoln, NE3 days ago$40 per hour
...tech firm is seeking experienced cybersecurity professionals to evaluate AI-generated security content and solve technical problems. This... ...choosing their projects and schedules, earning $40+ per hour. Remote work is available for candidates in the US and select...Remote workHourly payDataAnnotation
Louisiana, MO3 days ago$14.5 per hour
...AI Web Search Evaluator Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI... ...analysis is beneficial. Seeks a flexible, remote job that can easily fit around other...Remote workHourly payPart timeCurrently hiringImmediate startWork from home10 hours per weekFlexible hoursJobs for Humanity
United States1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to TOS AI Evaluator: Remote Annotation & Quality Auditor. Be the first to apply!
Related searches
- program evaluator New York, NY
- work from home web search evaluator New York, NY
- clinical evaluator New York, NY
- evaluator New York, NY
- ai evaluator New York, NY
- work from home social media evaluator New York, NY
- quality evaluator New York, NY
- education evaluator New York, NY
- social media evaluator New York, NY
- quality control associate New York, NY