Remote AI Q&A Evaluation Specialist
OpenTrain AI, Inc.
New York, NY
- Remote job
OpenTrain AI, Inc. is seeking an AI Question and Answer Evaluation Specialist to create research-backed questions and answers, test AI model responses, and improve evaluation content remotely for an hourly-equivalent, task-based compensation model. This entry-level, part-time role emphasizes high-quality written English, independent research, and careful analysis. The ideal candidate will craft nuanced questions, cite sources, and revise content based on reviewer feedback while maintaining #J-18808-Ljbffr OpenTrain AI, Inc.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Remote AI Q&A Evaluation Specialist in New York, NY vacancy
$60 per hour
Prolific is seeking Computer Science Specialists to join our Expert Network to train and evaluate AI models. You’ll complete a quick 10- to 15-minute test and, if... ...depending on skills and experience. This role offers remote work and the opportunity to contribute to high‑...Remote jobWork from homeFlexible hours- Crossing Hurdles is seeking an Image Evaluation Expert for a remote contract role in the United States. You will upload photographs, compare real images with AI outputs, and assess lighting, perspective, and textures to ensure accuracy. You will provide clear, evidence-...Remote jobContract work10 hours per week
$21 - $35 per hour
Crossing Hurdles is seeking an Image Evaluation Expert (Visual Arts / Photography) on a remote contract basis. You will upload photos, compare AI-generated images with real photographs, and assess lighting, perspective, and textures to ensure visual accuracy. You will...Remote jobHourly payContract work$20 - $60 per hour
AI Question and Answer Evaluation Specialist Create research-backed questions and answers, test AI model responses, and improve evaluation content remotely for $20 to $60 per hour equivalent, paid per task. $20-$60/hr equivalent, paid per accepted task Compensation...Remote workHourly payContract workPart timeFor contractors$41.6k
...Overview We are sourcing independent Search Engine Evaluation Specialists to provide their expertise for an AI benchmark evaluation project. As AI models... ...PTO do not apply. Engagement Type: Freelance / Independent Contractor Workplace Type: Remote...Remote workHourly payContract workFor contractorsFreelance- AuraOne, Inc. is seeking a Domain Contributor Evaluation Specialist for a remote contractor role in the United States. You will review AI outputs against workflows, policy, and stakeholder-fit using a structured rubric, and document the next steps for model training. Responsibilities...Remote jobFor contractors10 hours per week
$8 - $65 per hour
Philosophy Specialist - Freelance AI Trainer Project United States of America Are you a philosophy expert... ...to our prompt engineering and evaluation metrics. A master’s or PhD in philosophy... ...type: Contract Workplace type: Remote Seniority level: Mid‑Senior Level Apply...Remote jobHourly payContract workFor contractorsFreelanceImmediate start- YO AI Labs seeks a former U.S. Consular Officer or Passport Specialist to evaluate AI-generated guidance on passport and citizenship matters. This remote, contractor role asks for 20-30 hours per week and leverages your State Department experience to ensure accuracy and...Remote jobFor contractors
$30 - $50 per hour
AI Privacy, Safety And Evaluation Specialist Test personal AI agents and review responses for privacy risks in a six-week, part-time U.S. project paying $30 to $50 per hour. Remote Hourly · $30-$50/hr $30-$50/hr Compensation Contract, part-time Engagement Remote...Remote workHourly payContract workPart timeFor contractorsFlexible hours$21 - $35 per hour
...standards Compare your original images with the AI-generated versions Spot imperfections,... ...artifacts to composition problems Fully remote and flexible, no fixed shifts, no commute... ...No AI experience needed. Experience evaluating AI-generated images, annotating visual...Remote jobHourly payPart timeFor contractorsFlexible hours- OpenTrain AI, Inc. is seeking an Employment and Labor Law AI Evaluation Expert to review AI-generated answers to U.S. employment law scenarios, assess legal accuracy... ..., and write feedback to improve models. This 100% remote, part-time freelance role requires a U.S. law...Remote jobPart timeFreelance
- AuraOne is seeking an AI Agent Evaluator to remotely review and label ai agent evaluation prompts and responses against AuraOne's quality rubric. You will compare outputs, identify edge cases, and provide structured feedback to support retraining. The role focuses on auditing...Remote job
$30 per hour
Zekai is seeking a curious, clear writer to help evaluate AI assistants on realistic everyday tasks. You’ll craft short requests, interact... ...the results against a professional standard. This is a 100% remote contract in the United States, about 10 hours per week, paying...Remote jobHourly payContract work10 hours per weekFlexible hours$30 - $40 per hour
211 Specialist, Government Services AI Evaluator Use your experience helping people find public benefits and community resources to evaluate AI answers,... ...This U.S.-based contract role pays $30 to $40 per hour. Remote Hourly · $30-$40/hr $30-$40/hr Compensation...Remote workHourly payContract workPart timeFor contractorsFlexible hours- ...customer service role-plays in travel, finance, and tech support. Evaluate AI audio responses using structured criteria for accuracy,... ...compensation of $6-$65 based on experience and location. Fully remote freelance work with flexible scheduling. Meaningful impact on...Remote jobHourly payFreelanceFlexible hours
- Evaluate audio-based conversational AI in realistic customer support scenarios. Contribute to high-quality datasets for advanced AI models. Work remotely as a freelance independent contractor. Responsibilities: Design and conduct role-play scenarios across travel, finance...Remote jobHourly payFor contractorsFreelanceFlexible hours
- About the role Meridial seeks independent Audio Evaluation Specialists for an AI benchmark evaluation project. You will design evaluation frameworks... ...engagement; company benefits do not apply Work environment is remote; no office required #J-18808-Ljbffr remote workRemote workHourly payFor contractorsFreelanceWork at officeWorldwide
- Role Title: Evaluation Specialist/Recent Grad Role Type: Contractor Location: Remote our partner is engaging Evaluation Specialists/Recent Grads to contribute to a high-... ...apply your expertise to help train next-generation AI systems. Your work will shape how models learn,...Remote workContract workFor contractorsWorldwide
$70 - $120 per hour
Gridnaut Recruiting is hiring a remote Architectural & Interior Visualization Specialist (AI Evaluation) contractor (pay $70-$120/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: Guide research teams to close knowledge gaps and improve AI model...Remote workContract workFor contractors$70 - $120 per hour
...Architectural & Interior Visualization Specialist (AI Evaluation) is a remote review track for evaluating AI outputs across architectural interior visualization specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit...Remote jobFor contractorsWork experience placement10 hours per week$70 - $120 per hour
...Gridnaut Recruiting is hiring a remote Music Producer & Audio Post Specialist (AI Evaluation) contractor (pay $70–$120/hr). Contribute to frontier AI research and evaluation work. Ideal candidates: Guide research teams to close knowledge gaps and improve AI model performance...Remote workContract workFor contractors$70 - $120 per hour
...Music Producer & Audio Post Specialist - AI Evaluation (US Remote) is a remote evaluation track for reviewing audio annotation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback...Remote jobFor contractors10 hours per week$70k - $140k
...Program Evaluation Specialist - Department of State The Position: We are seeking driven, thoughtful candidates with experience in program... ...package, including paid vacation and sick leave, flexible and remote work opportunities, and tuition and training reimbursement....Remote workFull timeWork at officeWork from homeFlexible hoursCenseo Consulting Group
Washington DC2 days ago$75 - $110 per hour
...Neurology Evaluation Specialist is a remote clinical-review track for evaluating AI outputs that touch neurology. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so...Remote workHourly payFor contractors10 hours per weekAuraOne
New York, NY1 day ago$20 per hour
...Job Application for Search Engine Evaluation Specialist - Freelance AI Trainer Project at Meridial Back to jobs Search Engine Evaluation Specialist... .../ Independent Contractor Workplace Type: Remote Apply for this job * indicates a required field...Remote workHourly payPart timeFor contractorsFreelanceInvisible Technologies
San Francisco, CAa month ago$90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $90/hour Location: Remote Role Responsibilities Render a reference... ...RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel...Remote workContract workSummer workLocal area$80 - $150 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco... .... Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour Location: Remote Role Responsibilities Review and assess...Remote workContract workSummer work- ...About the role Calibration Technology Evaluation Specialist is a remote review track for evaluating AI outputs across calibration technology evaluation specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational...Remote workHourly payFor contractorsWork experience placement10 hours per week
AuraOne
New York, NY3 days ago $65 per hour
...Prolific is seeking registered nurses to join its Domain Expert pool to train and evaluate AI models. You will take a quick skills test and, if successful, be invited to join Prolific as a Domain Expert participant, earning payments for AI tasks. Researchers pay up...Remote workSelf employmentWork from homeFlexible hoursProlific Academic Ltd
United States18 hours ago$90 per hour
...Compensation: Approximately US$90 per hour. Location: Remote, with US/Europe preferred; location is flexible. About the... ...You will review a simulated industrial plant benchmark used for AI evaluation and help assess whether its environment, synthetic sensor data...Remote workHourly payContract workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Q&A Evaluation Specialist. Be the first to apply!
Related searches
- ai data scientist New York, NY
- ai scientist New York, NY
- graphic design remote New York, NY
- remote scrum master New York, NY
- remote document review New York, NY
- remote recruiter New York, NY
- remote infrastructure engineer New York, NY
- genetic counselor remote New York, NY
- remote appointment scheduler New York, NY
- junior angular developer remote New York, NY