AI Conversation Evaluator - Remote
$40 - $80 per hourYO AI Labs
New York, NY
- Remote job
Job Description
Job Description
Job Description: Paralegal – AI Training & Legal Evaluation
Role Type: Contractor
Location: Remote (Worldwide, U.S. Practice Experience Required)
Weekly Commitment: Approximately 10+ Hours
We are seeking experienced paralegals to contribute their legal expertise to an AI training project. You will apply your practical knowledge of legal research, document review, citation verification, and document preparation to evaluate realistic legal tasks and improve AI systems.
Prior AI experience is not required.
Key Responsibilities- Complete legal tasks involving document review, research, citation verification, and document preparation.
- Explain the reasoning behind legal decisions and assessments.
- Follow established review protocols and flag cases that require further clarification.
- Identify ambiguous issues requiring attorney judgment.
- Review other contributors' work for accuracy and consistency.
- Deliver high-quality work within assigned deadlines.
- At least 5 years of hands-on paralegal experience in litigation, corporate, or regulatory practice.
- Practical experience in document review, legal research, and citation verification.
- Paralegal certificate, bachelor's degree, or equivalent professional experience.
- Ability to manage multiple documents and identify inconsistencies.
- Strong written and verbal English communication skills.
- Experience handling complex legal assignments with accuracy and attention to detail.
- Experience with legal data projects, e-discovery platforms, or structured review protocols.
- Familiarity with AI or LLM evaluation.
- Strong analytical, organizational, and problem-solving skills.
- $40–$80 per hour.
- Approximately 10+ hours per week.
- Flexible weekly schedule.
- Remote contractor opportunity open worldwide to candidates with U.S. legal practice experience.
- Submit an application and complete screening questions.
- Complete a role-specific AI interview.
- Undergo profile review.
- Complete onboarding with the Talent Operations team.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Conversation Evaluator - Remote in New York, NY vacancy
- Anyone AI is seeking experts to evaluate personalized AI conversations by engaging in natural, back-and-forth dialogues with two AI assistants. You will compare how well each assistant uses information from your connected services and prior activity to address your questions...Remote jobPart time
- Lifted is seeking experts to engage in live conversations with AI systems, review and label transcripts, and provide written justifications based... ...-language fluency and JSON expertise, with flexible remote scheduling for a 2-3 month project that may extend with continued...Remote workFlexible hours
- German Voice AI Evaluator (Healthcare Front Desk Conversations) What if your native German fluency could help teach AI how to handle a real phone call to a... ...conversations, and grade the AI's performance. This is a fully remote, flexible contract role for people with clear German...Remote workContract workWork at officeFlexible hours
$20 - $160 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Generalist Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour Location: Remote Role Responsibilities Evaluate...Remote workContract workSummer work- ...AI Conversation Evaluator (Remote) is a remote evaluation track for reviewing ai conversation evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured feedback the modeling team...Remote jobHourly payFor contractors10 hours per week
- ...Tutor Conversation AI Evaluator is a remote review track for evaluating AI outputs across tutor conversation ai specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next...Remote jobHourly payFor contractorsWork experience placement10 hours per week
- ...Sales and Business Development Expert for a remote contractor role focused on an internal AI training project. You will bring your... ...written and verbal communication. You will evaluate AI interview scenarios, simulate conversations across industries, document observations,...Remote jobFor contractors
- Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will roleplay live conversations with AI voice models, score exchanges, and explain in writing what looked or sounded off. You will compare image and video...Remote jobFlexible hours
- ...detail-oriented English speakers to review AI-generated media from home with flexible... ...will roleplay with AI voice models, rate conversations, and compare visuals to assess adherence... ...decisive judgments when aspects differ. Remote work is supported across multiple countries...Remote jobFlexible hours
- Outlier, operated by Scale AI, is seeking detail-oriented English speakers to review AI-generated media from home. You will roleplay live conversations with an AI voice model and rate outputs, then explain issues in writing for continuous model improvement. You can set...Remote jobWeekly payFreelanceFlexible hours
$18 per hour
...seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with an AI voice model, score exchanges for naturalness... ...explain in writing what looked or sounded off, all remotely and on your own schedule. You'll compare AI-...Remote jobFlexible hours- Alignerr is seeking native Dutch speakers for a remote contract role to evaluate AI-powered healthcare receptionist interactions. You will role-play as a patient, record short conversations, and assess how well the AI listens, responds, and takes action. You will review...Remote jobContract workFlexible hours
- ...native German speakers in the New York area to evaluate a healthcare AI receptionist by role-playing as a patient and recording conversations. You will assess how well the AI listens,... ..., then provide structured feedback. This remote, contract-based role emphasizes linguistic...Remote jobContract workFlexible hours
- Zekai is seeking a Food Delivery AI Response Evaluator to work remotely as a contractor. You will assess AI-generated replies in food delivery contexts... ...and customer service helps. You will draft example conversations and provide concise improvement suggestions,...Remote jobFor contractors
$40 per hour
Talantir is seeking a remote contractor to work on evaluating AI chatbots. You will be given coding challenges for AI chatbots and assess their outputs... ...your own schedule. PayPal handles payments; currency conversions are managed by PayPal. #J-18808-Ljbffr...Remote jobHourly payContract workFor contractors- Jobgether is an AI-powered platform matching candidates with hiring companies. This freelance trainer project focuses on evaluating conversational AI through realistic audio interactions conducted remotely, offering flexible hours and independent contractor status. You...Remote jobFor contractorsFreelanceFlexible hours
- Role Title Food Delivery AI Response Evaluator Role Type Contractor Location Remote Our team is engaging Food Delivery AI Response Evaluators to contribute to... ...for improvement. Create illustrative example conversations that reflect authentic food delivery customer interactions...Remote workFor contractorsShift work
$30 per hour
Business Analyst, Educational Rater and Evaluator Review and improve AI-generated educational responses... ...and clear written explanations. This remote US contractor project pays $30 per hour... ...usage and at least 10 relevant conversations about learning, education, research,...Remote workHourly payContract workPart timeFor contractors- Dutch Voice AI Evaluator (Healthcare Front Desk Conversations) About the Role What if your voice could help teach AI how to handle a real phone call to a doctor... ..., and grade the AI's performance. This is a fully remote, flexible contract role for people with clear speech,...Remote workContract workWork at officeFlexible hours
- ...is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded off. This remote role offers flexible hours and allows you to work from...Remote jobWork from homeFlexible hours
$45 - $70 per hour
...users chat with different versions of an AI assistant through their own account, compare... ...background or coding is needed. The remote contract is open worldwide, pays $45 to $... ...Preferred: English proficiency No coding, AI evaluation experience or specific professional...Remote workHourly payContract workWorldwide- ...About the role AI assistants are becoming part of everyday... ...account, engage in everyday conversations, and share your feedback on what... ...preferred experience. Evaluate conversational quality, helpfulness... ...familiar with. Work remotely, with flexibility during the...Remote workHourly payTemporary workPart time
micro1
San Francisco, CA2 days ago $18 per hour
Get paid to spot what AI-generated media gets wrong Hold live conversations with AI voice models, compare image and video... ..., and explain what’s off. Fully remote, flexible hours. Rates vary based... ..., and improve. Through Outlier’s evaluation and feedback loop, your work helps...Remote jobWeekly payFlexible hours- HELP SHAPE THE FUTURE OF AI BY EVALUATING HOW WELL AI ASSISTANTS UNDERSTAND USERS, USE PERSONAL CONTEXT, AND DELIVER HELPFUL CONVERSATIONS. Location: Remote Type: Independent contractor / Part-time Project duration: up to 3 months ABOUT THE ROLE At Anyone AI, we create...Remote workPart timeFor contractors
- Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of a remote setup. You will roleplay live conversations with AI voice models, compare image and video pairs, and explain what’s off in writing. Work remotely on your own schedule...Remote job
- ...Alignerr is seeking Search Quality Evaluators (AI Training) to assess search results, AI-generated answers, and recommendations. This remote, hourly contract offers flexible 10–40 hours per week and the opportunity to contribute to reliable AI information delivery. You...Remote workHourly payContract work10 hours per weekFlexible hours
Alignerr Corp.
United States1 day ago $14.5 per hour
...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies to provide datasets that are... ...optimization or data analysis is beneficial. Seeks a flexible, remote job that can easily fit around other commitments. Pay...Remote workHourly payPart timeImmediate startWork from home10 hours per weekFlexible hoursWelo Data
New York, NY4 days ago- ...Seeking PhD-level quantitative finance experts, the full-time Remote AI Research Evaluator will assess AI-generated financial content and contribute to the evaluation of advanced AI models in a flexible, remote contract role. Key Responsibilities Assessing the factuality...Remote workFull timeContract workFlexible hours
Virtual Vocations Inc
United States9 hours ago $14.5 per hour
...AI Web Search Evaluator Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant,... ...suits you—choose your hours and achieve work-life balance. Remote Work: Enjoy the freedom of working from home anywhere in...Remote workBi-weekly payHourly payPart timeImmediate startWork from homeFlexible hoursWelo Data
United States4 days ago- # Licensed Real Estate Agent - AI Quality Evaluator (Remote - Seattle, WA)Tech Square VenturesReal EstateReal EstateOn-siteLocationSeattle, United... ...chatbot responses for accuracy, humanlike behavior, and conversational quality. Evaluate automatically annotated conversation...Remote jobContract workPart timeFor contractorsLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Conversation Evaluator - Remote. Be the first to apply!
Related searches
- evaluator New York, NY
- work from home web search evaluator New York, NY
- program evaluator New York, NY
- clinical evaluator New York, NY
- nurse evaluator New York, NY
- work from home social media evaluator New York, NY
- ai evaluator New York, NY
- education evaluator New York, NY
- quality evaluator New York, NY
- social media evaluator New York, NY