Data Quality Expert - Evaluator - AI Trainer
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data quality / CRM operations Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines and enhance AI model performance .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Data quality / CRM operations .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercor$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... ...success / support operations Evaluator Type: Contract Compensation... ...against domain-specific quality rubrics. Identify factual,... ...Collaborate with subject matter experts to ensure consistency and...SuggestedContract workSummer workWork at officeRemote work- ...contributors for flexible, project-based roles that require a strong background in finance. You will design complex tasks that challenge AI agents and enhance their learning. Ideal candidates have a Bachelor's or Master's degree, extensive experience in finance, and...SuggestedRemote workFlexible hours
$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation... .../week Role Responsibilities Evaluate and compare AI-generated responses to challenging...SuggestedFull timeContract workSummer workImmediate startRemote workFlexible hours$55 per hour
...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is... ...Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or...SuggestedPermanent employmentTemporary workPart timeFreelance10 hours per week$15 per hour
...Get paid to spot what AI-generated media gets... ...improve. Through Outlier's evaluation and feedback loop, your... ...$600M+ Paid to Experts 52 Countries... ...dimensions like adherence, quality, and realism , then writing... ...Additional incentives data is based on payments...SuggestedWeekly payContract workFreelanceInternshipRemote workFlexible hours$55 per hour
...ethically shape the future of AI. What We Do The... ..., connects domain experts with cutting‑edge AI projects... ...systems are tested and evaluated? This is a flexible,... .... Think scattered data, conditional procedures... ...with guidance from our quality team. From creating...Permanent employmentPart timeFreelanceRemote workFlexible hours$55 per hour
...Freelance Chemistry Expert with Python - AI Trainer 1 week ago Be among the first 25 applicants This opportunity is only for candidates currently... ...AI. Define comprehensive scoring criteria to evaluate the accuracy of the AI's answers. Correct the model's...Part timeFreelanceRemote work$60 per hour
...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is... ...Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or...Permanent employmentTemporary workPart timeFreelance10 hours per week$70 - $110 per hour
...technical talent with leading AI research labs.... ...Role Responsibilities Evaluate AI-generated project plans... ...incident responses for quality and accuracy.... ...technical support. Provide expert feedback on team... ...activities across electronic data processing, information...Hourly payContract workSummer workImmediate startRemote work$55 per hour
...power of collective intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects specialists... ...seeking experienced Civil Engineers with Python skills to train and evaluate AI models on realistic civil engineering problems. This role...Part timeFreelanceRemote workFlexible hours$15 per hour
...Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts work on a variety of projects, from generating training data to evaluating the performance of models. About the opportunity... ...dimensions like adherence, quality, and realism, then writing a...Hourly payContract workFor contractorsWork experience placementFreelanceInternshipRemote workFlexible hoursNight shift- ...analytical and critical-thinking skills to support AI and data-focused projects. The role involves reviewing, evaluating, and annotating information across different topics while maintaining high accuracy and quality. Key Responsibilities Analyze, review, and annotate...Remote jobFor contractors
$15 per hour
...Spanish language?could help improve the AI.? ?? WHAT YOU’LL DO ? Review, evaluate, and validate AI-generated content and data according to project guidelines. Compare... ...the most accurate, relevant, or high-quality result. Identify errors, inconsistencies...Hourly payFreelanceWork at officeRemote work$20.3 per hour
...Job Description Job Description: What if your knowledge English language?could help improve the AI.? ?? WHAT YOU’LL DO ? Evaluate the aesthetic quality, readability, and overall polish of digital map designs. Assess user-focused elements like viewport...Hourly payContract workFreelanceImmediate startRemote work$15 per hour
...Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts work on a variety of projects, from generating training data to evaluating the performance of models. About the opportunity... ...dimensions like adherence, quality, and realism, then writing a...Hourly payContract workFor contractorsWork experience placementFreelanceInternshipRemote workNight shift$55 - $65 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Location: Remote Role Responsibilities Evaluate AI work product in retail and pharmacy fields... ...Comfort with spreadsheets or PDFs for data reconciliation. Start Date ~...Contract workSummer workRemote work$15 per hour
...Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will engage... ...weekly. Prior experience and clear written communication are valued as you contribute to the evaluation and feedback loop. #J-18808-LjbffrHourly payWeekly payRemote workFlexible hours$15 per hour
...Outlier is seeking detail-oriented contributors to review AI-generated media remotely. You will engage in live conversations with AI voice models, compare media pairs, and assess adherence to prompts with written explanations. The role offers flexible hours and a pay...Hourly payWeekly payRemote workFlexible hours- A tech innovator in AI solutions is seeking a Freelance AI Trainer specializing in Civil Engineering and Python. This part-time role is fully remote and involves designing rigorous engineering problems, evaluating AI solutions, and utilizing Python for calculations. Candidates...Part timeFreelanceRemote work
$60 - $100 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Marketing Expert — Creator & Influencer (AI Agent Environments... ...wrong ones. Review AI agent attempts and evaluate them against established standards....Contract workSummer workRemote work$60 - $100 per hour
...technical talent with leading AI research labs. Headquartered in... .... Position: Marketing Expert — Lifecycle (AI Agent Environments... ...AI agent attempts and evaluate them against your standards.... ...issues from messy or conflicting data, prioritize, make tradeoffs, plan...Contract workSummer workRemote work$55 - $80 per hour
...technical talent with leading AI research labs. Headquartered in... ...PhDs and Technical Domain Experts Type: Contract Compensation... ...models . Create high-quality data by developing challenging problems in your domain. Evaluate and improve AI model performance...Contract workSummer workRemote work$92 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...bad debt management, and patient payment plan administration. Evaluate AI-generated patient financial communication drafts, payment plan...Contract workSummer workRemote work- ...Software Engineers to support an AI training project by creating... ...learning environments that evaluate AI models on complex software... ...understanding of algorithms and data structures . Experience... ...apply. Availability Selected experts should be prepared to begin...Remote jobFor contractors
- ...Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare generated images and videos, and explain in writing what looked or sounded wrong. This is remote and...Weekly payFreelanceRemote workFlexible hours
$15 per hour
...Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain in writing what looked or sounded off, all remotely and on your own schedule. Paid up...Remote workWork from homeFlexible hours- ...Bentley, Prada, Versace, and more. About the Role As a luxury brand evaluator, you will step into the world of luxury to discreetly assess... ...of your home. Observe carefully - check the ambiance, service quality, and overall customer experience. Provide honest feedback -...Contract workWorldwideFlexible hours
$55 per hour
...ethically shape the future of AI. What We Do The... ..., connects domain experts with cutting‑edge AI projects... ...systems are tested and evaluated? This is a flexible,... .... Think scattered data, conditional procedures... ...with guidance from our quality team. From creating...Permanent employmentPart timeFreelanceRemote workFlexible hours$80 per hour
...intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects... ...maintain automated tests to ensure the quality, performance, and reliability of Kotlin... ...Monitor app behavior in production and use data‑driven insights to guide testing priorities...Part timeFreelanceRemote work$90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Study Domain Expert — Judge Calibration — Sales Type:... ...independently to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have ~5+...Hourly payContract workFor contractorsSummer workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Quality Expert - Evaluator - AI Trainer. Be the first to apply!



