Data Quality Expert - Evaluator - AI Trainer
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data quality / CRM operations Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines and enhance AI model performance .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Data quality / CRM operations .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Data Quality Expert - Evaluator - AI Trainer in Houston, TX vacancy
$60 per hour
...seeking part-time legal consultants to engage in project-based AI opportunities. Ideal candidates will have a law degree and at least... ...in the US. Tasks involve generating challenges for AI, evaluating solutions, and improving AI reasoning. The compensation is competitive...SuggestedPart timeFreelance10 hours per week$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... ...: Process improvement / SOPs Evaluator Type: Contract... ...artifacts against domain-specific quality rubrics. Identify factual,... ...Collaborate with subject matter experts to ensure consistency and quality...SuggestedContract workSummer workWork at officeRemote workMercor
Houston, TXa month ago$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $... ...generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic,...SuggestedContract workSummer workWork at officeRemote workMercor
Houston, TX7 days ago- ...contributors for flexible, project-based roles that require a strong background in finance. You will design complex tasks that challenge AI agents and enhance their learning. Ideal candidates have a Bachelor's or Master's degree, extensive experience in finance, and...SuggestedRemote jobFlexible hours
$55 per hour
...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is... ...Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or...SuggestedPermanent employmentTemporary workPart timeFreelance10 hours per weekMind Rift
Houston, TX5 days ago- Toloka is seeking online annotators to join AI-related projects, rating content, evaluating factual accuracy, and comparing responses as projects become available... ...to detail and communication are essential for success. #J-18808-Ljbffr Mindrift Data Annotation ProjectsRemote jobPart timeFreelance
$50 per hour
...of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects... ...typically: Code generation and code review Prompt evaluation and complex data annotation Training and evaluation of large language models...Remote jobFull timePart timeFreelanceMindrift
Houston, TX1 day ago$55 per hour
...power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists... ...that challenge AI. Define comprehensive scoring criteria to evaluate the accuracy of the AI’s answers. Correct the model’s responses...Remote jobFull timePart timeFreelanceMindrift
Houston, TX1 day ago$60 per hour
...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is... ...Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or...Permanent employmentTemporary workPart timeFreelance10 hours per weekMind Rift
Houston, TX6 hours ago- Toloka is seeking a part-time, remote freelance annotator to review data, label content, and flag issues across AI-related projects. Tasks are project-based and posted when active, with compensation levels determined by scope and expertise. This role offers a flexible...Remote jobPart timeFreelanceFlexible hours
$24 per hour
...Prolific is not just another player in the AI space - we are building the biggest pool of quality human data in the world. AI Trainer - Advanced Telugu Fluency Over 35,000 AI... ...seeking Fluent Telugu Speakers to act as evaluators. AI models are now learning to...Shift work- A leading AI project company is seeking annotators for freelance, part-time remote work. You will be responsible for reviewing and labeling data across various projects. Candidates should have at least a Bachelor's degree, be proficient in Portuguese, and have strong English...Remote jobPart timeFreelanceFlexible hours
$23 per hour
...Annotators connects individuals with Generative AI projects from leading tech innovators.... ...such as rating AI-generated content, evaluating factual accuracy, or comparing responses... ...Responsibilities Carefully review provided data (text, images, or videos) Label or...Part timeFreelanceRemote work- ...seeking experienced Adult Inpatient Nurses (RNs) to train and evaluate AI systems used in clinical settings. You will translate bedside... ...annotate nursing assessments, review AI outputs, and provide expert insights while working with technical teams to refine guidelines...
- Mercor in Houston, TX, is seeking experienced Adult Inpatient Nurses (RNs) to help train and evaluate AI systems used in clinical settings. This role leverages frontline nursing expertise to improve AI accuracy, safety, and reliability through structured feedback on real...
- Mercor is working with a leading AI research lab to improve the capabilities of next-... ...management managers, and physician advisors — to evaluate AI tools designed to enhance clinical... ...align UM performance with financial and quality objectives. Annotate AI outputs and...Night shift
$1,150 - $1,450 per month
...Mercor is partnering with leading AI labs on Project Atlas — an... ...frontier AI agents are trained and evaluated in. We’re seeking experienced... ...with other pharma and biotech experts to design the environment,... ...Competitive and based on task quality (~$1,150 - $1,450 per completed...Hourly payFull time$55 per hour
...ethically shape the future of AI. What We Do The... ...Toloka, connects domain experts with cutting‑edge AI... ...systems are tested and evaluated? This is a flexible, project... .... Think scattered data, conditional procedures... ...with guidance from our quality team. From creating training...Permanent employmentPart timeFreelanceRemote workFlexible hours$55 per hour
Freelance Chemistry Expert with Python - AI Trainer 1 week ago Be among the first 25 applicants This opportunity is only for candidates currently... ...challenge AI. Define comprehensive scoring criteria to evaluate the accuracy of the AI's answers. Correct the model's responses...Part timeFreelanceRemote work- YO AI Labs is seeking a remote Lawyer contractor to contribute legal expertise to AI training projects. You will grow and refine high-quality legal content, including memoranda and contracts, for real-world AI applications, collaborating with a multidisciplinary team....Remote jobFor contractorsFlexible hours
- Obsidian is seeking experienced professionals to build realistic enterprise environments for AI training on Project Atlas. You will leverage your expertise from pharma and biotech to create high-fidelity environments simulating regulated enterprise workflows. Ideal candidates...
$76 per hour
What This Opportunity Involves Design original computational physics problems that simulate real physics research workflows; Create problems requiring Python programming to solve (using Numpy, SciPy, Sympy); Ensure problems are computationally intensive and cannot be...Hourly payFreelance10 hours per week- Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. The AI Trainer - Writer role involves shaping how models understand and generate human-like text, going beyond traditional...Temporary workPart timeFreelance10 hours per week
$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... .../ vendor management Evaluator Type: Contract Compensation... ...artifacts against domain-specific quality rubrics. Identify factual,... ...teams to enhance training data quality. Qualifications...Contract workSummer workWork at officeRemote workMercor
Houston, TX7 days ago$70 - $100 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Procurement Expert Type: Contract Compensation: $7... ...terms against realistic company reference data. Consolidate multi-lens reviews (finance...Contract workSummer workRemote workMercor
Houston, TX10 days ago$100 per hour
...technical talent with leading AI research labs.... ...Dorsey . Position: Zendesk Expert Type: Contract Compensation... ...Role Responsibilities Evaluate the effectiveness of... ...teams to refine AI training data and ensure high-quality performance. Work independently...Contract workSummer workRemote workMercor
Houston, TXa month ago- ...YO AI Labs in the United States is seeking a Hematology Expert to contribute clinical expertise to a healthcare AI project. Remote contractor role evaluating clinical content, reviewing trial data, and providing expert medical judgment. Candidates should hold board...Remote jobFor contractors
$55 per hour
Freelance AI Trainer - Civil Engineering & Python 4 days ago Be among the first 25 applicants This opportunity is only for candidates... ...seeking experienced Civil Engineers with Python skills to train and evaluate AI models on realistic civil engineering problems. This role...Part timeFreelanceRemote workFlexible hours$60 per hour
A leading AI development firm is seeking a Freelance Software Developer (Kotlin) to contribute to AI training projects. The role involves generating prompts, evaluating AI responses, and leveraging Kotlin development expertise. Candidates should have a degree in Computer...Remote jobHourly payFreelanceFlexible hours- Computational Astrophysics & Cosmology Expert About the Project We're... ...to test how well advanced AI systems can solve hard scientific... ...hidden information from data. This isn't a typical data-labeling... ...Familiarity with benchmark or evaluation design Background in...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Quality Expert - Evaluator - AI Trainer. Be the first to apply!
