Data Quality Expert - Evaluator
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data quality / CRM operations Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines and enhance AI model performance .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Data quality / CRM operations .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Data Quality Expert - Evaluator in New York, NY vacancy
$160k - $210k
BVAL (Bloomberg's Evaluated Pricing Service) Evaluator - US Agency Structured Products Location New... ...a BVAL Evaluator, you will serve as a sector expert responsible for delivering accurate, high-quality pricing data to our clients. In this role, you’ll apply your...SuggestedPrice workTemporary workFor contractorsWork experience placementBloomberg
New York, NY1 day ago$37.5 per hour
...programming. We are looking to create a golden data set for AI generated ad copy for various... ...In this role you will be responsible for evaluating advertising copy generated by a large... ...ensure that it meets their benchmark in quality, structure, brand voice adherence, brand...SuggestedContract workTemporary workRemote workTEKsystems
New York, NY4 days ago- ...MERIT Beauty is seeking Turkish-speaking annotators for a contract role evaluating AI-generated content. You will review content for coherence, consistency, and alignment with real-world expectations in Turkish. The ideal candidates are native or fluent Turkish speakers...SuggestedContract workTemporary workImmediate startRemote work
MERIT Beauty
New York, NY2 days ago - ...We are seeking a dedicated and skilled Psychological Evaluator to join our team in New York City. The ideal candidate will hold an active... ...EIP guidelines and protocols. Gather and analyze clinical data from multiple sources including interviews, observations, and standardized...Suggested
Roots To Grow
New York, NY2 days ago $25 - $35 per hour
...great opportunity to earn supplemental or full-time income on your own schedule. FAR Inspections is a leading provider of property data for mortgage lenders nationwide. Based in Reno, NV, we have a 12-year track record of excellence and stability in the mortgage field...SuggestedHourly payPrice workExtra incomeFull timeFor contractorsLive inFlexible hoursFAR Inspections
New York, NY22 hours ago- ...millions of securities daily. Your contributions directly impact the quality and reliability of valuations used by market participants... ..., entailing start-to-end responsibilities. This includes market data collection and analysis, price generation, quality control, and...Daily paidWorldwide
JP Morgan Chase
New York, NY5 days ago - A leading evaluation firm is seeking a Freelance Luxury Brand Evaluator in NYC Metro. In this entry-level role, you'll choose assignments, evaluate luxury stores, and provide feedback on customer experiences. Ideal candidates are passionate about luxury brands and possess...Freelance
CXG
New York, NY11 hours ago - Social Media Content Evaluator What if your social media instincts and cultural awareness could directly influence how AI communicates with millions of people online? We're looking for Social Media Content Evaluators to review and rate AI-generated posts, captions, and...Hourly payOngoing contractContract workFreelanceRemote workFlexible hours
$75k - $80k
...Position Summary: The Vocational Evaluation Supervisor manages and supervises the Vocational Evaluation team, oversees the Individualized... ...Administration. Ensures that all required statistical data and reports are prepared accurately and submitted in a timely manner...Fedcap Rehabilitation Services
New York, NY1 day ago- Obsidian is hiring expert Evaluators in Data quality / CRM operations to assess AI-generated work products for accuracy and quality. Candidates must have 5+ years of relevant experience and fluency in English. This role involves evaluating artifacts, identifying errors,...Remote jobWork at office
$80 - $120 per hour
AI Trainer Jobs is seeking a remote Document/Deck production QA Evaluator to review document annotation prompts and responses against AuraOne's quality rubric. You will compare outputs, label edge cases, and provide structured feedback for retraining the modeling team....Remote jobHourly payFor contractorsFlexible hours$40 per hour
DataAnnotation is recruiting contributors to evaluate AI on Slovak translation, localization, and cultural nuance across real projects. You will review frontier models, rate quality, and help train the next generation of AI with your linguistic judgment. You’ll work on...Remote jobFlexible hours$25 - $35 per hour
...great opportunity to earn supplemental or full-time income on your own schedule. FAR Inspections is a leading provider of property data for mortgage lenders nationwide. Based in Reno, NV, we have a 12-year track record of excellence and stability in the mortgage field...Hourly payPrice workExtra incomeFull timeFor contractorsLive inFlexible hoursFar Inspections
New York, NY1 day ago$18 per hour
RWS in the United States is seeking AI Linguistic Evaluators to assess Tamil-language outputs for a short-term, remote collaboration. This freelance role offers flexible work with an immediate start and a rate of 18 USD per hour. You will interact with an AI assistant,...Remote jobHourly payTemporary workFreelanceImmediate startFlexible hours- Obsidian is hiring expert Evaluators in Cybersecurity / IT GRC to review and assess AI-generated work products for accuracy and quality. This remote, hourly engagement requires 5+ years of professional experience and fluency in English. The ideal candidates will be proficient...Remote jobHourly payWork at office
- An educational institution is seeking Psychological Evaluators to assess the proficiency of students and determine placement and program eligibility. The ideal candidates must hold a Master's in Psychology and NYSED Certification as a School Psychologist. Responsibilities...
- AuraOne is seeking a Biology / environmental science Evaluator to remotely review AI outputs, reproduce key steps, and document correct... ...scientific rigor and reproducibility across biology reasoning and data-driven workflows. Qualified candidates bring PhD/postdoc or...Remote jobFor contractors
$100 per hour
...Description WELLBOUND Certified Home Health Agency is seeking a dedicated Physical Therapist (PT) Field Evaluator to join our growing team. In this role, you will deliver high-quality therapeutic services that support patients’ mobility, self-care, cognition, and overall...Work from homeService Providers
New York, NY21 days ago- Mercor is seeking a contractor to evaluate AI-generated artifacts, using domain... ...to assess accuracy and presentation quality. You will review documents,... ...candidates have 5+ years in Software/AI/IT/data, strong English fluency, and expert-level Microsoft Office and Google...Remote jobContract workFor contractorsWork at officeFlexible hours
- ESR Healthcare is seeking a highly qualified bilingual mental health expert for a remote contractor role. The position involves evaluating AI-generated psychological content, developing data sets for model training, and providing insights to improve AI responses in clinical...Remote jobFor contractors
$75 per hour
...Role Responsibilities Develop and deliver sociology content through AI training initiatives for postsecondary education. Evaluate and review AI-generated coursework, assignments, and simulated academic papers. Create lectures, learning modules, and case studies...Hourly payContract workRemote workCrossing Hurdles
New York, NY3 days ago- Obsidian is seeking experienced Evaluators skilled in Data analysis / quantitative readouts to review AI-generated outputs for quality and accuracy. This role is fully remote and involves providing expert feedback on various formats such as documents and slides. Candidates...Remote jobWork at office
- To support a short-term AI project, the freelance AI Linguistic Evaluator - Bengali will evaluate AI-generated content for linguistic... ...assistant in Bengali and translate prompts from English Evaluate the quality of AI-generated responses according to project guidelines...Temporary workFreelanceRemote workFlexible hours
$80 - $120 per hour
AuraOne is seeking a remote Pricing / ROI / revenue economics Evaluator to review prompts and model outputs against our quality rubric. You will compare paired responses, label edge cases, and provide structured feedback to retrain the model. As an independent contractor...Remote jobHourly payFor contractors10 hours per week- To support a short-term AI project, the freelance AI Linguistic Evaluator in Tamil will evaluate AI-generated content, assess linguistic... ...performance Translate prompts from English into Tamil and assess the quality of AI-generated responses Provide structured evaluations and...Temporary workFreelanceRemote workFlexible hours
- RWS - TrainAI is seeking an AI Linguistic Evaluator for Telugu to work remotely on a freelance contract. The role involves evaluating AI... ...into Telugu, and applying project guidelines to assess linguistic quality and cultural relevance. You'll collaborate asynchronously,...Remote jobContract workFreelanceImmediate startFlexible hours
- YO AI Labs is seeking a Thai Bilingual Expert to support an AI training project by evaluating Thai audio for fluency, pronunciation, and linguistic accuracy. This remote contractor role requires native Thai and English at B2 or higher, plus strong written and verbal communication...Remote jobFor contractors
$90 per hour
...Compensation: $70-$90/hour Location: Remote Role Responsibilities Evaluate the quality and correctness of AI-assisted software-development traces to... ...teams to ensure consistency and relevance in training data. Work independently and asynchronously to meet deadlines while...Remote jobContract workSummer work$90 per hour
...Dorsey . Position: SWE-Bench Task Auditor Type: Contract Compensation: $70-$90/hour Location: Remote Role Responsibilities Evaluate the quality, correctness, and reproducibility of software-engineering benchmark tasks . Assess repository-level tasks, reference patches...Remote jobContract workSummer work$16 per hour
AI Linguistic Evaluator - Tamil (India) Toronto RWS - TrainAI Temporary/Contract Remote We are looking for AI Linguistic Evaluators... ...of Tamil with strong English skills and a keen eye for language quality?Join a remote AI project where you'll evaluate AI-generated...Remote jobTemporary workFreelanceImmediate startFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Quality Expert - Evaluator. Be the first to apply!
Related searches
- data quality specialist New York, NY
- program evaluator New York, NY
- quality evaluator New York, NY
- evaluator New York, NY
- social media evaluator New York, NY
- education evaluator New York, NY
- ai evaluator New York, NY
- clinical evaluator New York, NY
- web search evaluator New York, NY
- ads evaluator New York, NY