Data Evaluator - Fully Remote | Upto $120/hr

$120 per hour

Mercor

Remote job

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Software / AI / IT / data Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

Evaluate AI-generated artifacts against domain-specific quality rubrics.
Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .
Provide clear, structured written feedback to improve AI model outputs .
Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
Work independently and asynchronously to meet deadlines.

Qualifications

Must-Have

5+ years of relevant professional experience in Software / AI / IT / data .
Native or professional fluency in English .
Highly proficient in Microsoft Office and Google Workspace , especially Slides .

Preferred

Advanced degree (Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

Upload resume
AI interview based on your resume
Submit form

Resources & Support

For details about the interview process and platform information, please check:
For any help or support, reach out to: View email address on ziprecruiter.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Apply

Vacancy posted 18 days ago

Similar jobs that could be interesting for youBased on the Data Evaluator - Fully Remote | Upto $120/hr in San Francisco, CA vacancy

Journalism Evaluator - Fully Remote | Upto $120/hr
$120 per hour
...Position: Media / journalism / communications Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-... ...with AI research teams to improve training data quality and downstream performance. Work...
Remote job
Data
Contract work
Summer work
Work at office
Mercor
New York, NY
9 days ago
Deck Production Evaluator - Remote | Upto $120/hr
$120 per hour
.... Position: Document/deck production QA Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated... ...with AI research teams to enhance training data quality and performance. Work...
Remote job
Data
Contract work
Summer work
Work at office
Mercor
New York, NY
9 days ago
Language Model Evaluator - Fully Remote | Upto $20/hr Part-time
$20 per hour
...English & Urdu Type Contract Compensation $15-$20/hour Location Remote Role Responsibilities Conduct fact-checking using trusted public sources and external tools. Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and...
Remote job
Data
Contract work
Part time
Summer work
Mercor
New York, NY
1 day ago
Environmental Science Expert - Fully Remote | Upto $120/hr
$120 per hour
...Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated... ...with AI research teams to enhance training data quality and performance. Work...
Remote job
Data
Contract work
Summer work
Work at office
Mercor
San Francisco, CA
18 days ago
Bilingual Evaluator - Fully Remote | Upto $50/hr
$50 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Dutch Audio Generalist Evaluator Expert Type: Contract Compensation: $50/hour Location: Remote Duration: 3–6 months Role Responsibilities Transcribe audio and video with...
Remote job
Contract work
Summer work
Mercor
New York, NY
9 days ago
Certified Residential Appraiser
...through cutting-edge technology and extensive data-supported analysis. This role is ideal for... ...and back-end services like IT and HR) Dedicated quality development resources... ...appraisers work outdoors at construction and remote sites in all seasons and weather, including...
Remote work
Data
Full time
Traineeship
Long distance
True Footage
Milwaukee, WI
3 days ago
Applied Mathematics Specialist - Fully Remote | Upto $100/hr
$100 per hour
...uncovering hidden information from data. This isn't a typical data-... ...compute exact answers from a fully defined setup — testing... ...Linux/terminal environment with remote compute sandboxes Available for... ...Familiarity with benchmark or evaluation design Background in scientific...
Remote work
Data
Obsidian
United States
10 hours ago
Remote Quantitative AI Evaluator & Designer
$60 per hour
...is seeking quantitative professionals to evaluate AI-generated insights and contribute to advancing AI systems. The role is fully remote, offering a flexible schedule with competitive... ...Ideal candidates will have experience in data science, statistical analysis, and...
Remote work
Data
Hourly pay
Flexible hours
DataAnnotation
Nevada, IA
5 days ago
Remote Quantitative AI Evaluator & Designer
$60 per hour
...experienced quantitative professionals to evaluate AI-generated analyses and contribute to the future of AI systems. This fully remote position allows flexibility in scheduling and... ...an impact in shaping AI's reasoning about data and analytics, with competitive hourly pay...
Remote work
Data
Hourly pay
DataAnnotation
Hartford, CT
5 days ago
Remote Quantitative AI Evaluator & Designer
...is seeking quantitative professionals to evaluate AI-generated analyses, solve technical... ...provide feedback on AI systems. This role is fully remote, allowing you to work from anywhere in... ...hourly pay, contributing to the future of AI reasoning about data. #J-18808-Ljbffr...
Remote work
Data
Hourly pay
Flexible hours
DataAnnotation
Jackson, MS
5 days ago
Remote Quant Analyst & AI Evaluator
$40 per hour
...experienced quantitative professionals to work remotely and evaluate AI-generated quantitative analyses. The... ...Candidates should have a background in data science, statistics, or a related field... .... Join to shape the future of AI in a fully remote environment. #J-18808-Ljbffr
Remote work
Data
Hourly pay
Flexible hours
DataAnnotation
California, MO
5 days ago
Remote Quantitative AI Evaluator & Designer
$60 per hour
...AI is seeking quantitative professionals to evaluate AI-generated work and provide insights for model development. This fully remote role allows a flexible schedule and competitive... ...to impact the future of AI systems focused on data and analytics. #J-18808-Ljbffr...
Remote work
Data
Hourly pay
Flexible hours
DataAnnotation
Springfield, IL
1 day ago
Remote Quant Analyst & AI Evaluator
$40 per hour
...experienced quantitative professionals to evaluate AI-generated quantitative work and... ...development of cutting-edge AI systems. This fully remote role offers flexible scheduling and pays... ..., and a background in areas such as data science, statistics, or economics. Help...
Remote work
Data
Flexible hours
DataAnnotation
New York, NY
5 days ago
Remote Quant Analyst & AI Evaluator
$40 per hour
...looking for experienced quantitative professionals to evaluate AI-generated work. This fully remote position allows for a flexible schedule, and projects... ...methods and predictive modeling. Join to help shape future AI systems designed for data reasoning. #J-18808-Ljbffr
Remote work
Data
Hourly pay
Flexible hours
DataAnnotation
Hartford, CT
10 hours ago
Remote Quantitative AI Evaluator & Model Validator
$40 per hour
A data annotation company is seeking professionals in quantitative fields to enhance AI development. This fully remote role allows individuals to set flexible schedules while evaluating AI-generated analyses and solving complex quantitative problems. Candidates should have...
Remote work
Data
Hourly pay
Flexible hours
DataAnnotation
Oregon, WI
4 days ago
Remote Quant Analyst & AI Evaluator
$40 per hour
...seeking experienced quantitative professionals to evaluate AI-generated analyses and provide impactful feedback. The role is fully remote, allowing flexibility in project selection... .... Candidates with strong backgrounds in data science, statistics, or related fields, alongside...
Remote work
Data
Hourly pay
DataAnnotation
Kansas City, MO
1 day ago
AI Data Evaluator Remote, Contract
$80 - $120 per hour
...Mercor is seeking a Software / AI / IT / data Evaluator to join their team remotely. In this role, you will evaluate AI-generated artifacts based on quality... ...Office and Google Workspace. This position offers compensation between $80 and $120 per hour. #J-18808-Ljbffr
Remote work
Data
Hourly pay
Contract work
Work at office
Mercor Inc
San Francisco, CA
1 day ago
Remote Quantitative AI Evaluator & Designer
$60 per hour
...experienced quantitative professionals to evaluate AI-generated work, solve complex problems, and provide critical feedback. This fully remote position allows for flexibility in... ...shape the future of AI systems that reason about data and analytics. #J-18808-Ljbffr...
Remote work
Data
DataAnnotation
Salt Lake City, UT
5 days ago
Remote Quant Analyst & AI Evaluator
$40 per hour
...company is seeking experienced quantitative professionals to evaluate AI-generated quantitative work and solve complex problems. The role is fully remote with a flexible schedule, ideal for those with 2+ years in data science, statistics, or related fields. Responsibilities...
Remote work
Data
Hourly pay
Immediate start
Flexible hours
DataAnnotation
Charleston, WV
5 days ago
Real Estate Expert - Fully Remote | Upto $110/hr
$110 per hour
...Type: Contract Compensation: $90–$110/hour Location: Remote Duration: 3–4 weeks Commitment: 30–40 hours/week... ...deadlines. Collaborate with AI research teams to improve training data quality. Qualifications Must-Have ~4+ years...
Remote job
Data
Contract work
Summer work
Immediate start
Mercor
New York, NY
28 days ago
Regulatory Response Expert - Fully Remote | Upto $120/hr
$120 per hour
...Jack Dorsey . Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific quality...
Remote job
Contract work
Summer work
Work at office
Mercor
San Francisco, CA
17 days ago
Remote Quant Analyst & AI Evaluator
$40 per hour
...seeking experienced quantitative professionals to evaluate AI-generated quantitative work. The role is fully remote, offering flexibility in project selection and... ...Ideal candidates will have practical experience in data science or adjacent fields and at least 2 years of...
Remote work
Data
Hourly pay
Flexible hours
DataAnnotation
Vermont
5 days ago
Remote Quant Analyst & AI Evaluator
$60 per hour
...while enjoying the flexibility of remote work and setting your own... ...the-art AI models on tasks like evaluating AI-generated quantitative... ...how these systems reason about data, models, and scientific problems... ...our platform. Benefits Fully remote: work from anywhere in...
Remote work
Data
Hourly pay
Full time
Flexible hours
DataAnnotation
Topeka, KS
1 day ago
AI Adversarial Specialist - Fully Remote | Upto $22/hr
$22 per hour
...Type: Contract Compensation: $20–$22/hour Location: Remote Role Responsibilities Red team conversational AI models... ...misuse cases, and bias exploitation. Generate high-quality human data. Annotate failures, classify vulnerabilities, and flag systemic...
Remote job
Data
Contract work
Summer work
Mercor
San Francisco, CA
18 days ago
Supply Chain Specialist - Fully Remote | Upto $50/hr Part-time
$50 per hour
...Contract Compensation: $50/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Evaluate the accuracy and depth of AI models in... ...teams to improve model outputs and training data quality. Work independently and asynchronously...
Remote job
Data
Contract work
Part time
Summer work
Mercor
New York, NY
28 days ago
Remote Quantitative AI Evaluator & Trainer
$60 per hour
...firm is seeking quantitative professionals to evaluate AI-generated work and ensure real-world validity. This fully remote role offers flexibility, allowing you to choose... ...hour. Join us to help shape the future of AI systems focused on data and analytics. #J-18808-Ljbffr...
Remote work
Data
Hourly pay
DataAnnotation
Lansing, MI
5 days ago
Machine Learning Expert - Fully Remote | Upto $90/hr
$90 per hour
...Compensation: $75–$90/hour Location: Remote Commitment: 20+ hours/week Role... ..., and completed questionnaires for evaluation. Qualifications Must-Have ~3+ years... ...generative modeling, multilingual experience, or data pipelines. Required Domain Expertise...
Remote job
Data
Contract work
For contractors
Summer work
Mercor
San Francisco, CA
27 days ago
Quantum Physicist - Fully Remote | Upto $90/hr
$90 per hour
...Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Develop challenging... ...innovation. Collaborate with AI labs to create high-quality data for large language models. Evaluate and improve AI model outputs using domain expertise....
Remote job
Data
Contract work
Summer work
Mercor
New York, NY
9 days ago
AI Adversarial Specialist - Fully Remote | Upto $22/hr
$22 per hour
...Type: Contract Compensation: $20–$22/hour Location: Remote Role Responsibilities Red team conversational AI models... ...misuse cases, and bias exploitation. Generate high-quality human data. Annotate failures, classify vulnerabilities, and flag systemic...
Remote job
Data
Contract work
Summer work
Mercor
San Francisco, CA
18 days ago
IT Director - Fully Remote | Upto $100/hr
$100 per hour
...Compensation: $70–$100/hour Location: Remote Commitment: 20+ hours/week Role... ...accurate, well-structured solutions. Evaluate Excel tasks and solutions, providing... ...ensure consistency and accuracy in training data . Qualifications Must-Have ~...
Remote job
Data
Contract work
Summer work
Weekday work
Mercor
San Francisco, CA
24 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Evaluator - Fully Remote | Upto $120/hr. Be the first to apply!