Data Analysis Expert - Evaluator - AI Trainer
$80 - $120 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data analysis / quantitative readouts Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI-generated work products.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines while ensuring domain quality.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Data analysis / quantitative readouts .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace, especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Data Analysis Expert - Evaluator - AI Trainer in New York, NY vacancy
$55 per hour
...ethically shape the future of AI. What We Do The Mindrift... ...you join the platform as a Data Science AI Trainer, you'll have the opportunity... ...data processing, statistical analysis, feature engineering, predictive... ..., statsmodels). You are an expert in statistical analysis and...SuggestedPart timeFreelanceRemote work$70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ..., and Jack Dorsey. Position: Generalist Expert Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to ensure accuracy and...SuggestedContract workSummer workRemote work$20 - $80 per hour
Role Overview Help improve next-generation AI systems by supplying precise, real-world evaluation, annotation, and feedback. This remote contractor role focuses... .... Exceptional attention to detail and accuracy in data annotation and content evaluation. Strong critical-...SuggestedHourly payContract workFor contractorsRemote work- Mercor is seeking a Materials Science PhD Coding Expert for a six-week remote contract. The role demands deep knowledge... ...science and the ability to craft prompts to test AI models. Responsibilities include sourcing data from papers and open sources, building grading...SuggestedRemote jobContract work
$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Role Details Position: Material Science PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration:...SuggestedContract workSummer workImmediate startRemote work$50 per hour
Mercor is seeking experienced scientists/engineers fluent in German to train and evaluate AI agents on realistic professional tasks. You will build workspaces and files, write prompts, and create grading rubrics based on real stem work as it's done in Germany. The role...Remote jobHourly pay$11 - $30.65 per hour
Meridial is seeking contractors to evaluate advanced agentic audio models by simulating realistic customer service interactions across multiple domains. You will contribute to developing diverse datasets and assess model performance using various metrics. The role requires...Remote jobHourly payFor contractors- About the Opportunity A leading AI research organization is... ...tasks. This project focuses on evaluating how well AI systems handle personalized... ...Willingness to sign a data-share consent form via DocuSign... ...Chromebooks are not supported Experts added to the project will begin...Trial period
$40 per hour
A leading company in AI training solutions is seeking a Content Developer specialized... ...involves enhancing AI models by providing and evaluating complex physics problems. Ideal... ...hour, makes this a great opportunity for experts in the field. #J-18808-Ljbffr DataAnnotationRemote jobHourly pay- Feitong Buke is hiring a Lead AI Trainer to oversee and enhance the quality of AI model dialogues with users. The role involves reviewing datasets for accuracy, providing feedback to annotators, and validating AI model outputs to ensure high production quality. Candidates...Remote jobFull time
$16 - $28 per hour
...Media Annotation - Freelance AI Trainer Project United States of America... .... With high-quality training data, tomorrow's AI can... ...to our prompt engineering and evaluation metrics. No formal degree or... ...content moderation, digital media analysis, or community-based projects...Hourly payContract workFor contractorsFreelanceImmediate startRemote work$200k - $300k
...(HRT) is seeking a Research Data Expert to join our Data team. Data is... ...forward through rigorous data analysis and delivery. You will also... ...sourcing team to identify and evaluate new data procurement opportunitiesAnalyze... ....Please be advised: Use of AI tools by an applicant during...Work at officeLocal areaImmediate startHudson River Trading
New York, NY4 days ago$160k - $210k
BVAL (Bloomberg's Evaluated Pricing Service) Evaluator - US Agency Structured... ..., you will serve as a sector expert responsible for delivering accurate, high-quality pricing data to our clients. In this role,... ...framework, and relative value analysis to produce accurate pricing...Price workTemporary workFor contractorsWork experience placementBloomberg
New York, NY4 days ago- ...Are you a literature expert eager to shape the future of AI? Large-scale... ...high-quality training data, tomorrow’s AI can help... ...access to literary analysis, support education,... ...accuracy and coherence; evaluate the depth and validity... ...– Freelance AI Trainer ProjectEmployment type...Hourly payFor contractorsFreelance
Agency.com
New York, NY4 days ago $125 per hour
...and bioinformaticians to help train AI models. You’ll design realistic analysis tasks from your own practice, run... ...can talk fluently about biological data analysis. What they can’t yet do reliably... ...DataAnnotation is where 100k+ experts train the world’s leading AI models...Full timeRemote workFlexible hoursDataAnnotation
New York, NY1 day ago$24 per hour
...another player in the AI space - we are building... ...pool of quality human data in the world. Over 35,... ...Speakers from India to act as evaluators. AI models are now... ...AI models. Sentiment Analysis: assessing the model’s... ...platform to join as an expert participant Joining our...Hourly payContract workFreelanceRemote workWork from homeFlexible hoursShift work- Meridial is seeking a Japanese Language Data Contributor for a freelance AI Trainer Project, focusing on shaping the... ...through data contribution and analysis. The position is suitable for entry... ...or linguistics, who are eager to evaluate AI systems and improve communication...Remote jobHourly payFreelanceWorldwide
- ...Specialist - Freelance AI Trainer Project World Wide -... ...Arabic (Emirati) language expert eager to shape the... ...high-quality training data, tomorrow's AI can democratize... ...engineering and evaluation metrics. A degree in... ...or hands-on linguistic analysis projects signal fit. Clear...Hourly payContract workFor contractorsFreelanceImmediate startRemote work
- ...A leading AI company is seeking a freelancer with strong analytical and multilingual skills, specifically in English and Korean. In this role, you will help fine-tune large language models by answering analytical questions and providing explanations to improve model accuracy...FreelanceRemote work
Turing Inc
New York, NY21 hours ago $20 per hour
Prolific is seeking a Sales Professional to join our Expert Network for AI model training and evaluation. You will be paid to contribute real sales and business development expertise via paid tasks, with a quick screening test if selected. All work is remote and ad hoc...Remote jobHourly payFreelance- ...you a mathematics expert fluent in Swedish,... ...shape the future of AI? Large-scale... ...-quality training data, tomorrow’s AI can... ...real and complex analysis, optimization theory... ...prompt engineering and evaluation metrics. A master’... ...in Swedish) - AI Trainer Employment Type...Hourly payContract workFor contractorsFreelanceRemote work
$60 per hour
...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is... ...recent change; Design material change impact analysis cases: identifying which internal policies, customer...Hourly payPermanent employmentTemporary workPart timeFreelance10 hours per week- ...to shape the future of AI? Large-scale language models... ...high-quality training data, tomorrow's AI can help... ..., support planning and analysis, and assist... ...strategy-based exercises; evaluate logical consistency and... ...Specialist - Freelance AI Trainer Project Employment type...Hourly payContract workFor contractorsFreelanceRemote work
- ...join our team.KPMG is currently seeking a Data Scientist to join our Audit Technology Alliance... ...implement core components of generative AI solutions, including RAG pipelines and... ...machine learning concepts and Python for data analysis; familiarity with LLMs and frameworks like...InternshipH1bLocal area
KPMG
New York, NY6 days ago $8 - $65 per hour
Are you a STEM expert fluent in Swedish, eager... ...the future of AI? Large-scale language... ...-quality training data, tomorrow's AI can... ...engineering and evaluation metrics. A bachelor... ...experience, data analysis projects, or coding... ...in Swedish) - AI Trainer Employment type: Contract...Hourly payContract workFor contractorsFreelanceRemote work- ...a Legal Counsel Specialist to support AI trainer projects on a freelance basis. The role... ...substantive legal dialogue with AI models, evaluating responses for accuracy and rigor, and... ...statutory interpretation and precedent analysis. Applicants must hold a JD and an...Remote jobFreelance
- Social Media Content Evaluator What if your social media instincts and cultural awareness could directly influence how AI communicates with millions of people online? We're looking... ...journalism, media studies, or cultural analysis Awareness of brand voice, audience targeting...Hourly payOngoing contractContract workFreelanceRemote workFlexible hours
$77k - $202k
...AI & GenAI Data Scientist-Senior Associate The Opportunity: As an AI & GenAI Data Scientist-Senior Associate you will leverage advanced analytics, statistical modeling, exploratory analysis, and data visualization to help solve business problems and inform decisions...Shift workPwC (US)
New York, NY2 days ago$116.2k - $229.1k
...ends on 02/28/2027Work you'll do· As a Supply Chain Optimization Data Scientist you will be responsible for· Define decision... ...solutions using Python, SQL, data pipelines, and enterprise systems.· Evaluate scenarios and trade-offs to quantify impacts on service, cost, capacity...Local areaDeloitte
New York, NY4 days ago- A talent marketplace is seeking soccer experts to evaluate live soccer games. The role involves assessing AI-generated commentary, scoring performance, and providing feedback. Qualified candidates will have deep expertise in soccer, strong analytical and communication skills...Contract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Analysis Expert - Evaluator - AI Trainer. Be the first to apply!
Related searches
- data science associate New York, NY
- data integration specialist New York, NY
- data entry associate New York, NY
- research data associate New York, NY
- data specialist New York, NY
- data visualization specialist New York, NY
- oncology data specialist New York, NY
- data conversion specialist New York, NY
- provider data specialist New York, NY
- data migration specialist New York, NY