Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Analysis Expert - Evaluator - AI Trainer

$80 - $120 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Data analysis / quantitative readouts Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
  • Provide clear, structured written feedback to improve AI-generated work products.
  • Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
  • Work independently and asynchronously to meet deadlines while ensuring domain quality.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Data analysis / quantitative readouts .
  • Native or professional fluency in English .
  • Highly proficient in Microsoft Office and Google Workspace, especially Slides .

Preferred

  • Advanced degree (Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#hiringmercor
Vacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the Data Analysis Expert - Evaluator - AI Trainer in New York, NY vacancy
  •  ...About the role We are hiring expert Evaluators in Data analysis / quantitative readouts to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise... 
    Suggested
    Hourly pay
    Work at office
    Remote work

    Mercor Inc

    New York, NY
    2 days ago
  • About the Opportunity A leading AI research organization is...  ...tasks. This project focuses on evaluating how well AI systems handle personalized...  ...Willingness to sign a data-share consent form via DocuSign...  ...Chromebooks are not supported Experts added to the project will begin... 
    Suggested
    Trial period

    Obsidian

    New York, NY
    4 days ago
  • $11 - $30.65 per hour

    Meridial is seeking contractors to evaluate advanced agentic audio models by simulating realistic customer service interactions across multiple domains. You will contribute to developing diverse datasets and assess model performance using various metrics. The role requires... 
    Suggested
    Remote job
    Hourly pay
    For contractors

    Meridial

    New York, NY
    5 days ago
  • $160k - $210k

    BVAL (Bloomberg's Evaluated Pricing Service) Evaluator - US Agency Structured...  ..., you will serve as a sector expert responsible for delivering accurate, high-quality pricing data to our clients. In this role,...  ...framework, and relative value analysis to produce accurate pricing... 
    Suggested
    Price work
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    1 day ago
  • $24 per hour

     ...another player in the AI space - we are building...  ...pool of quality human data in the world. Over 35,...  ...Speakers from India to act as evaluators. AI models are now...  ...AI models. Sentiment Analysis: assessing the model’s...  ...platform to join as an expert participant Joining our... 
    Suggested
    Hourly pay
    Contract work
    Freelance
    Remote work
    Work from home
    Flexible hours
    Shift work

    Prolific

    New York, NY
    3 days ago
  • $16 - $28 per hour

     ...Media Annotation - Freelance AI Trainer Project United States of America...  .... With high-quality training data, tomorrow's AI can...  ...to our prompt engineering and evaluation metrics. No formal degree or...  ...content moderation, digital media analysis, or community-based projects... 
    Hourly pay
    Contract work
    For contractors
    Freelance
    Immediate start
    Remote work

    Meridial

    New York, NY
    1 day ago
  •  ...Are you a literature expert eager to shape the future of AI? Large-scale...  ...high-quality training data, tomorrow's AI can help...  ...access to literary analysis, support education,...  ...accuracy and coherence; evaluate the depth and validity...  ...- Freelance AI Trainer Project Employment... 
    Hourly pay
    Contract work
    For contractors
    Freelance
    Remote work

    Invisible Technologies Inc. Defunct

    New York, NY
    2 days ago
  • $200k - $300k

     ...Trading (HRT) is seeking aResearch Data Expert to join our Data team. Data...  ...through rigorous data analysis and delivery. You will also manage...  ...team to identify and evaluate new data procurement opportunities...  ...you.Please be advised: Use of AI tools by an applicant during... 
    Work at office
    Local area
    Immediate start

    Hudson River Trading

    New York, NY
    9 hours ago
  •  ...Options (Vanilla, Mid-Curve) for multiple market closes, entailing start-to-end responsibilities. This includes market data collection and analysis, price generation, quality control, and client interaction.Continuously improve product and service quality through daily... 
    Daily paid
    Worldwide

    JP Morgan Chase

    New York, NY
    9 hours ago
  • $14.5 per hour

     ...Join to apply for the AI Web Search Evaluator role at Welo Data Welo Data works with technology companies...  ...over 500,000 AI training and domain experts. As a Web Search Evaluator you...  ...search engine evaluation, or data analysis is a plus, but not essential.... 
    Hourly pay
    Part time
    Immediate start
    Remote work
    Work from home
    10 hours per week
    Flexible hours

    Welo Data

    New York, NY
    5 days ago
  •  ...you a mathematics expert fluent in Swedish,...  ...shape the future of AI? Large‑scale...  ...‑quality training data, tomorrow’s AI can...  ...real and complex analysis, optimization theory...  ...prompt engineering and evaluation metrics. A master’...  ...in Swedish) - AI Trainer Employment type:... 
    Hourly pay
    Contract work
    For contractors
    Freelance
    Remote work

    Invisible Technologies Inc.

    New York, NY
    3 days ago
  • $8 - $65 per hour

    Are you a STEM expert fluent in Indonesian,...  ...shape the future of AI? Large-scale...  ...-quality training data, tomorrow’s AI can...  ...prompt engineering and evaluation metrics. A...  ...experience, data analysis projects, or coding...  ...Indonesian) - AI Trainer Employment type: Contract... 
    Hourly pay
    Contract work
    For contractors
    Freelance
    Remote work

    Invisible Technologies Inc.

    New York, NY
    3 days ago
  •  ...manage 837 file transmissions to state agencies and oversee responses to ensure complete and error-free submissions. The role focuses on data integrity, error correction, and compliance with state requirements. 40 hours weekly, full-time employment with a comprehensive... 
    Full time

    Careerwebsite

    New York, NY
    2 days ago
  •  ...seeking a Compensation Analyst to lead day-to-day compensation analysis, market pricing, and job evaluation for a multi-entity workforce. The role demands independent judgment, policy adherence, and precise data handling. The successful candidate will develop market-based... 

    Building Service 32BJ Benefit Funds

    New York, NY
    4 days ago
  •  ...requires strong analytical abilities. The ideal candidate has a Bachelor’s degree, 2+ years of relevant experience, and excellent written communication. The position focuses on high-impact evaluation projects and structured guideline adherence. #J-18808-Ljbffr Obsidian

    Obsidian

    New York, NY
    1 day ago
  •  ...analytical skills and domain expertise to contribute to high-impact evaluation projects. Basic Qualifications Bachelor’s degree (minimum) At...  ...proficiency in Excel, PowerPoint, and Word Strong document analysis and review skills Attention to detail and ability to follow... 

    Obsidian

    New York, NY
    1 day ago
  • A leading AI company is seeking a freelancer with strong analytical and multilingual skills, specifically in English and Korean. In this role, you will help fine-tune large language models by answering analytical questions and providing explanations to improve model accuracy... 
    Freelance
    Remote work

    Turing

    New York, NY
    5 days ago
  • $50 - $75 per hour

    Litigation Specialist - AI Trainer United States of America Are you a...  .... With high-quality training data, tomorrow's AI can democratize...  ...realistic legal scenarios, evaluate their reasoning, and identify...  ...evidence handling, procedural analysis, and judicial decision-making... 
    Hourly pay
    For contractors
    Freelance

    Meridial

    New York, NY
    1 day ago
  • $30 per hour

     ...: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate outputs from large language models and autonomous agent systems...  .... Requirements Strong experience in LLM evaluation, AI output analysis, QA/testing, UX research, or similar analytical roles. Proficiency... 
    Remote job
    Hourly pay
    Contract work

    Crossing Hurdles

    New York, NY
    3 days ago
  • A talent marketplace is seeking soccer experts to evaluate live soccer games. The role involves assessing AI-generated commentary, scoring performance, and providing feedback. Qualified candidates will have deep expertise in soccer, strong analytical and communication skills... 
    Contract work

    Mercor

    New York, NY
    3 days ago
  •  ...PricingDirect employees serve our clients globally by providing them evaluated pricing on over two million fixed income securities and...  ...-to-end ownership responsibilities, including market data collection and analysis, price generation, quality control, and client... 

    J.P. Morgan

    New York, NY
    3 days ago
  • $20 - $160 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $...  ...question in understandable language for non-experts. Detect sycophancy in AI interactions.... 
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    12 days ago
  • $50 - $190 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...: MCP & Plug In Connectors Expert Type: Contract Compensation...  ...Role Responsibilities Evaluate AI systems on complex personal...  ...history. Willingness to sign a data-share consent form via... 
    Hourly pay
    Contract work
    For contractors
    Summer work
    Remote work
    Trial period

    Mercor

    New York, NY
    23 days ago
  • €81 - €129 per hour

     ...Remote (EU/UK) Market Entry Specialist - AI Trainer - Freelance - 8-20 hrs/week - Remote (EU...  ...Us: 10x Team connects top independent experts with leading AI labs to advance the field...  ...generated outputs related to market entry analysis, strategies, and regulatory guidance... 
    Remote job
    Hourly pay
    Freelance
    Local area
    Flexible hours

    10x Team

    New York, NY
    3 days ago
  • $53.01k

     ...and deed descriptions to understand all relevant details Site Evaluation: Visit affected properties and collect information relating to...  ...support project staff through appraisal reviews and analyses Market Analysis: Develop market value estimates by reviewing comparable sales,... 
    Full time
    Local area
    Remote work
    Monday to Friday

    Commonwealth of Pennsylvania

    New York, NY
    3 days ago
  • MaziCTools is looking for a Full-time Fraud and Chargeback Analyst, responsible for identifying fraudulent activities and optimizing chargeback processes. This position allows for a remote-first approach and embraces a collaborative and diverse culture. The ideal candidate...
    Full time
    Remote work

    MaziCTools

    New York, NY
    2 days ago
  • Job Title: Junior Data Science Associate Consultant Job Type: Full-time Location: Remote...  ...are based on rigorous research and analysis underpinned by deep expertise and thought...  ...generative models and integrating classic AI techniques. Prior leadership experience and... 
    Full time
    Remote work

    micro1

    New York, NY
    3 days ago
  • $52k

     ...Haver Analytics, a database firm tracking macroeconomic and financial data located in Midtown Manhattan, is seeking energetic candidates with an economics/finance/data science background to join our growing team. We are hiring for our New York office and work hours will... 
    Full time
    Work at office
    Monday to Friday
    Flexible hours
    3 days per week

    Haver Analytics

    New York, NY
    5 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    New York, NY
    12 days ago
  •  ...seeking an Appraiser in New York, NY who is ready to redefine the profession through cutting-edge technology and extensive data-supported analysis. This role is ideal for a Certified residential appraiser with an understanding of valuation techniques. The Appraiser has... 
    Full time
    Traineeship
    Remote work
    Long distance

    True Footage

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Analysis Expert - Evaluator - AI Trainer. Be the first to apply!