Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Analysis Expert - Evaluator - AI Trainer

$80 - $120 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Data analysis / quantitative readouts Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
  • Provide clear, structured written feedback to improve AI model outputs.
  • Collaborate with subject matter experts to ensure consistency and rigor in evaluations.
  • Work independently and asynchronously to meet deadlines and enhance model performance.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Data analysis / quantitative readouts .
  • Native or professional fluency in English .
  • Highly proficient in Microsoft Office and Google Workspace , especially Slides .

Preferred

  • Advanced degree (Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#hiringmercor
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Data Analysis Expert - Evaluator - AI Trainer in San Jose, CA vacancy
  • $80 - $160 per hour

     ...technical talent with leading AI research labs. Headquartered...  ...Position: Analyst / Insights Experts Type: Contract...  ...to contribute to high-impact evaluation projects. Collaborate asynchronously...  ...hours. Enhance document analysis using Excel , PowerPoint... 
    Suggested
    Contract work
    Summer work
    Remote work
    Flexible hours

    Mercor

    San Jose, CA
    20 days ago
  • $170.6k

     ...Description: The Role and Impact As an AI Software Engineering PhD Intern, you will...  ...Responsible for designing and implementing data-driven solutions that optimize tool capacity...  ...Qualifications o Experience with data analysis and visualization. o Knowledge of... 
    Suggested
    Internship
    Local area
    Immediate start
    Worldwide
    Shift work

    Intel

    Santa Clara, CA
    1 day ago
  • $40 - $125 per hour

     ...drug discovery scientists to evaluate how frontier AI models handle real...  ...and preclinical work: SAR analysis, screening cascades, DMPK and...  ...actually handles: experimental data, protocols, records, reports...  ...refine tasks built by other experts. \n \n Domain qualifications... 
    Suggested
    Contract work
    Work at office
    Remote work
    10 hours per week
    Flexible hours

    DataAnnotation

    Mountain View, CA
    4 days ago
  •  ...Category: Frontier Model Evaluation · Pay: Hourly rate confirmed after the interview process...  ...: Remote — US-eligible · Contractor AI Trainer & Evaluator is a remote evaluation track...  ...retrain. Why this role matters AI data reviewers help turn ai trainer evaluation... 
    Suggested
    Hourly pay
    Contract work
    For contractors
    Remote work
    10 hours per week

    AuraOne

    San Jose, CA
    a month ago
  •  ...DataBricks, NumPy, Python Job Description : Job Requirements Role : Data Scientist Experience : 4 Years Job Description:" 4 years of...  ...learn, andNumPy." 3 years of dedicated experience in Statistical Analysis, Machine Learning (ML)algorithms, and deploying models into production... 
    Suggested
    Work experience placement

    Diversity Nexus

    San Jose, CA
    1 day ago
  •  ...Data ScientistLocation: RemoteDuration: Long Term10 years of experience and 5 years of work experience in data scientist discipline...  ...Azure cloud with focus on Data Factory, Data Bricks, BLOBs, Data Lake Storage, ML Studio, Azure Analysis Services, Azure Data Warehouse.... 
    Work experience placement

    Rootshell Inc

    Santa Clara, CA
    1 day ago
  •  ...Job DescriptionJob Description We are seeking a highly skilled Data Scientist for a hybrid contract role. This position requires a professional...  ..., and analyze large datasets. Apply Advanced Statistical Analysis and modeling techniques to solve complex business problems.... 
    Contract work
    Work at office
    3 days per week

    Macpower Digital Assets Edge Private Limited

    San Jose, CA
    2 days ago
  •  ...development and implementation of advanced data science models and algorithms. You will...  ...conversion changes to product features in AI-driven checkout flows. Develop behavioral...  ...Experience using Python and SQL for data analysis, querying databases, and machine learning... 
    Full time
    Work at office
    Local area
    Immediate start
    Remote work
    Flexible hours

    PayPal

    San Jose, CA
    2 days ago
  • $131.7k - $219.5k

     ...connecting people, systems, and data that power the world’s largest organizations...  ...modeling, Generative AI, Retrieval‑Augmented Generation (RAG), model evaluation, and applied AI experimentation...  ...regressions. Conduct exploratory analysis, dataset preparation, feature... 

    BMC Software

    Santa Clara, CA
    3 days ago
  • $184.7k - $324.8k

     ...50 Team: Machine Learning and AI Location: Cupertino; Seattle Posted...  ...impact via measurement and evaluation, for products and services...  ...organization, the mission of Data Science and Insights team is to...  ...Solve difficult, non-routine analysis problems, applying advanced analytical... 
    Work experience placement
    Relocation

    Apple

    Cupertino, CA
    1 day ago
  • $170k - $225k

     ...seeking a talented and motivated Data Scientist to join our Machine...  ..., from exploratory data analysis to building and deploying machine...  ...Learning: Build, train, and evaluate custom machine learning...  ...engineers, analysts, and domain experts to understand business requirements... 
    Work at office
    Remote work
    Flexible hours

    Versa Networks

    Santa Clara, CA
    5 days ago
  • $145k - $180k

     ...artificial intelligence (“AI”) solutions, and other...  ...day. As a Senior Data Scientist here, you’ll...  ...raw telemetry. Build, evaluate, and iterate on models...  ...to engineers and domain experts. Partner with backend...  ...models from offline analysis into production streaming... 
    Local area
    Worldwide
    Visa sponsorship
    Night shift

    Archer Aviation

    San Jose, CA
    4 days ago
  •  ...Data ScientistWe are seeking a seasoned Data Scientist to collaborate closely with cross...  ...Leveraging your expertise in statistical analysis, machine learning, and econometric...  ...Mathematics, Natural Sciences, or Economics)Expert knowledge of a scientific computing language... 

    Aven, Inc.

    Campbell, CA
    1 day ago
  •  ...career with us! As a Principal Data Scientist at Lumentum...  ...manufacturing data. Design and evaluate experiments, including DOE and...  ...Apply regression, multivariate analysis, time-series methods, anomaly...  ...manufacturing execution systems. Expert knowledge of experimental design... 
    Full time

    Lumentum Operations

    San Jose, CA
    5 days ago
  • $110k - $140k

     ..., providing an innovative and AI-enabled product-concept-to-commercialization...  ...part of something exceptional.Data Scientist ConsultantRetail...  ...data science and engineering experts. We help retailers and brands...  ...and analyse A/B tests to evaluate outcomes and answer business... 
    Full time
    Remote work

    Centric Software

    Campbell, CA
    4 days ago
  • NutaNXT is looking for supporting the planning and implementation of data design services, providing sizing and configuration assistance and performing needs assessments. Delivery of architectures for transformations and modernizations of enterprise data solutions using... 

    NutaNXT Technologies

    Santa Clara, CA
    4 days ago
  •  ...One of our direct client, a BigData & Data Science major is looking for a Lead Data Scientist to join their team of Data...  .../disadvantages of each for a particular business case. Expert knowledge of an analysis tool/statistical package such as R, JMP, Stata, SPSS, SAS,... 
    Permanent employment

    Staffwing Inc

    San Jose, CA
    2 days ago
  • $200k - $300k

     ...Ahuora is a cutting‑edge investment firm that harnesses AI and data‑driven insights to uncover investment opportunities with high potential...  ...Developing predictive models using sophisticated data analysis techniques Building and maintaining multi‑asset portfolios using... 

    Ahuora

    San Jose, CA
    5 days ago
  •  ...and Measurement powered by large-scale data and AI. This is a hands-on senior/lead role...  ...analytics requests - segmentation, overlap analysis, behavioral profiling, and adhoc pulls...  ..., Platt calibration, or model evaluation techniques Knowledge of data privacy... 
    Remote work

    Xoriant Corporation

    San Jose, CA
    1 day ago
  •  ...Description PlusAI is a Physical AI company pioneering AI-based...  ...them at fleet scale, the analysis that turns them into judgments...  ...map that behavior changes — the data and tooling that gate software...  ...processing, geospatial analytics, evaluation frameworks, and LLM-powered... 

    PlusAI

    Santa Clara, CA
    7 days ago
  •  ...world will rely on tomorrow. From advancing AI and hybrid cloud to pioneering practical...  ...empowered to use our software and services. As a data scientist intern, you will be supporting...  ...performing of advanced (predictive) data analysis. Successful attributes to thrive in this... 
    Full time
    Contract work
    Part time
    Fixed term contract
    Internship
    Shift work

    IBM

    San Jose, CA
    3 days ago
  • $95.6k - $153k

     ...possibilities. Job Description The Safety Data Sheet Authoring Senior...  ...serves as a Subject Matter Expert (SME) and works cross‑...  ...biotech environment. Strong data analysis skills, including advanced use...  ...Equal Opportunity Employer. We evaluate applicants without regard to race... 
    Hourly pay
    Work at office
    Remote work
    Worldwide
    Flexible hours

    BD

    Milpitas, CA
    2 days ago
  •  ...seasoned Senior IT Asset Management (ITAM) & Data Platform Consultant to lead the...  ...Responsibilities • Act as the ITAM subject matter expert for FlexeraOne, HAM, and SAM processes. •...  ...reporting, compliance, and analytics. • Evaluate and improve asset lifecycle processes,... 

    TechDigital Group

    Santa Clara, CA
    5 days ago
  • JOB Description: Data migration experience including: Production Orders BOMs Routings JD for Data Migration Consultant 2+ years of experience in Syniti, with multi project experience. Experience in Syniti - Collect, Map Construct and Transform. Experience in Migration... 

    TechDigital Group

    Santa Clara, CA
    5 days ago
  • $70k - $125k

     ...Data Scientist Salary- $70k-$125k Per Year Job Type- Full-Time Location- San Jose...  ...preparing large databases for statistical analysis. Minimum Background and Qualifications...  ...by the endless possibilities presented by AI Machine Learning IoT and Data Science this... 
    Full time
    Part time
    H1b
    Relocation
    Flexible hours

    SynergisticIT

    San Jose, CA
    25 days ago
  •  ...a proactive and detail-oriented Eightfold AI Technical Support Engineer with hands-on experience...  ...Write and execute SQL queries to validate data, investigate discrepancies, and support...  ...: Strong SQL skills for data validation, analysis, and troubleshooting. APIs &... 
    Contract work

    2T Consulting

    Santa Clara, CA
    a month ago
  • $142k

     ...its dynamic design engineering team as an AI-Driven Physical Design Engineering PhD...  ...powered workflows, building intelligent data analysis capabilities, and designing adaptive systems...  ...with broader project objectives. Evaluate and benchmark AI-driven methodologies against... 
    Internship
    Local area
    Immediate start
    Shift work

    Intel

    Santa Clara, CA
    2 days ago
  • $80 - $120 per hour

     ...About the role Biology / environmental science Evaluator is a remote review track for evaluating AI outputs across biology reasoning, calculations, and research...  ...validation Citation review Quantitative analysis Biology Application boundary Creating a specialist... 
    Contract work
    For contractors
    Remote work
    10 hours per week

    AuraOne

    San Jose, CA
    a month ago
  • $80 - $120 per hour

     ...About the role Investment analysis / valuation / credit Evaluator is a remote review track for evaluating AI outputs across investment analysis workflows. Reviewers grade calculations, narrative reasoning, and policy adherence; flag compliance and reconciliation issues... 
    Contract work
    For contractors
    Work experience placement
    Remote work
    10 hours per week

    AuraOne

    San Jose, CA
    a month ago
  • $80 - $120 per hour

     ...About the role Data analysis / quantitative readouts Evaluator is a remote evaluation track for reviewing data analysis / quantitative readouts evaluation...  ...feedback the modeling team can use to retrain. AI data reviewers help turn data analysis / quantitative... 
    Contract work
    For contractors
    Remote work
    10 hours per week

    AuraOne

    San Jose, CA
    a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Analysis Expert - Evaluator - AI Trainer. Be the first to apply!