Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Science Expert - Evaluation Specialist - AI Trainer

$120 - $170 per hour

Mercor

Job Description

Job Description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Data Science Expert
Type: Contract
Compensation: $120–$170/hour
Location: Remote

Role Responsibilities

  • Design precise, task-specific grading criteria for real-world data science deliverables, including analyses, models, dashboards, and experiment readouts.
  • Score AI-generated and human work samples against established criteria with detailed, well-reasoned written justifications.
  • Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
  • Incorporate structured feedback from senior reviewers and iterate quickly on your work.
  • Collaborate with AI research teams to improve training data quality and downstream performance.

Qualifications

Must-Have

  • 5+ years of professional data science experience in industry.
  • Background in business operations, product, or growth data science at top-tier technology companies.
  • Deep fluency in experiment design, A/B testing , metric definition, SQL/Python analysis, and communicating findings to executive stakeholders.
  • Exceptionally strong written communication.
  • Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers.

Preferred

  • Prior experience with AI training , evaluation, or human-data projects.

Application Process (Takes 20–30 mins to complete)

  • Submit your resume or relevant technical background to get started.
  • Qualified applicants may be asked to complete a brief technical assessment or submit additional information.

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#hiringmercor
Vacancy posted 20 days ago
Similar jobs that could be interesting for youBased on the Data Science Expert - Evaluation Specialist - AI Trainer in Philadelphia, PA vacancy
  • $30 - $40 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Location: Remote Role Responsibilities Evaluate the functionality and performance of...  ...technical artists , and virtual production specialists to enhance real-time 3D applications.... 
    Suggested
    Contract work
    Summer work
    Remote work
    Flexible hours

    Mercor

    Pennsauken, NJ
    21 days ago
  • $50 - $60 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ..., Larry Summers , and Jack Dorsey . Position: Data Analysts & Spreadsheet Specialists (Must own MacBook) Type: Contract Compensation:... 
    Suggested
    Full time
    Contract work
    Summer work
    Internship
    Immediate start
    Remote work

    Mercor

    Philadelphia, PA
    29 days ago
  • $80 - $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Position: UI / UX Design Expert Type: Contract Compensation...  ...and asynchronously to evaluate and improve AI model performance...  ...training , evaluation, or human-data projects. Application... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    Pennsauken, NJ
    9 days ago
  • $55 - $80 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...PhDs and Technical Domain Experts Type: Contract Compensation: $...  ...language models.Create high-quality data by developing difficult...  ...Healthcare, Statistics and Data Science, AI / ML Research, Computer Science... 
    Suggested
    Contract work
    Summer work

    Mercor Inc

    Philadelphia, PA
    2 days ago
  • $110k - $138k

     ...and scale intelligent AI, digital, cybersecurity...  ...The Computer Vision Specialist is a member of WWT’s Global...  ...Architecture team, part of AI & Data Solutions, focused on...  ...AI sub team, the data science and edge AI specialists...  ...on how models will be evaluated, optimized for edge... 
    Suggested
    Full time
    Work experience placement
    Remote work
    Flexible hours
    Shift work

    World Wide Technology

    Philadelphia, PA
    2 days ago
  •  ...Data ScientistDrive the future of AI-powered decision-making by leading sophisticated machine learning and...  ...Join our dynamic, centralized Data Science team as we execute our AI/ML roadmap...  ...Skilled in data wrangling, quality evaluation, transformation, and cleaning for analysis... 
    Work from home
    Flexible hours

    Ergo by Next

    Philadelphia, PA
    4 days ago
  • $86.6k - $144.4k

     ...Data ScientistBuild AI That Accelerates Scientific DiscoveryDo you want your...  ...challenges?At Elsevier, data science is not about building...  ...scientific ontologies.Fine-tune, evaluate, and integrate large...  ...UX, analytics, and domain experts to transform ambiguous challenges... 
    Local area

    RELX

    Philadelphia, PA
    3 days ago
  • $98k - $163k

     ...Job Family : Data Science & Analysis, Data Science Consulting Travel Required : Up...  ..., predictive forecasting solutions, and AI/ML capabilities that support Navy Reserve...  ...data-driven recommendation. Evaluate emerging analytics technologies, methodologies... 
    Full time
    Temporary work
    Flexible hours

    Guidehouse

    Philadelphia, PA
    5 days ago
  •  ...Senior Data ScientistAI for Science, Research Intelligence & Knowledge DiscoveryBuild AI That Helps Advance Human KnowledgeWhat if your next...  ..., you will design, build, evaluate, and scale advanced AI solutions...  ..., Editorial, UX, and domain experts to solve complex scientific... 
    Worldwide

    RELX

    Philadelphia, PA
    1 day ago
  • $109.4k - $150.4k

     ...MAKE HISTORY HERE… As a Senior Data Scientist, you will serve as a...  ..., machine learning, and AI solutions that deliver measurable...  ...mentorship, you will elevate data science capabilities, influence...  ...quasi-experimental approaches, to evaluate business initiatives and support... 
    Full time
    Temporary work
    Immediate start
    Visa sponsorship

    Campbell Soup Company

    Camden, NJ
    3 days ago
  • $125.4k - $182.6k

     ...Sr. Data ScientistThe North America Data Analytics team at Chubb...  ...is responsible for delivering AI solutions to our business partners...  ...Engineering, Chunking, LLM evaluation techniquesAbility to multi-task...  ...such as Statistics, Computer Science, Data Science, Bioinformatics,... 
    Temporary work
    Local area

    Chubb

    Philadelphia, PA
    2 days ago
  • $40 - $125 per hour

     ...Description Job Description Remote AI Trainer, Data Science Contract | Part-Time or Full-Time |...  ...the test by running your tasks and evaluating the analyses, code, models, and write...  ...Review and refine tasks built by other experts. What You Bring ~2+ years of... 
    Remote job
    Hourly pay
    Full time
    Contract work
    Part time
    Work at office
    Flexible hours

    Accountingfly

    Philadelphia, PA
    5 days ago
  •  ...team.KPMG is currently seeking a Data Scientist to join our Audit...  ...core components of generative AI solutions including RAG pipelines...  ...the delivery of robust data science features by taking ownership...  ...best practicesEnhance AI and RAG evaluation frameworks using tools like... 
    H1b
    Local area

    KPMG

    Philadelphia, PA
    12 hours ago
  •  ...quantitative researchers tackle challenging data and algorithmic problems that inform...  ...optimize how they perform in production Evaluation: Backtest ideas using historical market...  ..., or postdoctoral experience in computer science, economics, electrical engineering, mathematics... 
    Summer work
    Visa sponsorship

    Susquehanna International Group

    Bala Cynwyd, PA
    3 days ago
  •  ...and lower healthcare costs.By combining data-driven insights, innovative risk...  ...Scientist will independently lead applied AI and data science workstreams that translate complex healthcare...  ...approvalsManaging third-party model evaluations and ROI analyses when external... 
    For subcontractor
    Flexible hours

    ParetoHealth

    Philadelphia, PA
    2 days ago
  • $120.38k - $192.6k

     ...Lead Data ScientistLincoln Financial Group is seeking a Data Scientist to join our AI Product & Delivery organization, focused on the agentic...  ...while establishing rigorous evaluation frameworks that keep agentic...  ...years of experience in data science, applied machine learning,... 
    Work experience placement

    Lincoln Financial Services

    Broomall, PA
    1 day ago
  •  ...Overview We are seeking a Data Engineer to join our Systematic Delta One desk, where...  ...modelers and traders to understand their needs, evaluate new datasets, and build the pipelines...  ...Advanced degree in Computer Science, Mathematics, Physics, Computer Engineering... 

    Susquehanna International Group, LLP

    Bala Cynwyd, PA
    12 hours ago
  •  ...Services Department: PennDNA Data Management and Ops Location...  ...the real-world impact of AI-enabled clinical technologies,...  ...that enable the organization to evaluate how these technologies influence...  ...Bachelor's degree in Computer Science, Information Systems, or... 
    Remote work

    Penn Medicine

    Philadelphia, PA
    1 day ago
  • $116.2k - $229.1k

     ...you'll do· As a Supply Chain Optimization Data Scientist you will be responsible for·...  ...data pipelines, and enterprise systems.· Evaluate scenarios and trade-offs to quantify impacts...  ...research, supply chain, computer science, or applied mathematics.· 2+ years of experience... 
    Local area

    Deloitte

    Philadelphia, PA
    3 days ago
  • $70 per hour

     ...technical talent with leading AI research labs. Headquartered in...  .... Position: Generalist Expert Type: Contract Compensation...  ...Role Responsibilities Evaluate AI-generated responses to strengthen...  ...feedback to improve training data quality and downstream... 
    Contract work
    Summer work
    Remote work

    Mercor

    Philadelphia, PA
    6 days ago
  •  ...Entity: Corporate Department: PennDNA Data Mgmt and Ops Location: Remote based out...  ...databases, and external data feeds. Evaluate and recommend appropriate data technologies...  ...Equivalent Experience: Bachelor of Arts or Science Computer Science, Information Systems, or... 
    Remote work

    Penn Medicine

    Philadelphia, PA
    2 days ago
  •  ...Enterprise AI (EAI) builds the data foundations that GSKs AI systems depend our operating model digital...  ...workflows with clear tool design evaluations guardrails and human-in-the-loop controls...  ...: ~ Bachelors degree in Computer Science Data Engineering or a related field... 
    Permanent employment
    Full time
    Local area
    Remote work
    Flexible hours

    GSK

    Philadelphia, PA
    19 days ago
  • $50 - $80 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  .... Collaborate with AI research teams to enhance training data quality and model outputs. Qualifications Must-Have ~1+... 
    Contract work
    Summer work
    Remote work

    Mercor

    Pennsauken, NJ
    26 days ago
  • $95.61k

     ...investments; ensuring data security continuity; planning...  ..., analysts, and GIS specialists, contributing to...  ...enterprise data warehouse, AIS, the City’s custom address...  ...’s degree in Computer Science, Data Science,...  ...terms.To thoughtfully evaluate new data engineering tools... 
    Work experience placement
    Work at office

    City of Philadelphia, PA

    Philadelphia, PA
    4 days ago
  •  ...variety of Employee Resource Groups (ERGs) to support employees. Data Engineer / AI Engineer (Co-op) We are seeking a motivated and curious...  .... Qualifications Current graduate student in Computer Science, Data Science, Artificial Intelligence, Mathematics, or a... 
    Temporary work
    Internship
    Immediate start

    The Campbell's Company

    Camden, NJ
    3 days ago
  • Job SummaryData AnalystPhilladelphia,PA Onsit Seeking a Senior Specialist with 7 to 11 years of experience in data analysis proficient in PowerBI and Tableau to deliver advanced data visualization and business insights Job Description Utilize expertise in PowerBI and Tableau... 

    LTM

    Philadelphia, PA
    2 days ago
  • $124k - $280k

     ...SummaryAt PwC, our people in data and analytics engineering focus...  ...developing and implementing advanced AI and ML solutions to drive...  ...- Lead large healthcare data science engagements, innovating...  ...closely with team members. We evaluate these factors thoughtfully to... 
    Full time
    H1b

    PwC

    Philadelphia, PA
    2 days ago
  • $70 - $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Location: Remote Role Responsibilities Evaluate the quality, correctness, and methodological...  ...ML experience. ~ Strong grasp of data-quality rigor: leakage detection, metric gaming... 
    Contract work
    Summer work
    Remote work

    Mercor

    Philadelphia, PA
    3 days ago
  • $105.1k - $189.6k

     ...Overview This role is essential for designing and developing data architectures across on-premise, cloud, and hybrid platforms to...  ...Acceptable areas of study include Computer Engineering, Computer Science, a related subject area (Required) ~4-7 years Developing cloud... 
    Full time
    Temporary work
    Part time
    Work experience placement
    Local area
    Flexible hours

    T-Mobile

    Philadelphia, PA
    12 hours ago
  • $122k - $240.5k

     ...Deloitte's business through new AI-native platforms and products....  ...We are looking for a talented Data Scientist to join the Converge...  ...at the intersection of data science, product, and financial services...  ...services data sources.Evaluate model performance against business... 
    Local area

    Deloitte

    Philadelphia, PA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Science Expert - Evaluation Specialist - AI Trainer. Be the first to apply!