Data Science Expert - Evaluation Specialist - AI Trainer
$120 - $170 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data Science Expert
Type: Contract
Compensation: $120–$170/hour
Location: Remote
Role Responsibilities
- Design precise, task-specific grading criteria for real-world data science deliverables, including analyses, models, dashboards, and experiment readouts.
- Score AI-generated and human work samples against established criteria with detailed, well-reasoned written justifications.
- Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate quickly on your work.
- Collaborate with AI research teams to improve training data quality and downstream performance.
Qualifications
Must-Have
- 5+ years of professional data science experience in industry.
- Background in business operations, product, or growth data science at top-tier technology companies.
- Deep fluency in experiment design, A/B testing , metric definition, SQL/Python analysis, and communicating findings to executive stakeholders.
- Exceptionally strong written communication.
- Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers.
Preferred
- Prior experience with AI training , evaluation, or human-data projects.
Application Process (Takes 20–30 mins to complete)
- Submit your resume or relevant technical background to get started.
- Qualified applicants may be asked to complete a brief technical assessment or submit additional information.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Data Science Expert - Evaluation Specialist - AI Trainer in Philadelphia, PA vacancy
$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Data Engineer (Coding Agent Experience) Type:... ...frontier AI coding agents to complete and evaluate complex data engineering tasks. Review...SuggestedContract workSummer workRemote work$45 - $55 per hour
...technical talent with leading AI research labs. Headquartered in... ...Role Responsibilities Evaluate the accuracy and depth of AI-... ...research teams to improve training data quality and downstream... ...Collaborate with subject matter experts to ensure consistency, relevance...SuggestedContract workSummer workRemote work$70 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Location: Remote Role Responsibilities Evaluate the quality, correctness, and methodological... ...ML experience. ~ Strong grasp of data-quality rigor: leakage detection, metric gaming...SuggestedContract workSummer workRemote workMercor
Philadelphia, PA3 days ago$63k - $141.5k
...SummaryThe Opportunity As part of the AI Engineering team within the... ...to design and develop robust data solutions for clients. Within... ...involving testing and evaluation of AI-enabled systems, analyze... ...fields of study: Analytics/Data Science, Artificial Intelligence/Robotics...SuggestedFull timeH1bPwC
Philadelphia, PA9 hours ago- ...Job Description Job Description Job Title: AI Data Science Domain Expert Job Type: Contractor (Part-Time) Location: Remote Job Overview... ...-generation AI systems. In this role, you will review, evaluate, and refine AI-generated technical and analytical content...SuggestedRemote jobPart timeFor contractors
- ...Description Job Description Data Scientist Role Type:... ...quantitative professionals to support AI training and evaluation projects. You'll apply... ...AI outputs across data science, statistics, ML, and quantitative problems. Create expert-level prompts, datasets, and...Remote jobFor contractors
$40 - $50 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Remote Commitment: ~5 hours/week Role Responsibilities Evaluate full shopper and agent conversations, including tool calls and...Contract workSummer workRemote work$176k - $179.5k
...Apply: be on the global Life Sciences AI team, fully integrated with... ...AI by McKinsey, as a Senior Data Scientist, building AI that transforms... ..., design agentic flows, evaluate agentic outputs, write... ...and collaborate with diverse experts to deliver impactful innovations...ApprenticeshipWorldwideEasy workMcKinsey & Company
Philadelphia, PA2 days ago- ...Job DetailsSummary:At Cencora, data scientists work on high-impact... ..., experimentation, and model evaluation.Deploy models into production... ...version control, responsible AI, and governance.What You Bring... ...Qualifications:Bachelor's degree in Data Science, Statistics, Mathematics,...Full timeLocal area
Cencora
Conshohocken, PA1 day ago - ...LevelPosition Title: Sr. Data Scientist, Technology... ...cel is currently being evaluated in the RESET (REstoring... ...build and advance data science and data-driven capabilities... ...CMC subject matter experts to identify scientific... ...learning, and emerging AI-enabled approaches to relevant...
Cabaletta Bio
Philadelphia, PA9 hours ago $30 - $40 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Location: Remote Role Responsibilities Evaluate the functionality and performance of... ...technical artists , and virtual production specialists to enhance real-time 3D applications....Contract workSummer workRemote workFlexible hours- Mercor seeks professionals with hands-on, real-world experience in specialized applications, especially Photoshop on Windows. You must have Photoshop installed on your own PC and be ready to use it today. Note: We do not provide software licenses, virtual machines, or hardware...
$70 per hour
...technical talent with leading AI research labs. Headquartered in... .... Position: Generalist Expert Type: Contract Compensation... ...Role Responsibilities Evaluate AI-generated responses to strengthen... ...feedback to improve training data quality and downstream...Contract workSummer workRemote work$30 - $40 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...$30–$40/hour Location: Remote Role Responsibilities Evaluate the functionality and performance of Premiere on Windows for...Contract workSummer workRemote work- ...your application further. We are looking for a Visual Designer to write, review, and validate prompt-based questions designed to train AI. Your expertise in visual design, either graphic design or UI work, will ensure each prompt and response reflects real-world design...10 hours per weekFlexible hours
- ...lower healthcare costs. By combining data-driven insights, innovative risk... ...Scientist will independently lead applied AI and data science workstreams that translate complex healthcare... ...Managing third-party model evaluations and ROI analyses when external expertise...For subcontractorFlexible hours
ParetoHealth
Philadelphia, PA9 days ago $80 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: UI / UX Design Expert Type: Contract Compensation... ...and asynchronously to evaluate and improve AI model performance... ...training , evaluation, or human-data projects. Application...Contract workSummer workRemote work- ...Job Description Job Description Humanities Evaluation Specialist Role Type: Contractor Location: Remote micro1 is seeking Humanities Evaluation Specialists to support an AI training project involving research, critical analysis, question development, and...Remote jobFor contractors
YO AI Labs
Philadelphia, PA6 days ago $95.3k - $190.5k
...Senior Data Scientist AI for Science, Research Intelligence & Knowledge Discovery Build AI That Helps... ...Data Scientist, you will design, build, evaluate, and scale advanced AI solutions that... ...Research, Editorial, UX, and domain experts to solve complex scientific and...Full timeLocal areaWorldwide$98k - $163k
...Job Family : Data Science & Analysis, Data Science Consulting Travel Required : Up... ..., predictive forecasting solutions, and AI/ML capabilities that support Navy Reserve... ...deliver data-driven recommendation. Evaluate emerging analytics technologies, methodologies...Full timeTemporary workFlexible hours$109.4k - $150.4k
...MAKE HISTORY HERE… As a Senior Data Scientist, you will serve as a... ..., machine learning, and AI solutions that deliver measurable... ...mentorship, you will elevate data science capabilities, influence... ...quasi-experimental approaches, to evaluate business initiatives and...Full timeTemporary workImmediate startVisa sponsorship$124k - $280k
...OpportunityAs an AML and Sanctions- AI Engineer- Senior Manager, you will leverage data and analytics to provide... ...study: Accounting, Analytics/Data Science, Biology/Biomedical Sciences, Business... ...collaborating closely with team members. We evaluate these factors thoughtfully to...Full timeH1bPwC
Philadelphia, PA2 days ago$18 - $50 per hour
...Digital Industries Software is seeking an AI & Engineering Data Intern to support emerging Artificial... ...into reusable data models. Evaluate and document AI-assisted engineering workflows... ...'s or Master's degree in Computer Science, Data Science, Artificial...Remote jobHourly payFull timeInternshipLocal areaSiemens
Philadelphia, PA15 hours ago$1,000 per month
...technology and customer-centric solutions. Senior Data Engineer Join our Data Platform & Analytics... ...recurrence. Partner with Analytics Engineering, Data Science, Product, Engineering, and other technical stakeholders to evaluate source systems, define dependable data...Temporary workWork at officeImmediate startRemote workFlexible hours- Sr Data Engineer Location: Philadelphia, PA/ Durham, NC Core engineering data skills. Strong... ...connectors, webhooks, and rate limits. AI tools may assist in the recruitment... ...recruitment team based on a comprehensive evaluation of candidates. *** is an Equal Employment...
- Data Engineer We are seeking a Data Engineer to join our Systematic Delta One desk, where... ...and traders to understand their needs, evaluate new datasets, and build the pipelines that... ...communicator Advanced degree in Computer Science, Mathematics, Physics, Computer...
- Extract data from noisy, inconsistent sources Validate and reconcile outputs across multiple... ...validation Retry/fallback strategies Evaluation and monitoring Experience with data... ...This Role Interesting Work on high-accuracy AI systems where correctness matters Solve real...
$118.8k - $186.2k
...about, in industries you care about. Workday PSA & Financials Data Engineer Armanino is proud to be among the top 20 Largest Accounting... .... Partner with business analysts and functional leads to evaluate the feasibility of technical and business requirements....Full timeContract workLocal areaFlexible hours$127k - $150k
Position Summary Healthcare Data Engineer Sr. Consultant Deloitte Consulting's technology... ...clear guidance to others The Team AI & Data offers a full spectrum of solutions... ...coordinationBachelor's degree, preferably in Computer Science, Information Technology, Computer...Local areaVisa sponsorshipDeloitte
Philadelphia, PA9 hours ago$73.5k - $212.28k
...At PwC, our people in data and analytics engineering focus on leveraging... ...growth. Those in data science and machine learning... ...development of innovative AI solutions that drive remarkable... ...closely with team members. We evaluate these factors thoughtfully to...H1bPwC
Philadelphia, PA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Science Expert - Evaluation Specialist - AI Trainer. Be the first to apply!
Related searches
- data entry associate Philadelphia, PA
- data associate Philadelphia, PA
- provider data specialist Philadelphia, PA
- oncology data specialist Philadelphia, PA
- data science associate Philadelphia, PA
- data management specialist Philadelphia, PA
- data management associate Philadelphia, PA
- data specialist Philadelphia, PA
- ai trainer Philadelphia, PA
- ai data Philadelphia, PA