Data Science Expert - Evaluation Specialist - AI Trainer
$120 - $170 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data Science Expert
Type: Contract
Compensation: $120–$170/hour
Location: Remote
Role Responsibilities
- Design precise, task-specific grading criteria for real-world data science deliverables, including analyses, models, dashboards, and experiment readouts.
- Score AI-generated and human work samples against established criteria with detailed, well-reasoned written justifications.
- Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate quickly on your work.
- Collaborate with AI research teams to improve training data quality and downstream performance.
Qualifications
Must-Have
- 5+ years of professional data science experience in industry.
- Background in business operations, product, or growth data science at top-tier technology companies.
- Deep fluency in experiment design, A/B testing , metric definition, SQL/Python analysis, and communicating findings to executive stakeholders.
- Exceptionally strong written communication.
- Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers.
Preferred
- Prior experience with AI training , evaluation, or human-data projects.
Application Process (Takes 20–30 mins to complete)
- Submit your resume or relevant technical background to get started.
- Qualified applicants may be asked to complete a brief technical assessment or submit additional information.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
#hiringmercorVacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Science Expert - Evaluation Specialist - AI Trainer in Philadelphia, PA vacancy
$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Data Engineer (Coding Agent Experience) Type:... ...frontier AI coding agents to complete and evaluate complex data engineering tasks. Review...SuggestedContract workSummer workRemote work- ...Job Description Job Description Job Title: AI Data Science Domain Expert Job Type: Contractor (Part-Time) Location: Remote Job Overview... ...-generation AI systems. In this role, you will review, evaluate, and refine AI-generated technical and analytical content...SuggestedPart timeFor contractorsRemote work
YO AI Labs
Philadelphia, PA6 days ago $70 per hour
...technical talent with leading AI research labs. Headquartered in... .... Position: Generalist Expert Type: Contract Compensation... ...Role Responsibilities Evaluate AI-generated responses to strengthen... ...feedback to improve training data quality and downstream...SuggestedContract workSummer workRemote workMercor
Philadelphia, PA7 days ago- ...team.KPMG is currently seeking a Data Scientist to join our Audit... ...core components of generative AI solutions including RAG pipelines... ...the delivery of robust data science features by taking ownership... ...best practicesEnhance AI and RAG evaluation frameworks using tools like...SuggestedH1bLocal area
- ...can be addressed using Agentic AI, LLMs, and NLP.Translate... ...across tools, workflows, and data sources.Design multi‑agent and... ...performance in mind.Implement evaluation, monitoring, and guardrails for... ...workflows.MS or PhD in Computer Science, Machine Learning, Data Science...SuggestedFull timeVisa sponsorship
$77k - $202k
...SummaryAt PwC, our people in data and analytics focus on leveraging... ...in Computer and Information Science, Economics, Engineering, Operations... ...- Knowledge of agentic AI frameworks for workflows- Ability... ...understanding of model evaluation metrics across tasksTravel RequirementsUp...Full timeH1b- ...Overview Mercor is partnering with a leading AI research organization to engage... ...product designers for a project focused on evaluating how well AI systems perform real-world digital... ...with AI training, evaluation, or human-data projects is a strong plus #J-18808-Ljbffr...
$118k - $196k
Job Family:Data Science ConsultingTravel Required:Up to 10%Clearance Required:NoneWhat You Will Do:As a Managing Consultant within Guidehouse's AI and Data practice, you will help utilities and energy providers evaluate and improve energy efficiency, demand response, electrification...Full timeFlexible hours- Job SummaryData AnalystPhilladelphia,PA Onsit Seeking a Senior Specialist with 7 to 11 years of experience in data analysis proficient in PowerBI and Tableau to deliver advanced data visualization and business insights Job Description Utilize expertise in PowerBI and Tableau...
$131k - $218.3k
Position Summary Our Deloitte AI & Engineering team works to transform technology... ...innovation. Work you'll do As an AI and Data Science Engineer III on the team, you will be... ..., training/validation/optimization, and evaluation at scale1+ years of technology...Local area$109.4k - $150.4k
...MAKE HISTORY HERE…As a Senior Data Scientist, you will serve as a... ...statistical, machine learning, and AI solutions that deliver... ...mentorship, you will elevate data science capabilities, influence... ...quasi-experimental approaches, to evaluate business initiatives and support...Full timeTemporary workImmediate start$105.4k - $207.8k
...profiles of leading companies? Do you want to build the data foundations that power the next generation of AI-enabled cyber defense?If yes, then Deloitte’s Cyber... ...or hybrid retrieval, tool or function calling, evaluation or monitoring, prompt-injection defenses, and...Local areaVisa sponsorship- Role SummaryURBN is seeking a Senior Data Scientist to develop AI-powered visual experiences, with a primary... ...tools. You should be able to evaluate generated outputs not just quantitatively... ...years of industry experience in data science, machine learning, or AI engineering,...Casual work
$95.3k - $158.8k
Senior Data ScientistAI for Science, Research Intelligence & Knowledge DiscoveryBuild AI That Helps Advance Human KnowledgeWhat if your next... ..., you will design, build, evaluate, and scale advanced AI solutions... ..., Editorial, UX, and domain experts to solve complex scientific...Local areaWorldwide$99k - $232k
...Description & SummaryThe OpportunityAs an AI & GenAI Data Scientist - Manager, you will play a... ...Information Systems, Computer and Information Science, Systems Engineering, Mathematics,... ...closely with team members. We evaluate these factors thoughtfully to establish...Full timeH1b- ...capabilities, then consider a career in Advisory.KPMG is currently seeking a Lead Specialist to join our Federal Advisory practice. Responsibilities:Leverage a variety of modern big data tools / approaches to solve complex business objectivesDevelop / update big data platform...Local area
$40 - $50 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Remote Commitment: ~5 hours/week Role Responsibilities Evaluate full shopper and agent conversations, including tool calls and...Contract workSummer workRemote work$116.2k - $229.1k
...Summary Join Deloitte’s AI & Engineering practice and... ...technology platforms, modernize data environments, and unlock value... ...• Team and Technology Lead: Evaluate, pilot, and integrate new big... ...Bachelor’s degree in Computer Science, Engineering, or a related field...Local areaVisa sponsorship$224.19k - $351.57k
...seeking a visionary Senior Technologist, Data & Agentic AI Enablement to shape the future of our... ...as-Code (IaC), and DevSecOps practices.Evaluate emerging agent frameworks, copilots, and... ...’s why we provide an array of options, expert guidance and always-on tools, that are...Full timeWork at officeRemote workWorldwide- Overview We are seeking a Data Engineer to join our Systematic... ...alternative datasets: from evaluating samples and data dictionaries... ...advanced degree in Computer Science, Mathematics, Physics, Computer... ...together.What we do We are experts in trading essentially all listed...
$150k - $175k
...publishers & consumers. Our predictive AI orchestrates outcomes on any... ...and experienced Lead Data Scientist within the Data Services... ...for shaping our data science strategy, managing a team of data... ...optimization strategies and develop, evaluate, and demonstrate prototypes...Temporary workImmediate start- ...Data Scientist 1+ year contract Hybrid - 2 days a week in Toronto... ...alert monitoring ? proactive, AI-driven detection and triage ,... ...Strong experience in data science, analytics, or machine... ...Model behavior and performance evaluation Experience working with alerting...Contract work2 days per week
Manpower Group Inc.
Cherry Hill, NJ1 day ago - ...Data ScientistThe Data Scientist plays a pivotal role... ...datasets, developing AI/ML/optimization models,... ...efficient and repeatable data science projects.Apply... ...multivariate testing), to evaluate hypotheses, measure... .../Caboodle, Google Cloud ML Engineer, AWS ML Specialist)...Local area
United Software Group
Camden, NJ1 day ago $94.4k - $293.8k
...Global Responsible AI team within the Global Data & AI Practice. AI is... ...agentic AI, and decision-science problem statements.... ..., guardrails, and evaluation. Design agentic... ...architects, cybersecurity specialists, and platform teams... ...as a subject matter expert in Responsible AI...Live inWork at officeLocal areaAccenture
Philadelphia, PA3 days ago- ...at work and at home. Join our dynamic, centralized Data Science team as we execute our AI/ML roadmap! We focus on developing and maintaining predictive... ...challenges. Skilled in data wrangling, quality evaluation, transformation, and cleaning for analysis. Experience...Temporary workWork from homeFlexible hours
Munich Reinsurance America, Inc.
Philadelphia, PA3 days ago $118.7k - $218.6k
...Summary Cyber Data Protection and PKI Specialist - Senior... ...as a subject matter expert and trusted advisor... ..., assisting them to evaluate strategic and practical... ...Engineering, Computer Science, Information Technology... ...Quantum readiness and AI protection experience...Work experience placementLocal areaVisa sponsorship$125k - $187k
...Responsibilities Oversee data-driven initiatives that uncover... ...efficiency and impact of the data science team. Serve as a recognized... ...experience, and expertise, as evaluated during the interview process.... ...a resume for that opening. AI Notice Indeed is committed...Temporary workWork experience placementLocal areaIndeed
Philadelphia, PA4 days ago$130k - $185k
...sector expertise, paired with innovative AI-powered technology and an investor mindset... ...Parthenon service line, the EY Growth Platforms Data Scientists collaborate with Business... ...Experience in data engineering or hybrid data science roles focused on pipeline scalability and...Work experience placementSummer holidayWork at officeFlexible hoursEY
Philadelphia, PA16 hours ago$130k - $185k
...Strategy and Execution - Growth Platforms - Data Scientist - Sr Associate/... ...sector expertise, paired with innovative AI-powered technology and an investor mindset... ...Experience in data engineering or hybrid data science roles focused on pipeline scalability and...Work experience placementSummer holidayWork at officeFlexible hoursEY
Philadelphia, PA2 days ago$152.9k - $221.1k
By joining Chubb as Lead Data Engineer for our North America Finance... ...squads deliver by embedding AI-assisted development, modern... ...modernization, and replatforming efforts.Evaluate and recommend modern tooling,... ...s degree required in Computer Science, Computer Information Systems,...Permanent employmentWork experience placementWork at officeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Science Expert - Evaluation Specialist - AI Trainer. Be the first to apply!
Related searches
- provider data specialist Philadelphia, PA
- data specialist Philadelphia, PA
- oncology data specialist Philadelphia, PA
- data entry associate Philadelphia, PA
- data management specialist Philadelphia, PA
- data management associate Philadelphia, PA
- data associate Philadelphia, PA
- data science associate Philadelphia, PA
- data integration specialist Philadelphia, PA
- data loss prevention analyst Philadelphia, PA