Data Science Expert - Evaluation Specialist
$120 - $170 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data Science Expert
Type: Contract
Compensation: $120–$170/hour
Location: Remote
Role Responsibilities
- Design precise, task-specific grading criteria for real-world data science deliverables, including analyses, models, dashboards, and experiment readouts.
- Score AI-generated and human work samples against established criteria with detailed, well-reasoned written justifications.
- Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate quickly on your work.
- Collaborate with AI research teams to improve training data quality and downstream performance.
Qualifications
Must-Have
- 5+ years of professional data science experience in industry.
- Background in business operations, product, or growth data science at top-tier technology companies.
- Deep fluency in experiment design, A/B testing , metric definition, SQL/Python analysis, and communicating findings to executive stakeholders.
- Exceptionally strong written communication.
- Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers.
Preferred
- Prior experience with AI training , evaluation, or human-data projects.
Application Process (Takes 20–30 mins to complete)
- Submit your resume or relevant technical background to get started.
- Qualified applicants may be asked to complete a brief technical assessment or submit additional information.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on us.fitly.work
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Science Expert - Evaluation Specialist in New York, NY vacancy
$120 - $170 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour... .... Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20...SuggestedContract workSummer workRemote work$200k - $300k
...River Trading (HRT) is seeking aResearch Data Expert to join our Data team. Data is a... ...with the sourcing team to identify and evaluate new data procurement opportunities.Analyze... ...Python/R preferred) and proficiency in data science methodologies5+ years of professional experience...SuggestedWork at officeLocal areaImmediate startHudson River Trading
New York, NY1 day ago$150 per hour
...Summers , and Jack Dorsey . Position: Data Scientist Talent Network Type:... ...task-specific grading criteria for data science deliverables. This includes exploratory... ...learning pipelines , and technical reports. Evaluate AI-generated or human-created work...SuggestedContract workSummer workRemote workMercor
New York, NY2 days ago- ...About the role We are hiring expert Evaluators in Data analysis / quantitative readouts to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise...SuggestedHourly payWork at officeRemote work
Mercor Inc
New York, NY3 days ago - ...automotive partnerships. As an Associate Data Scientist, you will partner with a sales-... ...channels. Your work will integrate data science, research, and business domain expertise... ...refine reporting frameworks and KPIs to evaluate channel effectiveness and partnership performance...Suggested
JPMorgan Chase & Co.
New York, NY7 days ago $111.71k - $137.59k
...this position by using the contact information provided on the "Contact" tab for the position. Title Mental Hygiene Program Evaluation Specialist 4 (NY HELPS), Pilgrim Psychiatric Center, P27982 Occupational Category Health Care, Human/Social Services Salary Grade 27...Permanent employmentFull timeWork at office- ...professional to join a GenAI red-team within a leading AI lab network. The role involves probing frontier models, designing robust evaluation tasks, and documenting findings for reproducibility. This full-time W-2 position is remote within the United States, requiring...Full timeRemote work
- Mercor is seeking detail-oriented writing experts to contribute to a high-impact video AI research project. You will evaluate paired video outputs, score them against a rubric, and document brief rationales. This is a short-term, flexible engagement for researchers with...Temporary workFlexible hours
- ...seeking a future team member for the role of Data Scientist to join our IT Asset Management... ...:2+ years of experience in a Data Science role.Hands-on experience utilizing AI tools... ...into account when developing infrastructure.Evaluates the organization's existing...Work experience placementWorldwideFlexible hours
The Bank of New York Mellon
New York, NY9 hours ago - ...translate research and analytics into clear roadmaps, partner with data science, machine learning engineering, channel teams, and business... ...that provide value to customers.Analyzes, tracks, and evaluates product metrics including work to time, cost, and quality targets...
JP Morgan Chase
New York, NY9 hours ago $157.64k - $210.91k
...future of business with AI + Data + CRM. Leading with our core... ...focused/industry SEs and product specialist SEs. This role is for an... ...Focus client decision-making by evaluating solutions and driving... ...QualificationsB.S. in Computer Science, Software Engineering, MIS, Data...Full timeWork experience placementRemote workSalesforce
New York, NY3 days ago- Data Science Expert - AI Content Specialist What if your expertise in machine learning and statistical modeling could directly shape how the world's most... ...benchmark for AI responses Audit AI-Generated Code — Evaluate outputs from models using Scikit-Learn, PyTorch, TensorFlow...Hourly payOngoing contractContract workFreelanceRemote workFlexible hours
$96.89k - $155.02k
...ones Capital Group Rotational Program Data & Technology Track Associate - US - New York... ...making and business outcomes. ~ Data Science: Apply advanced analytics, modeling,... ...visualizations, support data and AI initiatives, evaluate business requirements, and help create...Rotational programFull timeTemporary workInternshipLocal areaFlexible hours$77k - $202k
...Description & Summary At PwC, our people in data and analytics focus on leveraging data to... ...analytics and emerging technologies to evaluate investment opportunities, assess risk,... ...Have - Bachelor's Degree in Computer Science, Data Processing/Analytics/Science, Applied...Full timeH1b- ...Job Description Job Description Job Title: AI Data Science Domain Expert Job Type: Contractor (Part-Time) Location: Remote Job Overview... ...-generation AI systems. In this role, you will review, evaluate, and refine AI-generated technical and analytical content...Remote jobPart timeFor contractors
$150 per hour
...Summers , and Jack Dorsey . Position: Data Scientist Talent Network Type:... ...task-specific grading criteria for data science deliverables. This includes exploratory... ...learning pipelines , and technical reports. Evaluate AI-generated or human-created work...Remote jobContract workSummer work$60 - $90 per hour
..., Larry Summers , and Jack Dorsey . Position: Data Science & Quantitative Analysis Expert Type: Contract Compensation: $60–$90/hour... ...involve spot checks and provide clear recommendations. Evaluate model performance on tasks, ensuring statistics and...Contract workSummer workRemote work- ...Machine Learning Model Specialist The ideal candidate will have a... ...understanding of machine learning, data annotation, quality assurance... .... Model Training and Evaluation: Initiate model training processes... ...'s degree in Computer Science, Data Science, Linguistics or...Full time
$121.2k - $181.8k
...engineer to join our Realtime Risk Data team. This role is at the... ...cloud‑native architectures, evaluating and proposing their adoption... ...distributed systems. Java Mastery: Expert-level command of Java (... ...with a Master's in Computer Science, Electrical Engineering, or a...Full time$60 - $70 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data Science and Analytics Experts Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct...Contract workSummer workRemote workMercor
New York, NY2 days ago$45 - $55 per hour
...Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated... ...AI research teams to improve training data quality and downstream performance.... ...solutions. Collaborate with subject matter experts to ensure consistency, relevance, and...Contract workSummer workRemote work$135k - $170k
...focused on real estate, private equity, credit, infrastructure, life sciences, growth equity, secondaries and hedge funds. Further information... ...@blackstone on LinkedIn, X (Twitter), and Instagram. As a Data Analyst within the Real Estate and Private Equity technology team...Full timeLocal areaBlackstone Group
New York, NY9 hours ago- Welo Data is hiring Data Labeling Associates in New York City for Project Perseus. The role involves evaluating Arabic language AI outputs and ensuring AI safety, requiring professional proficiency in Arabic and experience in writing and AI safety. You’ll critique models...
- ...hone existing skills and learn new ones Data & Technology Summer Associate (Summer 202... ...-making and business outcomes Data Science: Apply advanced analytics, modeling, and... ...support digital product or data initiatives, evaluate business requirements, and help develop...Rotational programFull timeSummer workInternshipFlexible hours
Capital Group
New York, NY3 days ago $52k
...Haver Analytics, a database firm tracking macroeconomic and financial data located in Midtown Manhattan, is seeking energetic candidates with an economics/finance/data science background to join our growing team. We are hiring for our New York office and work hours will...Full timeWork at officeMonday to FridayFlexible hours3 days per weekHaver Analytics
New York, NY1 day ago- Senior Merchant Mariner Evaluation Specialist (Engine) This vacancy is for a GS-2101-13, Senior Merchant Mariner Evaluation Specialist (Engine) located in the Department of Homeland Security, U.S. Coast Guard, NMC MARINER EXAMINATIONS BRANCH in location to be determined...
- ...ones Capital Group Rotational Program Data & Technology Track Associate - US - New York... ...-making and business outcomes. Data Science: Apply advanced analytics, modeling,... ...visualizations, supportdata and AIinitiatives, evaluate business requirements, and help create...Rotational programFull timeFlexible hours
Capital Group
New York, NY1 day ago - Welo Data is seeking a Data Labeling Associate in New York City to evaluate AI systems, focusing on data quality and model behavior. This full-time position requires native British English proficiency and a bachelor's degree. You'll work closely with AI, providing critical...Full time
- ...Job Description Job Description Apply now: Data Analyst, Hybrid ( New York, NY). Start date is ASAP for this 6-month contract position... ...metrics and learnings •Blend digital and marketing analytics to evaluate funnel acquisition, audience engagement, and intervention points...Contract workImmediate start
Mondo
New York, NYa month ago $143.2k - $163.5k
...Overview Principal Data Analyst - Strategy and Analytics Data is at the center... ...effectiveness Conducting analysis to evaluate processes and tests Enhancing self-service... ..., Analytics, Mathematics, Computer Science or a related quantitative field) plus at...Full timePart timeLocal areaCapital One
New York, NY11 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Science Expert - Evaluation Specialist. Be the first to apply!
Related searches
- data entry associate New York, NY
- data integration specialist New York, NY
- data associate New York, NY
- provider data specialist New York, NY
- data visualization specialist New York, NY
- oncology data specialist New York, NY
- data science associate New York, NY
- data management specialist New York, NY
- data conversion specialist New York, NY
- data management associate New York, NY