Data Science Evaluator - Expert
$100 - $150 per hourMercor
Job Description
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data Science Expert
Type: Contract
Compensation: $100–$150/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts for usability in data science contexts.
- Identify and correct factual, aesthetic, and presentation errors.
- Provide clear, structured written feedback to improve AI model outputs .
- Collaborate with AI research teams to enhance training data quality.
- Work independently and asynchronously to meet deadlines.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Data Science at a top firm in the United States , United Kingdom , Canada , Australia , or New Zealand .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace (PowerPoint, Excel, Word).
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on ziprecruiter.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 13 days ago
Similar jobs that could be interesting for youBased on the Data Science Evaluator - Expert in San Francisco, CA vacancy
$80 - $120 per hour
..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...SuggestedContract workSummer workWork at officeRemote workMercor
San Francisco, CA15 days ago$120 - $175 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: CNC Machining Expert Type: Contract Compensation: $120–$175/hour Location: Remote Role Responsibilities Contribute to text-only,...SuggestedContract workSummer workRemote workMercor
San Francisco, CA13 days ago$50 per hour
...Position: English Language and Literature Expert Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated... ...linguistic annotation, language evaluation, or NLP data work in English. Strong understanding of...SuggestedContract workSummer workRemote work- Obsidian is seeking expert Evaluators in FP&A / corporate finance to assess AI-generated work products for accuracy and quality. This role entails deep expertise to grade outputs and provide structured feedback. Candidates should have at least 5 years of relevant experience...SuggestedRemote jobHourly payWork at office
- Obsidian is seeking experienced AI Safety Practitioners to evaluate safety, quality, and alignment of frontier AI models across complex policy-sensitive topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured...Suggested
- We are seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex,... ...Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline. 5+ years of professional experience...Worldwide
$60 - $70 per hour
...60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance... ..., Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline. ~5+ years of professional...Contract workSummer workRemote workMercor
San Francisco, CA16 days ago- Mercor, a San Francisco-based talent platform, is seeking a Government/public administration Evaluator for a remote contract. You will assess AI-generated artifacts against domain rubrics, identify factual and presentation errors, and provide structured feedback to improve...Remote jobContract workWork at office
- ...client service teams to counsel defense clients, shape their AI and data agendas, and build and deploy agentic AI and machine learning... ...and security ecosystems)7+ years of experience applying data science, advanced analytics, and AI to drive measurable mission or business...ApprenticeshipFor subcontractorEasy work
McKinsey & Company
San Francisco, CA2 days ago $55 - $90 per hour
Obsidian is seeking STEM PhDs and Technical Domain Experts for a premier project with a leading AI lab in San Francisco. This role offers... ...and requires advanced expertise in fields such as Medicine, Data Science, AI/ML Research, and more. Key responsibilities include aiding...$80 - $120 per hour
.... Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location... ...improve AI model outputs . Collaborate with subject matter experts to ensure consistency and quality. Work independently and...Contract workSummer workWork at officeRemote work$15 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation: $15/hour... ...months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres and assess quality...Contract workSummer workImmediate startRemote workFlexible hours$70 - $110 per hour
...weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated sales conversations , product recommendations,... ..., order handling, and post-sale support. Provide expert feedback. Work independently and asynchronously to meet deadlines...Hourly payContract workSummer workImmediate startRemote work$50 - $70 per hour
...Larry Summers , and Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50–$70/hour Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for quality...Contract workSummer workRemote workFlexible hours$150 per hour
...Jack Dorsey . Position: General Clinician (MD/DO) - HLS Expert Pool Type: Contract Compensation: $150/hour Location... ..., checkable criteria for consistent model response grading. Evaluate clinical dialogues for accuracy, safety, completeness, and...Contract workSummer workRemote work$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote work$164.5k - $219k
General Information Job Title Expert Senior Manager, Data Sciences, Software and Data Services, Coro Job ID 109009 Work Areas Technology... ...set the standards the team applies to prompt design, evaluation and output quality assuranceDevelop Coro intellectual...Permanent employmentFull timeApprenticeshipLocal areaHome office3 days per weekBain & Company
San Francisco, CA5 days ago$293.5k
...Information Job Title Expert Senior Manager, AI Engineering... ...Work Areas Analytics, Data & Research, Management Consulting... ...across engineering, product, data science, ethics, and client... ..., model experimentation, and evaluation design to production system deploymentOversee...Permanent employmentFull timeApprenticeshipWork at officeLocal areaWork from homeHome office3 days per weekBain & Company
San Francisco, CA2 days ago$100 - $150 per hour
...Dorsey . Position: Sales Engineering Expert Type: Contract Compensation: $... ..., supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands... ..., cloud infrastructure, cybersecurity, data platforms, developer tools, or enterprise...Contract workSummer workRemote work$90 per hour
...Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid . Write structured rationales for every...Contract workSummer workLocal areaRemote work$100 - $150 per hour
..., Larry Summers , and Jack Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a software engineering context...Contract workSummer workWork at officeRemote work- ...EKS footprint, and optimized managed datastores. You’ll automate infrastructure and improve developer experience across teams. The position is remote within the United States, with collaboration across engineering, data science, and ML teams. #J-18808-Ljbffr LogoslabsRemote job
$50 per hour
...Jack Dorsey . Position: French Linguistic Expert Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated French... ..., editing, linguistic annotation, or NLP data work in French. Strong understanding of...Contract workSummer workRemote work- YO AI Labs is seeking a Creative & Design Specialist to evaluate AI-generated outputs, provide high-quality human feedback, and improve creative... ...in related fields, experience with Figma/After Effects and AI data work, and strong English communication. Flexible schedule and...Remote jobFlexible hours
- ...relevant experience in CFD or closely related engineering simulation work. Engagement: 15–20 hours/week Location: US, Canada, UK, or Europe Engagement Remote, project-based expert role Supporting AI model training and evaluation for a leading AI lab ....Hourly payFreelanceRemote work
Braintrust
San Francisco, CA4 days ago $110k - $150k
San FranciscoCustomer Solutions /Full-Time /On-siteAs a Product Delivery Expert, you will own fast, accurate, and reliable product delivery for Windfall's customers, making sure every data file, model score, and data integration lands on time and right the first time. Working...Full timeRemote workWindfall
San Francisco, CA7 days ago- ...engineering and software domain expert to work directly with a... ...2. Key Responsibilities Data QA and reviews: Vet the quality... ...challenging engineering tasks and evaluation sets, and help build... ...degree or higher in computer science, software engineering, or a closely...Full timeContract workPart timeFreelanceInternshipLive inRelocationRelocation package
Mercor
San Francisco, CA2 days ago $140k
...Job Category: Engineering / Science Job Level: Individual Contributor... ...-functional teams, including data scientists, asset engineers, risk engineers, technology experts, regulatory professionals, and... ...risk analytics by studying, evaluating, and improving risk models...Work at officeRemote workPacific Gas And Electric Company
Oakland, CA14 days ago- Obsidian is hiring expert Evaluators in Program management / implementation planning to review AI-generated documents for accuracy and quality. This role requires deep subject-matter expertise and offers a remote, hourly engagement. Ideal candidates will have 5+ years of...Remote jobHourly payWork at office
$50 per hour
...Jack Dorsey . Position: English (Australia) Audio Generalist Evaluator Expert Type: Contract Compensation: $50/hour Location: Remote Commitment... ...graduates. Background in linguistics, humanities, social sciences, journalism, or technical disciplines. Experience with transcription...Contract workSummer workRemote work10 hours per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Science Evaluator - Expert. Be the first to apply!
Related searches
- quality evaluator San Francisco, CA
- evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- education evaluator San Francisco, CA
- ai evaluator San Francisco, CA
- work from home web search evaluator San Francisco, CA
- data science associate San Francisco, CA
- data integration specialist San Francisco, CA
- data entry associate San Francisco, CA
- data specialist San Francisco, CA