Data Science Evaluator - Expert
Mercor Inc
About the role We are hiring expert Evaluators in Data Science to review and assess AI-generated work products (slides, spreadsheets, and documents) for real-world quality. You will apply deep subject-matter expertise to grade outputs. This is a remote, hourly engagement. Requirements (must have) 5+ years of relevant professional experience in Data Science at a top firm in the United States, United Kingdom, Canada, Australia, or New Zealand. Native or professional fluency in English. Highly proficient in Microsoft Office and Google Workspace (PowerPoint, Excel, Word). Preferred (nice to have) Advanced degree (Master's or higher) from a reputable institution. What you'll do Evaluate AI-generated artifacts for usability in data science context. Identify factual, aesthetic, and presentation errors. Provide clear, structured written feedback. #J-18808-Ljbffr
Vacancy posted 11 hours ago
Similar jobs that could be interesting for youBased on the Data Science Evaluator - Expert in San Francisco, CA vacancy
- ...Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI... ...immediate Duration: up to 6 months Commitment: flexible. Most experts work around 20 hours per week; there is no cap We consider all...SuggestedImmediate startFlexible hours
Mercor Inc
San Francisco, CA4 days ago $80 - $120 per hour
..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...SuggestedContract workSummer workWork at officeRemote workMercor
San Francisco, CA17 days ago$120 - $175 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: CNC Machining Expert Type: Contract Compensation: $120–$175/hour Location: Remote Role Responsibilities Contribute to text-only,...SuggestedContract workSummer workRemote workMercor
San Francisco, CA15 days ago$50 per hour
...Position: English Language and Literature Expert Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated... ...linguistic annotation, language evaluation, or NLP data work in English. Strong understanding of...SuggestedContract workSummer workRemote work$90 per hour
...Inspect underlying markup with browser devtools to distinguish genuinely correct replications from those that merely look correct. Evaluate responsive behavior and semantic quality, ensuring proper use of flexbox and grid . Write structured rationales for every...SuggestedContract workSummer workLocal areaRemote workMercor
San Francisco, CA26 days ago- Mercor, a San Francisco-based talent platform, is seeking a Government/public administration Evaluator for a remote contract. You will assess AI-generated artifacts against domain rubrics, identify factual and presentation errors, and provide structured feedback to improve...Remote jobContract workWork at office
- ...client service teams to counsel defense clients, shape their AI and data agendas, and build and deploy agentic AI and machine learning... ...and security ecosystems)7+ years of experience applying data science, advanced analytics, and AI to drive measurable mission or business...ApprenticeshipFor subcontractorEasy work
McKinsey & Company
San Francisco, CA4 days ago $80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Cybersecurity / IT GRC Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote work$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts...Contract workSummer workWork at officeRemote work$70 - $110 per hour
...weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated sales conversations , product recommendations,... ..., order handling, and post-sale support. Provide expert feedback. Work independently and asynchronously to meet deadlines...Hourly payContract workSummer workImmediate startRemote work$15 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Malayalam Type: Contract Compensation: $15/hour... ...months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres and assess quality...Contract workSummer workImmediate startRemote workFlexible hours$150 per hour
...Jack Dorsey . Position: General Clinician (MD/DO) - HLS Expert Pool Type: Contract Compensation: $150/hour... ...checkable criteria for consistent model response grading. Evaluate clinical dialogues for accuracy safety completeness and appropriate...Full timeContract workSummer workRemote work$164.5k - $219k
General Information Job Title Expert Senior Manager, Data Sciences, Software and Data Services, Coro Job ID 109009 Work Areas Technology... ...set the standards the team applies to prompt design, evaluation and output quality assuranceDevelop Coro intellectual...Permanent employmentFull timeApprenticeshipLocal areaHome office3 days per weekBain & Company
San Francisco, CA7 days ago$60 - $70 per hour
...60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance... ..., Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline. ~5+ years of professional...Contract workSummer workRemote work$293.5k
...Information Job Title Expert Senior Manager, AI Engineering... ...Work Areas Analytics, Data & Research, Management Consulting... ...across engineering, product, data science, ethics, and client... ..., model experimentation, and evaluation design to production system deploymentOversee...Permanent employmentFull timeApprenticeshipWork at officeLocal areaWork from homeHome office3 days per weekBain & Company
San Francisco, CA4 days ago- ...production EKS footprint, and optimized managed datastores. You’ll automate infrastructure and improve developer experience across teams. The position is remote within the United States, with collaboration across engineering, data science, and ML teams. #J-18808-Ljbffr...Remote work
Logoslabs
San Francisco, CA3 days ago $100 - $150 per hour
..., Larry Summers , and Jack Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a software engineering context...Contract workSummer workWork at officeRemote work$50 per hour
...Jack Dorsey . Position: French Linguistic Expert Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated French... ..., editing, linguistic annotation, or NLP data work in French. Strong understanding of...Contract workSummer workRemote work$118k
...Relations departments. Position Summary The External Reporting Expert Analyst prepares complex disclosures and supporting workpaper documentation... ...the process of researching and resolving issues Identifies and evaluates accounting issues including preparing documentation, proposing...Work experience placementPacific Gas And Electric Company
Oakland, CA2 days ago- ...Mercor connects elite creative and technical talent with leading AI research labs. We are seeking a Music & Lyrics Expert - French to evaluate AI-generated music and lyrics, rate quality, and compare lyrics to published songs. You will work independently in French and...Immediate startRemote work
NEPSE Trading
San Francisco, CA3 days ago - ...Obsidian is seeking expert Evaluators in IP / trademark / copyright law to review AI-generated outputs for accuracy and quality. Candidates should have over 5 years of relevant professional experience and native fluency in English.The role involves evaluating documents...Hourly payRemote work
Obsidian
San Francisco, CA4 days ago - ...Obsidian is seeking expert Evaluators in Cybersecurity / IT GRC to review AI-generated work products for accuracy and quality. This remote position requires a minimum of 5 years of relevant experience and fluency in English. Successful candidates will evaluate documents...Work at officeRemote work
Obsidian
San Francisco, CA4 days ago $140k
...Job Category: Engineering / Science Job Level: Individual Contributor... ...-functional teams, including data scientists, asset engineers, risk engineers, technology experts, regulatory professionals, and... ...risk analytics by studying, evaluating, and improving risk models...Work at officeRemote workPacific Gas And Electric Company
Oakland, CA3 days ago$15 per hour
...Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts work on a variety of projects, from generating training data to evaluating the performance of models. About the opportunity: We are seeking detail-oriented English speakers to review...Hourly payContract workFor contractorsWork experience placementFreelanceInternshipRemote workNight shiftScale AI
San Francisco, CA2 days ago$15 per hour
...Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts work on a variety of projects, from generating training data to evaluating the performance of models. About the opportunity: We are seeking detail-oriented English speakers to review...Hourly payContract workFor contractorsWork experience placementFreelanceInternshipRemote workNight shiftScale AI
San Francisco, CA2 days ago- ...Mercor is seeking an evaluator for nonprofit/philanthropy programs in a remote, contract role. You will assess AI-generated artifacts against quality rubrics, identify factual and presentation errors, and deliver concise feedback. Deep domain expertise will guide grading...Contract workWork at officeRemote work
Mercor Inc
San Francisco, CA4 days ago - ...Mercor is seeking a UI/UX Design Expert for a remote, contract-based role. You will design grading criteria for real-world digital products and evaluate AI-generated and human work samples against defined criteria. Apply evidence-based judgment, incorporate senior feedback...Contract workRemote work
Mercor Inc
San Francisco, CA4 days ago - ...interpretation, accuracy, relevance, response timing, and use of spatial language. The ideal candidate is a native or near-native English speaker with clear, precise writing, strong attention to detail, and prior experience in data annotation or AI model #J-18808-Ljbffr...Contract workRemote work
Mercor Inc
San Francisco, CA3 days ago $175k - $275k
...Principal in San Francisco who possesses a strong engineering background and excellent communication skills. In this role, you'll evaluate the technical capabilities of startups while actively engaging with founders in the consumer software, games, and crypto sectors....NFX
San Francisco, CA3 days ago- ...Mercor is seeking a contract-based Legal/Compliance Evaluator to assess AI-generated artifacts against quality rubrics, providing structured feedback while applying domain expertise. The role is remote and requires independent, deadline-driven work with strong English...Contract workWork at officeRemote work
Mercor Inc
San Francisco, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Science Evaluator - Expert. Be the first to apply!
Related searches
- quality evaluator San Francisco, CA
- evaluator San Francisco, CA
- social media evaluator San Francisco, CA
- education evaluator San Francisco, CA
- ai evaluator San Francisco, CA
- work from home web search evaluator San Francisco, CA
- data science associate San Francisco, CA
- data integration specialist San Francisco, CA
- data entry associate San Francisco, CA
- data specialist San Francisco, CA