Math & Statistics - AI Evaluation Expert
Temporary
Rise Data Labs
What You'll Do
Apply your subject-matter expertise to advanced AI training and evaluation work
Develop or evaluate challenging problems within your area of expertise
Assess AI-generated reasoning for technical accuracy and identify subtle errors or failure modes
What We're Looking For
Master's degree required; PhD strongly preferred
in Mathematics, Statistics, Applied Mathematics, Probability, Operations Research, or a closely related quantitative field
Advanced academic, research, or professional expertise within your specialization
Strong analytical reasoning and ability to evaluate complex mathematical or statistical work
Prior AI training, evaluation, benchmarking, or LLM experience is a plus
Flexible, remote contract work starting ASAP.
Vacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the Math & Statistics - AI Evaluation Expert in New York, NY vacancy
- Rise Data Labs is seeking advanced Mathematics and Statistics experts to support the training and evaluation of state-of-the-art AI systems. We need subject-matter experts who can apply deep quantitative knowledge to AI evaluation problems, assess AI-generated reasoning...SuggestedRemote jobContract workImmediate startFlexible hours
$70 - $75 per hour
...am looking for a Knowledge Expert - Math for Meta. This is an 18 week... ...and help build foundational AI models from the ground up. We... ...guidelines and detailed rubrics / evaluation frameworks to assess legal... ..., Calculus, Probability and Statistics, Number Theory, or Topology...SuggestedFull timeContract workFor contractorsRemote workFlexible hours- 1. Overview Join a leading AI lab's cutting-edge GenAI team and help build foundational AI models... .... We’re seeking talented Retail subject-matter experts (SMEs) with deep domain expertise and hands-on experience evaluating AI model outputs against rubrics to bring rigor...SuggestedContract workWeekday work
- Obsidian is seeking a Medical Expert to help train AI models with high-quality healthcare reasoning data. You will design clinical scenarios, evaluate model outputs, and provide essential feedback to improve AI-driven patient care. This remote, asynchronous role defaults...SuggestedRemote jobFlexible hours
- Mercor is partnering with a leading AI lab to design and evaluate disability adjudication processes for frontier AI models. You will craft realistic disability scenarios, generate determinations and evidence summaries, and assess AI-generated responses against established...Suggested
- ...-based — no fixed working days Weekday is an AI-native recruiting platform. We are backed by Y... ...them. We are now running an AI training and evaluation project as a YC-backed AI data lab, and we're looking for legal experts to build and judge the tasks that advanced AI...Full timeContract workRemote workFlexible hoursWeekday work
- Prolific is seeking Computer Science Specialists to join our Expert Network to help train and evaluate cutting‑edge AI models. If you have a background in CS research or technical analysis, you’ll complete a brief 10- to 15‑minute test to assess your skills. If successful...Remote jobWork from homeFlexible hours
$60 per hour
Prolific seeks Computer Science Specialists to join its Expert Network for AI model training and evaluation. You’ll complete a short skills test, then contribute by ranking responses, reviewing papers, and ensuring technical accuracy. Pay is up to $60/hr, with opportunities...Work from homeFlexible hours- Mercor in the United States is seeking experienced Spanish Linguistic Experts to join an AI research project in partnership with a leading research lab. The role focuses on evaluating how effectively a large language model performs in Spanish-language tasks and on curating...
$150 per hour
...seeking experienced accounting professionals for a short-term AI training and evaluation project. You should bring 5+ years of accounting plus 3+... ...and professional judgment to improve AI systems. Selected experts will receive specific workflows, tools, and training, with...Remote jobTemporary work- Prolific in New York, NY, is seeking Chemistry Experts and Chemical Engineers to join its Expert Network. In this role, you will help train and evaluate AI models using your chemical expertise. Duties include evaluating AI-generated responses for accuracy and validating...Remote jobWork from homeFlexible hours
- Prolific is seeking Fluent Korean Speakers to join our Expert Network to help train and evaluate AI models using real legal expertise. If you have the necessary experience, we’ll send you a quick 10- to 15-minute test to assess your skills and suitability for AI tasks....Remote job
$60 - $80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...solutions grounded in real retail practice. Evaluate AI model outputs against structured... ...Collaborate with other subject matter experts to ensure consistency and accuracy in training...Contract workSummer workRemote workWeekday workMercor
New York, NY15 days ago- Prolific is seeking a JavaScript Specialist to join our Expert Network, evaluating AI-generated JavaScript/TypeScript code for accuracy and reliability. You will complete a short test and, if successful, participate as a paid contributor training AI models. Expect to review...Remote workFlexible hours
- Mercor is seeking Clinical Mental Health Experts to support an AI research initiative that evaluates the realism and quality of simulated clinical conversations. This is a short-term, fully remote evaluation task designed for mental health professionals who can apply clinical...Remote jobTemporary work
$45 - $70 per hour
Behavioral Health Expert, AI Safety and Model Evaluation is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated...For contractorsRemote work10 hours per week- 1. Overview A leading AI lab is seeking behavioral health experts to help evaluate and improve how its AI models handle sensitive, everyday conversations. People increasingly turn to AI for support with relationships, family dynamics, emotional wellbeing, personal beliefs...Contract workPart timeWeekday work
$60 - $70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...$60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance...Contract workSummer workRemote workMercor
New York, NY7 days ago- ...contribute their clinical expertise to the development and evaluation of next-generation AI systems. This remote, contract opportunity requires real-... ...will help create realistic clinical scenarios, develop expert reference responses, and evaluate AI outputs for clinical...Remote jobContract work
$80 - $150 per hour
Prolific in New York, NY, is seeking Medical Doctors to join our Expert Network for training and evaluating AI models. As a Domain Expert participant, you will review and rate AI-generated clinical responses, providing crucial feedback for AI development. You must hold...Remote jobHourly payWork from homeFlexible hours$40 per hour
Prolific is seeking Neuroscience Experts to act as evaluators for a high-level AI verification project. You will review dense scientific literature and judge the accuracy of AI-generated graphical abstracts, ensuring factual integrity. This remote advisory role pays $4...Remote jobHourly payFlexible hours$30 per hour
...About Prolific Prolific is not just another player in the AI space – we are building the biggest pool of quality human... ...Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation...Remote workWork from homeFlexible hoursProlific
New York, NY1 day ago- Appsierra Group is seeking an experienced Registered Nurse to evaluate and rank AI-generated clinical content for safety and accuracy. This... ...clinical documentation meet high standards. You will develop expert demonstrations from real nursing practice, assess model responses...Remote jobFor contractors
- YO AI Labs is seeking established Physics Professors and Principal Investigators to provide high-level scientific expertise for a project advancing next-generation AI systems. You will adjudicate physics arguments, assess reasoning, and deliver authoritative judgments...Remote job
- Mercor, in partnership with Crossing Hurdles, is looking for a Multimedia Expert to work remotely on project-based tasks. The role involves reviewing and editing multimedia outputs, creating assets for AI model training, and providing feedback to ensure quality standards....Remote jobPart time10 hours per week
- Mercor is seeking proficient bilingual speakers (Turkish & English) to help strengthen how AI models handle sensitive topics in Turkish. You will write expert-level prompts and apply guidelines to classify content, flag adversarial phrasing, and document reasoning. Start...Immediate start
- ...What You'll Do Apply your subject-matter expertise to advanced AI training and evaluation work Develop or evaluate challenging problems within your area of expertise Assess AI-generated reasoning for technical accuracy and identify subtle errors or failure modes...Contract workImmediate startRemote workFlexible hours
Rise Data Labs
New York, NY12 days ago $100 - $120 per unit
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Baseball Fan Live MLB Game AI Evaluator (US) Type: Contract Compensation... ...schedules broadcasts highlights and expert-style analysis. Run the same question...Full timeContract workWork experience placementSummer workRemote work$50 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar...Contract workSummer workRemote workFlexible hoursMercor
New York, NY25 days ago- ...small but sharp team in Zurich, we're looking for analytical and driven Geopolitical and Event Forecasting Professionals to help us evaluate AI-generated predictions about real-world events . Estimated project scope of approximately 15 hours/week . Tasks Evaluate AI-...Freelance
Lightly AG
New York, NY2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Math & Statistics - AI Evaluation Expert. Be the first to apply!
Related searches
- sql expert New York, NY
- fulfillment expert New York, NY
- technology expert New York, NY
- subject matter expert New York, NY
- guest service support expert New York, NY
- mathematics specialist New York, NY
- math phd New York, NY
- math degree New York, NY
- summer jobs for maths students New York, NY
- maths New York, NY