Applied Mathematics Benchmark Specialist - review AI outputs in your specialty
Mercor
Role Overview We are seeking expert mathematicians to author and review high-quality academic assessment content for an AI research initiative. You will write and verify rigorous multiple-choice questions across core mathematics domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be assigned one of two task types: Question Authoring - Create original, challenging multiple-choice questions in your area of mathematical expertise, rate their difficulty, and submit them for review. Question Verification - Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made. Mathematics Domains Covered Signal Processing Financial Mathematics & Actuarial Science Mathematical Economics Mathematical Modeling of Ecological & Biological Systems Mathematical Programming & Combinatorial Optimization Geomathematics & Climate Modeling. Key Responsibilities Author original math questions that test deep conceptual understanding, not surface-level recall Ensure questions are unambiguous, self-contained, and precisely defined - all necessary information must be in the problem statement Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above) Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers Write step-by-step Chain-of-Thought solutions with clear, concise intermediate steps in markdown format Supply 1-5 academic references per question from reputable sources (peer-reviewed journals, university repositories) For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made Ideal Qualifications PhD or doctoral candidate in Mathematics, Applied Mathematics, Statistics, or a closely related field Master's degree considered for candidates with exceptional depth in a specific subdomain Strong command of graduate-level mathematical concepts and formal proof writing Experience with rigorous academic problem design or mathematical competition writing is a strong plus Excellent written English and ability to express complex ideas clearly and concisely More About the Opportunity Expected commitment: 10+ hours/week Asynchronous, fully remote work #J-18808-Ljbffr Mercor
- ...possibilities? Start here. AI RESEARCH AT... ...is reproducible, benchmarked against strong... ...production. Because our output serves multiple... ...data snooping. Applied quantitative... ...researchers and engineers, review research designs... ..., Statistics, Mathematics, Physics, Electrical...SuggestedFull timeWork at officeImmediate start
$8 - $30 per hour
...independent LaTeX Specialists to provide their expertise for an AI benchmark evaluation... ...content that blends mathematical and technical formatting... ...robust, expert-reviewed training data.... ...refine complex AI outputs. Expected deliverables... ...Application: Applying complex, multi-...SuggestedHourly payFor contractorsFreelanceRemote work$44 - $56 per hour
...experts in history and political science to author and review high-quality academic assessment content for an AI research initiative. You will write and verify... ...quality, and help establish gold-standard benchmarks used to advance AI capabilities. You will be assigned...SuggestedHourly payRemote workWeekday work- Mercor is seeking an Applied Biology Benchmark Specialist for a remote contract role, offering 10+ hours per week. You will author original biology questions spanning Pharmaceutical Manufacturing, Industrial and Synthetic Biology, Medical Research & Drug Discovery, and...SuggestedRemote jobContract work10 hours per week
$169k - $228.6k
...future of generative AI and eager to help the... ...including model performance benchmarking, output quality assessment,... ...high-calibre group of specialist Solutions Architects... ...Day-to-day, you'll: • Review customer requirements... ...encourage candidates to apply. If your career is just...SuggestedFlexible hours- Are you a mathematics expert fluent in Swedish, eager to shape the future of AI? Large-scale language models are... ...looking for mathematics specialists who live and breathe... ...algorithms, and applied mathematics—documenting... ...field is ideal; peer‑reviewed publications, teaching...Hourly payContract workFor contractorsFreelanceRemote work
$207k - $275k
...The Essential Cloud for AI. Built for pioneers by... ...market-maker. As a Solution Specialist for AI Runtime Services... ...playbooks, and benchmark narratives that help sales... ...with a track record of applying that expertise to drive... ...actual compensation, we review the market rate for...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$142.8k - $193.2k
...the teamThis position is part of the AWS Specialist and Partner Organization (ASP).... ...description, we encourage candidates to apply. If your career is just starting, hasn’t... ...degree in computer science, engineering, mathematics or equivalent- Experience in quota carrying...Flexible hours$153.6k - $207.8k
...AWS is seeking a Sr. Database Specialist Solutions Architect to serve... ..., and architecture reviews, applying technical judgment to evaluate... ...right workload.- Generative AI fluency: Understanding of how... ...Certifications: AWS Database Specialty, AWS Solutions Architect Professional...Work at officeFlexible hours- Agency is seeking a Pure Mathematics and Lean 4 Specialist for a freelance AI trainer project. The role emphasizes rigorous proof construction, formalization... ...in Lean 4, and collaboration to improve evaluation benchmarks. Ideal candidates hold a PhD or PostDoc in pure...Freelance
- Review Specialist United States -- Remote | Full-time Job Description Safal... ...the quality of review outputs across standards alignment,... ...content area (e.g., ELAR, mathematics, science, social studies),... ...Experience Experience reviewing or applying rubrics to instructional...Full timeWork at officeImmediate startRemote workFlexible hoursShift work
$50 - $90 per hour
...School Social Workers for a remote, flexible position. Responsibilities include designing insightful questions for AI, collaborating with teams, and reviewing content to ensure it meets social work standards. Ideal candidates should have strong experience in child welfare...Remote jobHourly payContract workFlexible hours$210.2k - $284.3k
...Description AWS is hiring an AI Transformation Specialist to lead enterprise... ...identification of unrealized value, benchmarking customer usage against... ...executive business reviews that connect Bedrock adoption... ...we encourage candidates to apply. If your career is just...Local areaFlexible hoursShift work$32.85 - $35.71 per hour
Broadcast Standards & Practices Associate / Ad Review Specialist 2 days ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features... ...effectively issue spot and interpret and apply policy. To determine whether advertising is truthful...Fixed term contract- ...sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project assessing advanced... ..., audit conversational AI outputs, and generate clean, reliable datasets... ...such as health insurance and PTO do not apply. Engagement Type: Freelance / Independent...Hourly payFor contractorsFreelanceRemote work
$8 - $65 per hour
...to shape the future of AI? Large-scale language models... ..., education, and applied problem-solving. With high... ...skilled Chemistry specialist fluent in Arabic who can... ...tools, evaluate and refine outputs, and provide expert... ...typical day, you will review and annotate AI-generated...Hourly payContract workFor contractorsFreelanceRemote workWorldwide- ...PCI) surveys? Advanced AI systems are being developed... ...tasks. You will review roadway images, inspection... ...records, and AI-generated outputs to determine whether... ...transportation engineers, DOT specialists, highway inspectors,... ...to consistently apply pavement distress definitions...Hourly payFor contractorsFreelanceRemote work
$11 - $30.65 per hour
Agentic Audio Specialist - Freelance AI Trainer Project Contribute to the development... ...to diverse datasets and apply structured evaluation... ...Specialist, you will help benchmark and improve AI-powered audio... ...coherence, and naturalness. Review audio comprehension, response...Hourly payFor contractorsFreelanceRemote work$162.7k - $220.2k
...scale? We are looking for a Senior Data & AI GTM Specialist to build and own the campaign execution... ...technical skill of the role. You will apply AI both to mine thousands of internal... ...signals that are stalling deals in business reviews, quantifying blocked pipeline by root...Local areaWorldwideFlexible hoursNight shiftDay shift- ...Associate Applied Researcher At JPMorgan Chase, we're building the next generation of AI-powered workflow automation. This is a hands-on role for someone who thrives on... ...and operating monitoring/QA processes for LLM outputs (quality, safety, reliability) About Us...
- ...Odyssey House is looking for a Full-Time Utilization Review Specialist. Summary: Odyssey House's Mission is "Empowering people to heal and... ...of your paycheck early for hours already worked! (conditions apply) UTA free passes available for your work commute Functions of...Full timeContract workTemporary workCasual workLocal areaImmediate startFlexible hoursShift work
$150k
...how healthcare works: applying 550+ proprietary clinical... ...metrics across 80+ specialties to a dataset of 320M+... ...the U.S. — and using AI to scale that impact further... ...can rely on, and review your peers' code and analyses... ...in Computer Science, Mathematics, Statistics, Economics...Work visaFlexible hours$50 per hour
...technical talent with leading AI research labs.... ...our investors include Benchmark , General Catalyst , Peter... ...and grading to assess outputs for accuracy and fluency... ...Participate in QA and review cycles to maintain quality... ..., language models, or applied research environments....Contract workSummer workRemote work$90k - $125k
...expertise to help you succeed. With over 30 specialty and property and casualty operations,... ...Division is seeking an Underwriting Specialist to join its team. This role supports the... ...information and clarify details.Orders and reviews additional reports and screens, such as...Full timePart timeSeasonal workRemote work$176.6k - $239k
...platform is headed next? As a Specialist Solutions Architect for Aurora... ...and participating in roadmap reviews.• Engage with customer engineers... ..., we encourage candidates to apply. If your career is just starting... ...Java, etc.), and fluency with AI tooling (Kiro, Claude Code,...Local areaWorldwideFlexible hours- ...Every day, our teams harness cutting-edge AI and breakthrough technologies to... ...Platform/Line of Business Resiliency teams to review their Evergreen positions and recommend key... ...Hands-on experience utilizing AI tools and applying AI techniques.Ability to translate a...Work experience placementWorldwideFlexible hours
$169k - $228.6k
...generative artificial intelligence (AI) and business intelligence?... ...a thought leader and deep specialist in Amazon Quick, our AI... ...peer — participating in design reviews, beta programs, and feature validation... ...If the country/region you’re applying in isn’t listed, please...WorldwideFlexible hours- AuraOne, Inc. is seeking a remote Robotics Expert to review outputs against real-world safety envelopes and operating standards. You will assess perception, motion, and decision logic, scoring them on a structured rubric and flag potential safety concerns. The role emphasizes...Remote jobFor contractors
- ...Adolescent Addiction Specialist Role Type... ...this role, you'll apply your expertise to... ...train next-generation AI systems. Your work... ...matters. Scope of Work Review clinical case... ...guidelines. Compare and benchmark your assessments... ...use. Clinical specialty in addiction medicine...For contractorsImmediate startRemote work
- ...including decks, memos, and financial models. No prior AI experience is required, but senior-stakeholder-ready output is essential. You will craft board-level recommendations, build Excel models from scratch, and apply MECE and pyramid principles to complex business...Remote jobContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Applied Mathematics Benchmark Specialist - review AI outputs in your specialty. Be the first to apply!
- sewing specialist New York, NY
- graduation specialist New York, NY
- sem specialist New York, NY
- technology integration specialist New York, NY
- consumer insights specialist New York, NY
- drilling fluids specialist New York, NY
- vulnerability management specialist New York, NY
- evaluation specialist New York, NY
- escalation specialist New York, NY
- outsourcing specialist New York, NY



