Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Combinatorics Model Evaluator [Remote]

AuraOne Human Data

Remote
  • Remote job

Combinatorics Model Evaluator is a remote review track for evaluating AI outputs across combinatorics model research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.

Why this role matters

Combinatorics Model research review models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would — checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one.

Responsibilities

  • Review AI outputs against current combinatorics model research review methods, conventions, and prior work for Combinatorics Model Evaluator assignments.
  • Reproduce or sanity-check key derivations, calculations, or experimental claims.
  • Flag dimensional, methodological, and citation errors with structured severity tags.
  • Capture the corrected reasoning or worked example so the modeling team can train on it.
  • Adjudicate disputed answers against textbooks, papers, or community standards.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Graduate-level training or equivalent applied experience in combinatorics model research review or a closely related field for Combinatorics Model Evaluator work.
  • Hands-on experience publishing, teaching, or advising on the topic at a professional level.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites methods, papers, or worked examples.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Reproduce a combinatorics model research review derivation from a model output and flag any algebraic or dimensional errors.
  • Grade a model's literature summary against the cited papers and rate the citation quality.
  • Adjudicate a disputed answer between two reviewers using textbook methods.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • PhD, postdoc, or industry research experience in the topic area.
  • Prior work reviewing AI-assisted research tooling and its failure modes.
  • Multilingual fluency for non-English papers and corpora.

Skills

  • Scientific reasoning
  • Method validation
  • Citation review
  • Quantitative analysis
  • Combinatorics Model research review
  • Formal reasoning
  • Proof review
  • Combinatorics

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Combinatorics Model Evaluator [Remote] in Remote vacancy
  • $20 per hour

     ...public sources and external tools. Generate high-quality human evaluation data by identifying response strengths, areas for improvement,...  ...quality, clarity, tone, and completeness of responses. Ensure model responses align with expected conversational behavior and system... 
    Suggested
    Remote job
    Contract work
    Part time
    Summer work

    Mercor

    New York, NY
    4 days ago
  • $65 per hour

    Prolific is seeking registered nurses in Las Vegas, NV, to assist in training AI models. You will review AI responses, rate their accuracy and safety, and write feedback to enhance AI learning. Candidates must be verified registered nurses, have recent clinical experience... 
    Suggested
    Hourly pay
    Self employment
    Work from home
    Flexible hours

    Prolific

    Las Vegas, NV
    3 days ago
  •  ...Medical Document OCR Model Evaluator is a remote clinical-review track for evaluating AI outputs that touch clinical review. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    21 days ago
  •  ...Helpfulness Ranking Reward Model Evaluator is a remote evaluation track for reviewing helpfulness ranking reward model evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of structured... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    15 days ago
  •  ...Refusal Preference Reward Model Evaluator is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    7 days ago
  •  ...Policy Preference Reward Model Evaluator is a remote review track for evaluating AI outputs in policy review workflows. Reviewers grade citation accuracy, statutory reasoning, and policy adherence; flag risk; and document the corrected analysis so the modeling team can... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    14 days ago
  • $52k - $57k

     ...Job Description Job Description POSITION TITLE: Program Evaluator REPORTS TO: Director of Quality      BROAD FUNCTION:  Collects, analyzes, and reports on data to evaluate effectiveness of program services.  I. CORE VALUES: # CULTURAL PROFICIENCY: Articulates... 
    Full time
    Summer work
    Local area

    Family Connections, Inc.

    East Orange, NJ
    8 days ago
  • Job Description Our client in MI is looking for Model-N admins . experience in integrating with Model N and configuring Model N.  Additional Information
    Full time

    Deegit Inc

    Remote
    1 day ago
  •  ...Mental Health Evaluator The Mental Health Evaluator is a critical role dedicated to delivering comprehensive, clinically appropriate, culturally competent, and trauma-informed patient behavioral health interventions in the hospital Emergency Department. Responsibilities... 

    Maria Fareri Children's Hospital, a member of the WMCHealth ...

    Poughkeepsie, NY
    5 days ago
  •  ...Luxury Brand Evaluator Turn your passion for luxury into a career opportunity. Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in customer experience, and work alongside iconic names... 
    Remote work
    Worldwide
    Flexible hours

    CXG

    United States
    5 days ago
  • $79.4k - $119.1k

     ...This position represents Auto Spec Control department in a development team environment as Project Lead on a mix of complex Full Model Change (FMC) and Minor Model Change (MMC) developments. Creates, promotes, and manages critical milestones for successful package delivery... 
    Full time
    Temporary work
    Work experience placement
    Work at office
    Remote work
    Relocation package

    Honda Dev. and Mfg. of Am.,LLC

    Raymond, OH
    22 days ago
  • $14.5 per hour

    A technology company is seeking an AI Web Search Evaluator to enhance the quality of search engine results. This flexible, remote, part-time role focuses on analyzing search performance and providing feedback to improve algorithms. Ideal candidates will have strong analytical... 
    Hourly pay
    Part time
    Remote work
    Flexible hours

    Welo Data

    United States
    5 days ago
  • A leading digital solutions provider is seeking a Personalized Ads Evaluator for a part-time position. This entry-level role involves reviewing online advertisements to assess their relevance to search terms, providing detailed feedback on content and cultural context.... 
    Part time
    Remote work

    TELUS Digital AI Data Solutions

    United States
    4 days ago
  • $14.5 per hour

     ...AI Web Search Evaluator Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years of experience in... 
    Hourly pay
    Part time
    Currently hiring
    Immediate start
    Remote work
    Work from home
    10 hours per week
    Flexible hours

    Welo Data

    United States
    3 days ago
  • A leading AI research accelerator is seeking a contractor to evaluate North American teen humor. The ideal candidate will review and rate humorous content popular among teens and explain its appeal. This role offers flexible, project-based work with competitive pay and... 
    For contractors
    Freelance
    Remote work
    Flexible hours

    Turing

    United States
    2 days ago
  • $80 - $120 per hour

     ...This role is for one of our clients Compensation: $80 - $120 per hour We are hiring expert Evaluators in Special education / IEP to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality... 
    Hourly pay
    Contract work
    For contractors
    Work at office
    Remote work

    Weekday AI

    United States
    1 day ago
  • $80 - $120 per hour

     ...Special Education Iep Evaluator This role is for one of our clients. Compensation: $80 - $120 per hour. We are hiring expert Evaluators in special education / IEP to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy... 
    Hourly pay
    Remote work

    Weekday

    United States
    1 day ago
  •  ...wholesale partners, and sells online through its website, which serves customers across the United States and globally at WOMEN'S FIT MODEL: This is a part-time opportunity to be a part of the design process and to influence the comfort and fit of our clothing. You will... 
    Part time
    Flexible hours

    The Normal Brand

    Saint Louis, MO
    3 days ago
  •  ...Family Model Provider Type: Family Model Provider (TN) - Independent Contractor If you are a positive and personable individual looking for a satisfying and fun opportunity to make a real difference in the lives of people with intellectual, developmental disabilities... 
    Full time
    Contract work
    For contractors
    Live in
    Work from home

    RHA Health Services

    Kingsport, TN
    18 hours ago
  •  ...a caring, compassionate, and reliable person? Here is an opportunity to make a lasting impact on someone’s life – become an Family Model Provider !! This is a chance to help make a difference by opening your home to an individual with developmental and/or physical disabilities... 
    Daily paid

    Community Options

    Chattanooga, TN
    3 days ago
  •  ...talent in a variety of ways. We are pleased that you are interested in career opportunities offered at MICA. General purpose: Models will pose for art students for the purpose of studying the human figure. Summary of Essential Functions: Model poses may include... 

    Maryland Institute College of Art

    Baltimore, MD
    1 day ago
  •  ...programs and deliver value to our business. At Applied Intuition, You Will: Conduct research on pretraining world-action foundation model with various world modalities including vision and physics associated with ego actions, serving the purpose for both robot action... 
    Full time
    For contractors
    For subcontractor
    Casual work
    Internship
    Work at office
    Immediate start
    Remote work
    Day shift

    Applied Intuition

    Sunnyvale, CA
    2 days ago
  • $170k - $216k

     ...engineers like you to (1) develop methods for efficiently and continuously learning from large scale real-world data, to (2) develop models and model training at scale, to (3) analyze real-world behavior and develop systems for handling the complexities of interacting... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    1 day ago
  • $175k - $215k

     ...are currently focusing on include reinforcement learning, learning from demonstration, generative modeling, Bayesian inference, hierarchical learning, and robust evaluation. In this hybrid role, you will report to a Senior Research Scientist. You will:... 
    Full time
    Remote work

    Waymo

    New York, NY
    1 day ago
  • $228.7k - $343.1k

     ...and screens for financial crime at enormous scale, and one bad model can mean millions in credit losses, suspicious activity that goes...  ...that lets a lean team validate at scale, so you critically evaluate what it produces and own the evaluation that confirms its output... 
    Remote job
    Full time
    Local area
    Shift work

    Block

    New York, NY
    1 day ago
  •  ...building next-generation AI infrastructure to power the world’s most demanding AI workloads. We provide high-performance GPU compute and Model API services, enabling AI companies, research labs, and enterprises to train and deploy cutting-edge models at scale. Our platform... 
    Remote job
    Full time
    Flexible hours

    Yotta Labs

    United States
    1 day ago
  • $60 - $90 per hour

     ...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Machine Learning Engineer — Model Evaluation & Experimentation Type: Contract Compensation: $60–$90/hour Location: Remote Commitment:... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Remote
    1 day ago
  •  ...communities thrive. Schedule: M-F, 8am- 5pm . This is a remote position, open to Missouri Residents only.  The Project Evaluator-GLS plays a key role in evaluating the Garrett Lee Smith (GLS) Program by overseeing data collection, analysis, and reporting. This... 
    Remote work

    Compass Health Network

    Clinton, MO
    4 days ago
  • $22 - $25 per hour

     ...REVOLVEcareers or #lifeatrevolve. Are you ready to set the standard for Premium apparel? Main purpose of the position: The Fit Model will try on samples of clothes and express his or her expert knowledge on the fit of the garment, movement, fabric hand and feel,... 
    Hourly pay
    Flexible hours

    REVOLVE

    Cerritos, CA
    9 days ago
  • $298k - $368k

     ...engineers like you to (1) develop methods for efficiently and continuously learning from large scale real-world data, to (2) develop models and model training at scale, to (3) analyze real-world behavior and develop systems for handling the complexities of interacting... 
    Full time
    Remote work

    Waymo

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Combinatorics Model Evaluator [Remote]. Be the first to apply!