Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Causal Reasoning Model Evaluation Specialist [Remote]

AuraOne Human Data

Remote
  • Remote job

Causal Reasoning Model Evaluation Specialist is a remote review track for evaluating AI outputs across causal reasoning model evaluation research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.

Why this role matters

Causal Reasoning Model Evaluation research review models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would — checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one.

Responsibilities

  • Review AI outputs against current causal reasoning model evaluation research review methods, conventions, and prior work for Causal Reasoning Model Evaluation Specialist assignments.
  • Reproduce or sanity-check key derivations, calculations, or experimental claims.
  • Flag dimensional, methodological, and citation errors with structured severity tags.
  • Capture the corrected reasoning or worked example so the modeling team can train on it.
  • Adjudicate disputed answers against textbooks, papers, or community standards.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Graduate-level training or equivalent applied experience in causal reasoning model evaluation research review or a closely related field for Causal Reasoning Model Evaluation Specialist work.
  • Hands-on experience publishing, teaching, or advising on the topic at a professional level.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites methods, papers, or worked examples.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Reproduce a causal reasoning model evaluation research review derivation from a model output and flag any algebraic or dimensional errors.
  • Grade a model's literature summary against the cited papers and rate the citation quality.
  • Adjudicate a disputed answer between two reviewers using textbook methods.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • PhD, postdoc, or industry research experience in the topic area.
  • Prior work reviewing AI-assisted research tooling and its failure modes.
  • Multilingual fluency for non-English papers and corpora.

Skills

  • Scientific reasoning
  • Method validation
  • Citation review
  • Quantitative analysis
  • Causal Reasoning Model Evaluation research review
  • Frontier evaluation
  • Rubric calibration
  • Failure analysis
  • Causal
  • Reasoning

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 15 hours ago
Similar jobs that could be interesting for youBased on the Causal Reasoning Model Evaluation Specialist [Remote] in Remote vacancy
  •  ...Multi-Step Reasoning Model Evaluation Specialist is a remote evaluation track for reviewing multi step reasoning model evaluation evaluation prompts and responses against AuraOne's quality rubric. Reviewers compare paired outputs, label edge cases, and write the kind of... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne Human Data

    Remote
    15 hours ago
  • $60 - $90 per hour

     ...where your expertise fuels the development of the most advanced AI models. Overview A leading AI lab is building the next generation of agentic evaluation benchmarks for frontier models and needs specialists who can find where those models break. Working in a red-teaming... 
    Suggested
    Hourly pay
    Full time
    Contract work
    Part time
    Freelance
    Remote work

    SaidGig

    United States
    3 days ago
  • $15 - $25 per hour

     ...As a Legal Specialist, you will leverage your legal expertise to contribute to the training...  ...a crucial role in shaping how these models learn, reason, and perform by providing high-...  ...policies to support structured legal evaluations. Prepare concise written summaries... 
    Suggested
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    SaidGig

    United States
    3 days ago
  •  ...Quant Finance Reasoning Model Evaluator is a remote review track for evaluating AI outputs across finance and risk workflows. Reviewers grade...  ...Work model Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    15 hours ago
  • $350k

     ...pivotal role in shaping the future of AI-powered legal reasoning. This position focuses on the intersection of large language models, agentic systems, and legal workflows, emphasizing the development of rigorous evaluation frameworks to measure and enhance AI performance in... 
    Suggested
    Remote job
    Full time

    SaidGig

    United States
    2 days ago
  • $70 - $90 per hour

     ...and low-level programming experts to apply their knowledge in systems programming and security concepts to enhance AI models'' ability to detect and reason about potential threats. The opportunity begins with a work trial and may extend into a two-month project based on... 
    Hourly pay
    Remote work

    SaidGig

    United Kingdom
    25 days ago
  • $60 per hour

     ...professionals to help advance AI development. AI models are increasingly capable of performing complex analytical and scientific reasoning — but these systems still need...  ...state-of-the-art AI models on tasks like evaluating AI-generated quantitative analysis, solving... 
    Hourly pay
    Full time
    Remote work
    Flexible hours

    DataAnnotation

    Little Rock, AR
    16 hours ago
  • $40 per hour

     ...firm is looking for experienced quantitative professionals to evaluate AI-generated work and design problems for AI training. This fully...  ...AI systems' development. Join us to shape the future of AI reasoning while working from anywhere in the US, Canada, UK, Ireland, Australia... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Bismarck, ND
    5 hours ago
  • $40 per hour

     ...seeking experienced quantitative professionals to evaluate AI-generated analyses and contribute to the evolution of AI models. Candidates should have a background in data...  ...problems and provide technical feedback on AI reasoning systems, shaping the future of data analytics.... 
    Hourly pay
    Remote work

    DataAnnotation

    Lansing, MI
    5 hours ago
  • $40 per hour

     ...company is seeking experienced quantitative professionals to evaluate AI-generated analyses and contribute to the development of cutting...  ...or statistics and strong coding skills. Join us to directly impact the future of AI analytics and model reasoning. #J-18808-Ljbffr... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Lincoln, NE
    5 hours ago
  • A data technology company is seeking a Statistician to enhance AI models by evaluating their logic and progress. The role demands expert-level mathematical reasoning and offers a flexible working schedule, allowing for full-time or part-time remote work. Responsibilities... 
    Hourly pay
    Full time
    Part time
    Remote work
    Flexible hours

    DataAnnotation

    Raleigh, NC
    5 hours ago
  •  ...Pull Request Reasoning Evaluation Specialist is a remote review track for evaluating AI outputs across pull request reasoning evaluation specialist...  ...risk; and document the right next step so the modeling team can train on it. Why this role matters Pull Request... 
    Remote job
    Hourly pay
    For contractors
    Work experience placement
    10 hours per week

    AuraOne Human Data

    Remote
    15 hours ago
  •  ...data services company is seeking an Applied Mathematician to evaluate AI models by providing complex mathematical problems to chatbots and...  ...schedule. Applicants should possess expert-level mathematical reasoning and fluency in English. Payment is hourly, starting at $40,... 
    Hourly pay
    Remote work

    DataAnnotation

    New York, NY
    1 day ago
  • $40 per hour

     ...seeking experienced quantitative professionals to evaluate AI-generated work and help advance AI development...  ...the development of AI systems while influencing their ability to reason about data. Join us to help shape the future of AI models! #J-18808-Ljbffr DataAnnotation
    Remote job
    Hourly pay

    DataAnnotation

    New York, NY
    16 hours ago
  • $20 per hour

     ...external tools. Generate high-quality human evaluation data by identifying response strengths, areas...  ...improvement, and factual inaccuracies. Assess reasoning quality, clarity, tone, and completeness of responses. Ensure model responses align with expected conversational... 
    Remote job
    Contract work
    Part time
    Summer work

    Mercor

    New York, NY
    1 day ago
  • $40 per hour

     ...for experienced quantitative professionals to evaluate AI-generated quantitative work and contribute...  ...familiarity with statistical methods and predictive modeling. Join us and help shape the future of AI systems built to reason about data and analytics. #J-18808-Ljbffr... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Boston, MA
    3 days ago
  • $40 per hour

     ...tech firm is seeking experienced quantitative professionals to evaluate AI-generated analyses and enhance AI development. The role...  ...This opportunity impacts the evolution of AI systems focused on reasoning and data analytics. Applicants can work alongside other roles... 
    Remote job
    Hourly pay

    DataAnnotation

    Brooklyn, NY
    16 hours ago
  • $40 per hour

     ...development company seeks experienced quantitative professionals to evaluate AI-generated work and solve quantitative problems. This fully...  ...us to contribute to shaping the future of AI systems focused on reasoning about data and analytics. #J-18808-Ljbffr DataAnnotation
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Little Rock, AR
    3 days ago
  • $40 per hour

     ...company is seeking experienced quantitative professionals to evaluate AI-generated quantitative work, solve quantitative problems, and...  ...quantitative field. Join a team that helps shape the future of AI systems tailored for data reasoning. #J-18808-Ljbffr DataAnnotation
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Juneau, AK
    3 days ago
  •  ...contribute to AI research projects that enhance the understanding of workplace tasks and language in their field. This role involves evaluating AI model outputs, assessing content related to your profession, and providing structured feedback to improve AI performance. The... 
    Remote work
    Flexible hours

    SaidGig

    United States
    2 days ago
  • $50 - $60 per hour

     ...seeking a Senior Financial Analyst to improve AI outputs by evaluating their reasoning against complex real-world problems. The role offers...  ...fluency in English, and expertise in financial analysis and modeling, all while contributing to the evolution of AI technologies... 
    Hourly pay
    Full time
    Part time
    Remote work
    Flexible hours

    DataAnnotation

    Springfield, IL
    1 day ago
  •  ...their remote team. The role encompasses evaluating and enhancing AI Assistant responses, alongside applying expert-level financial reasoning in a flexible working environment. Candidates...  ...proficiency in financial analysis and modeling. This is a remote, independent contract... 
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    DataAnnotation

    Florida, NY
    16 hours ago
  •  ...time engagement remotely. The candidate should possess expert-level financial reasoning and hold or be pursuing a Master’s or PhD in a finance-related field. Responsibilities include evaluating AI outputs on financial topics and providing feedback to improve reliability.... 
    Hourly pay
    Full time
    Part time
    Remote work
    Flexible hours

    DataAnnotation

    Sioux Falls, SD
    16 hours ago
  •  ...is seeking a Senior Financial Analyst to improve AI models' performance with expert financial reasoning. This remote role offers flexible hours and project...  ...-related discipline. Responsibilities include evaluating AI outputs and checking financial models for accuracy... 
    Remote work
    Flexible hours

    DataAnnotation

    Juneau, AK
    16 hours ago
  • $50 - $60 per hour

     ...those seeking part-time or full-time opportunities. Responsibilities include evaluating AI outputs and providing structured feedback. Candidates should have expert-level financial reasoning and a preference for a Master’s or PhD in a finance-related discipline. This role... 
    Hourly pay
    Full time
    Part time
    Remote work

    DataAnnotation

    Lansing, MI
    16 hours ago
  • $50 - $60 per hour

     ...Analyst for an independent contract position focused on training AI models. Responsibilities include evaluating AI outputs and ensuring financial accuracy. Candidates should have strong financial reasoning skills and proficiency in financial analysis. This REMOTE role... 
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    DataAnnotation

    Wisconsin
    16 hours ago
  • $40 per hour

     ...driven company is seeking a Statistician to support AI model development. In this flexible role, you will evaluate AI logic and solve complex mathematical problems,...  .... Candidates should possess strong mathematical reasoning and proficiency in various mathematical... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Boston, MA
    3 days ago
  • $40 per hour

     ...a Biostatistician to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the...  ...biology as well as an expert level of statistical reasoning. Other related fields include, but are not... 
    Remote job
    Hourly pay
    Full time
    Contract work
    Part time

    DataAnnotation

    Iowa, LA
    4 days ago
  • $50 - $60 per hour

    DataAnnotation seeks an experienced Appellate Attorney to train AI models and evaluate their legal outputs. This role allows for flexible project...  ...a Juris Doctor (J.D.) and demonstrated expertise in legal reasoning. Responsibilities include presenting legal challenges to AI... 
    Remote job
    Hourly pay
    For contractors
    Work from home
    Flexible hours

    DataAnnotation

    Florida, NY
    3 days ago
  • $20 - $30 per hour

     ...As an Image Evaluation Generalist, you will play a pivotal role in supporting an image assessment project that contributes to the...  ...AI systems. Your expertise will be essential in shaping how models learn, reason, and perform by providing high-quality, real-world input.... 
    Hourly pay
    For contractors
    Remote work

    SaidGig

    Indiana
    a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Causal Reasoning Model Evaluation Specialist [Remote]. Be the first to apply!