Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Board Game Reasoning Expert (AI Training & Evaluation)

Part-time

Turing

Create and evaluate board game tasks to enhance AI reasoning skills.

About Turing

Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. Turing helps leading AI labs improve the reasoning, problem-solving, and decision-making capabilities of large language models (LLMs) through high-quality human feedback, evaluation, and training data.

Role Overview

We are seeking Board Game Reasoning Experts to help train and evaluate next-generation AI models. In this role, you will leverage your expertise in board games, game mechanics, strategic reasoning, probability, and complex rule systems to create, review, and evaluate high-quality datasets that improve AI performance.

You will work on challenging tasks involving game logic, decision-making, strategic planning, rule interpretation, and scenario analysis, helping frontier AI systems develop stronger reasoning capabilities.

What Does Day-to-Day Look Like?

  • Create and review game-based reasoning tasks designed to evaluate AI systems.
  • Analyze board game scenarios, strategic decision trees, and rule-based systems.
  • Evaluate AI-generated responses for correctness, consistency, and reasoning quality.
  • Develop prompts, rubrics, and evaluation guidelines for board game and strategy-focused tasks.
  • Identify logical errors, rule violations, and flawed reasoning in AI outputs.
  • Contribute to benchmark creation and quality assurance processes for AI evaluation projects.
  • Collaborate with project teams to improve dataset quality and evaluation methodologies.

Requirements

Required Qualifications

  • Bachelor's degree in Computer Science, Mathematics, Cognitive Science, Game Design, Philosophy, Economics, or a related analytical field.
  • 2+ years of professional or semi-professional experience in board game design, playtesting, tabletop game communities, or related strategy-focused environments.
  • Strong understanding of logic, probabilistic reasoning, game mechanics, and complex rule systems.
  • Background in game theory, behavioral economics, decision science, or formal logic.
  • Familiarity with modern board games, trading card games (TCGs), tabletop RPGs, strategy games, or competitive game systems.
  • Strong analytical and problem-solving skills.
  • Excellent written communication skills.

Preferred Qualifications

  • Prior experience in data annotation, AI training, prompt engineering, QA, game design, puzzle design, or rules-based system analysis.
  • Experience creating evaluation rubrics, benchmark datasets, or quality assurance frameworks.
  • Experience with Python, SQL, or data analysis tools.
  • Experience working on RLHF, model evaluation, synthetic data generation, or LLM benchmarking projects.
  • Familiarity with recently released strategy or tabletop games and the ability to quickly learn new rule systems.

Perks of Freelancing With Turing

  • Work in a fully remote environment.
  • Opportunity to work on cutting-edge AI projects with leading LLM companies.

Offer Details

  • Commitments Required: At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST. 
  • Engagement type : Contractor assignment (no medical/paid leave)
  • Duration of contract : 2 months; [expected start date is next week]

Evaluation Process

  1. Take home Assessment

Skills: Game Development

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Board Game Reasoning Expert (AI Training & Evaluation) in San Francisco, CA vacancy
  • $60 per hour

    Prolific seeks Chemistry Experts and Chemical Engineers to join our Expert Network and evaluate AI models using your chemical expertise. Successful candidates will be invited to assess and review AI-generated chemistry tasks and ensure their accuracy. Compensation can reach... 
    Training
    Remote job
    Hourly pay
    Flexible hours

    Prolific

    San Francisco, CA
    2 days ago
  • $110 per hour

     ...Clinical Medicine Domain Expert Join a leading AI lab's cutting-edge...  ...frontier AI models reason about real clinical...  ...clinical tasks and evaluation sets, and help build...  ...Residency and fellowship training alone do not count...  ...one U.S. state, and board certification in... 
    Training
    Full time
    Contract work
    Part time
    Freelance
    Live in
    Relocation
    Relocation package

    Hackajob

    San Francisco, CA
    2 days ago
  • $50 - $150 per hour

     ...United States | Canada + 6 more We're hiring PhD-level experts to help train and evaluate advanced AI models. This is remote, flexible contract work where...  ...expertise directly shapes how cutting-edge models reason, answer, and improve. You'll review AI-generated content... 
    Suggested
    Contract work
    Temporary work
    Remote work
    Flexible hours

    Braintrust

    San Francisco, CA
    a month ago
  • $1,350 per unit

     ...Help evaluate how AI systems approach scientific and clinical work. Use your subject expertise...  ...for scientific accuracy and quality of reasoning. What you’ll work on Develop Linux-...  ...be PGY-4 or later, or at an equivalent training stage. Senior residents, fellows and attendings... 
    Training

    Braintrust

    San Francisco, CA
    1 day ago
  • $24 per hour

     ...and QuickBooks experience to help improve AI responses to real small-business and...  ...In this remote freelance project, you'll evaluate accuracy, identify gaps and help build reliable...  ..., completeness, relevance and quality of reasoning. Review financial reporting,... 
    Suggested
    Part time
    Freelance
    Remote work

    Braintrust

    San Francisco, CA
    3 days ago
  • $184k - $272k

     ...Waabi, founded by AI visionary Raquel Urtasun...  ...distributed training frameworks for research...  .... Identify and evaluate emerging...  ...that includes a gym, games room (ping pong table...  ...game consoles, board games, etc), multiple...  ...all employees. If reasonable accommodation is... 
    Training
    Games
    Work at office
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    11 days ago
  •  ...Ventures-backed company building AI agents that reason about complex scientific...  ...existing models, we’re training our own foundation models on...  ...hypothesis generation and evaluation. Process reward models and...  ...from other domains (robotics, game-playing, scientific... 
    Training
    Games

    Xterra Ai

    San Francisco, CA
    3 days ago
  • $293.5k

     ...Information Job Title Expert Senior Manager, AI Engineering Job...  ...with clients on board-level and executive...  ..., keyword)Integrate reasoning, tool use, function...  ...experimentation, and evaluation design to production...  .../certifications, training and skill level. Annual... 
    Training
    Permanent employment
    Full time
    Apprenticeship
    Work at office
    Local area
    Work from home
    Home office
    3 days per week

    Bain & Company

    San Francisco, CA
    5 days ago
  • $150 per hour

     ...technical talent with leading AI research labs....  ...Clinician (MD/DO) - HLS Expert Pool Type: Contract...  ...response grading. Evaluate clinical dialogues for...  ...Annotate clinical reasoning by recording case work...  ...week Preferred Board certification in your specialty... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    9 days ago
  •  ...About the Role We're looking for an AI Research Scientist to advance the...  ...may include novel architectures, new training or evaluation techniques, long-horizon research bets...  ...meetings. You'll usually find us playing a board game before getting back to work. What... 
    Training
    Games
    Temporary work
    Work at office
    Monday to Friday
    Monday to Thursday
    Flexible hours

    Sprinter Health

    San Francisco, CA
    4 days ago
  •  ...designers to build the design evaluation and Figma workflow scenarios frontier AI labs use to test model...  .... AfterQuery builds the expert evaluation data that...  ...critiques with the design reasoning behind each judgment,...  ...build the evaluation and training data that frontier AI labs... 
    Training
    Weekly pay
    Contract work
    Temporary work
    For contractors
    Live in
    Remote work
    10 hours per week

    AfterQuery

    San Francisco, CA
    a month ago
  •  ...Role: Member of Technical Staff - Evaluations Team: Post-Training Location: San Francisco Location...  ...Employment Type: Full-time About Liquid AI Spun out of MIT CSAIL, we build...  ...models from bad ones, and is hard to game. Evals you have built before that... 
    Training
    Games
    Remote job
    Full time
    Weekend work

    liquid-ai

    San Francisco, CA
    2 days ago
  • $70 - $110 per hour

     ...technical talent with leading AI research labs....  ...Clinical Medicine Domain Expert Type: Contract...  ...Role Responsibilities Evaluate the quality of clinical...  ...missing behaviors, thin reasoning, and unsafe recommendations...  ...one U.S. state. ~ Board certification in your... 
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work

    Mercor

    San Francisco, CA
    a month ago
  •  ...We’re looking for an AI Enablement Engineer to...  ...prompt and skill libraries, evaluation frameworks, deployment patterns, and training programs that raise AI...  ...find us playing a board game before getting back to...  ...leadership Help non-experts move quickly while ensuring... 
    Training
    Games
    Full time
    Temporary work
    Work at office
    Relocation package
    Monday to Friday
    Monday to Thursday
    Flexible hours

    sprinter-health

    San Francisco, CA
    3 days ago
  • $145 per hour

     ...technical talent with leading AI research labs....  ...Position: ML Research PhD Experts (ICML / NeurIPS / ICLR...  ...Responsibilities Evaluate the accuracy and depth...  ...content to strengthen reasoning and rigor in model outputs...  ...teams to improve training data quality and downstream... 
    Training
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    8 days ago
  • $70 - $120 per hour

     ...USA Join a leading AI lab's cutting-edge GenAI...  ...the quality of our AI training data. This is a full-time...  ..., .step or .stl. Evaluate AI-generated 3D assets...  ...with other subject matter experts to ensure consistency and...  ...shipped 3D work at a game studio, animation or VFX... 
    Training
    Games
    Full time
    Contract work
    Weekday work

    Mercor

    San Francisco, CA
    11 days ago
  • $156.8k - $235.2k

     ...a Lead Engineer on the AI Engagement Engine team....  ...peers. Explore, evaluate, and implement new technologies...  ...with entertainment, games, news, or sports-...  ...market demands, experience, training, and education. The...  ...disability, you may request a reasonable accommodation during... 
    Training
    Games
    Local area
    Worldwide
    San Francisco, CA
    more than 2 months ago
  • $150 per hour

     ...and technical talent with leading AI research labs. Headquartered in...  ...Position: Machine Learning Expert Type: Contract Compensation...  .... Focus on inference, evaluation, and systems work rather than heavy model training. Tasks run on both GPU and CPU... 
    Training
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    28 days ago
  • $45 - $70 per hour

     ...and Social Science Help a leading AI lab ensure its models respond to people...  ...leading AI lab is seeking behavioral health experts to help evaluate and improve how its AI models handle...  ...and worldviews, and to explain the reasoning behind a professional judgment. ~... 
    Contract work
    Part time
    Weekday work

    Mercor

    San Francisco, CA
    a month ago
  • $60 - $70 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Location: Remote Role Responsibilities Evaluate AI-generated responses for safety,...  ...Identify unsafe outputs, hallucinations, reasoning failures, and policy violations. Provide... 
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    10 days ago
  • $1,350 per unit

     ...Help test AI systems on realistic creative and technical workflows. We’re looking for experienced specialists in music, audio, speech...  ...conservatory credential, or ABRSM Grade 8 or equivalent theory training as an alternative credential for relevant work. Practical... 
    Training

    Braintrust

    San Francisco, CA
    1 day ago
  •  ...Applied Scientist, AI to turn messy,...  ...baselines, design honest evaluations, run careful error...  ...subject-matter experts to validate...  ...find us playing a board game before getting back...  ...Used statistical reasoning, experimental design...  ...for formal graduate training You have depth... 
    Training
    Games
    Remote job
    Full time
    Temporary work
    Work at office
    Relocation package
    Monday to Friday
    Monday to Thursday
    Flexible hours

    sprinter-health

    San Francisco, CA
    2 days ago
  • $45 - $55 per hour

     ...technical talent with leading AI research labs....  ...Role Responsibilities Evaluate the accuracy and depth...  ...Econometrics to strengthen reasoning and rigor in model...  ...research teams to improve training data quality and...  ...Collaborate with subject matter experts to ensure consistency,... 
    Training
    Contract work
    Summer work
    Remote work

    Mercor

    San Francisco, CA
    5 days ago
  •  ...troubleshooting scenarios frontier AI labs use to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs...  ...design and troubleshooting reasoning behind each decision Grade...  ...We build the evaluation and training data that frontier AI labs use... 
    Training
    Weekly pay
    Contract work
    For contractors
    Remote work
    10 hours per week

    AfterQuery

    San Francisco, CA
    a month ago
  • $8 - $65 per hour

     ...Arabic (Levantine) Language Expert - Freelance AI Trainer Project at Meridial...  .... With high-quality training data, tomorrow’s AI can accurately...  ...so we can harden model reasoning. On a typical day, you will...  ...our prompt engineering and evaluation metrics. A Master's degree... 
    Training
    Hourly pay
    Contract work
    Part time
    For contractors
    Freelance
    Immediate start
    Remote work

    Invisible Technologies

    San Francisco, CA
    a month ago
  • $8 - $65 per hour

     ...Caribbean/Belize/Guyana) Language Expert - Freelance AI Trainer Project at Meridial...  .... With high-quality training data, tomorrow’s AI can better...  ...so we can harden model reasoning. On a typical day, you will...  ...our prompt engineering and evaluation metrics. A Master's... 
    Training
    Hourly pay
    Contract work
    Part time
    For contractors
    Freelance
    Immediate start
    Remote work

    Invisible Technologies

    San Francisco, CA
    a month ago
  • $8 - $65 per hour

     ...Suriname/Caribbean) Language Expert - Freelance AI Trainer Project at Meridial...  .... With high-quality training data, tomorrow’s AI can better...  ...mode so we can harden model reasoning. On a typical day, you will...  ...our prompt engineering and evaluation metrics. A Master's... 
    Training
    Hourly pay
    Contract work
    Part time
    For contractors
    Freelance
    Immediate start
    Remote work

    Invisible Technologies

    San Francisco, CA
    a month ago
  • $30 per hour

     ...About SME Careers As AI systems become more...  ...intelligent systems learn, reason, and act. SME Careers...  ...SuperAnnotate that provides AI training data to many of the...  ...full picture of how expert work actually gets done...  ...Optimize AI Performance: Evaluate and rank AI responses... 
    Training
    Hourly pay
    Full time
    Contract work
    Freelance
    Local area
    Remote work
    Flexible hours

    SuperAnnotate

    San Francisco, CA
    a month ago
  • $80 per hour

     ...technical talent with leading AI research labs....  ...PhDs and Technical Domain Experts Type: Contract...  ...problems in your domain. Evaluate and improve AI model...  ...teams to enhance training data quality. Work...  ...Computer Science , Game Development , or Mechanical... 
    Training
    Games
    Remote job
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    8 days ago
  • $50 per hour

     ...edge projects with top AI labs while earning $50+...  ...performance (e.g., multi-step reasoning, abstraction, symbolic...  ...rigorous logic. Evaluate AI outputs for accuracy...  ...: Shortlisted experts complete an evaluation...  ...quality data, advanced training pipelines, plus top AI... 
    Training
    Contract work
    Remote work
    Flexible hours

    Turing

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Board Game Reasoning Expert (AI Training & Evaluation). Be the first to apply!