Board Game Reasoning Expert (AI Training & Evaluation)

Create and evaluate board game tasks to enhance AI reasoning skills.

About Turing

Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. Turing helps leading AI labs improve the reasoning, problem-solving, and decision-making capabilities of large language models (LLMs) through high-quality human feedback, evaluation, and training data.

Role Overview

We are seeking Board Game Reasoning Experts to help train and evaluate next-generation AI models. In this role, you will leverage your expertise in board games, game mechanics, strategic reasoning, probability, and complex rule systems to create, review, and evaluate high-quality datasets that improve AI performance.

You will work on challenging tasks involving game logic, decision-making, strategic planning, rule interpretation, and scenario analysis, helping frontier AI systems develop stronger reasoning capabilities.

What Does Day-to-Day Look Like?

• Create and review game-based reasoning tasks designed to evaluate AI systems.
• Analyze board game scenarios, strategic decision trees, and rule-based systems.
• Evaluate AI-generated responses for correctness, consistency, and reasoning quality.
• Develop prompts, rubrics, and evaluation guidelines for board game and strategy-focused tasks.
• Identify logical errors, rule violations, and flawed reasoning in AI outputs.
• Contribute to benchmark creation and quality assurance processes for AI evaluation projects.
• Collaborate with project teams to improve dataset quality and evaluation methodologies.

Requirements

Required Qualifications

• Bachelor's degree in Computer Science, Mathematics, Cognitive Science, Game Design, Philosophy, Economics, or a related analytical field.
• 2+ years of professional or semi-professional experience in board game design, playtesting, tabletop game communities, or related strategy-focused environments.
• Strong understanding of logic, probabilistic reasoning, game mechanics, and complex rule systems.
• Background in game theory, behavioral economics, decision science, or formal logic.
• Familiarity with modern board games, trading card games (TCGs), tabletop RPGs, strategy games, or competitive game systems.
• Strong analytical and problem-solving skills.
• Excellent written communication skills.

Preferred Qualifications

• Prior experience in data annotation, AI training, prompt engineering, QA, game design, puzzle design, or rules-based system analysis.
• Experience creating evaluation rubrics, benchmark datasets, or quality assurance frameworks.
• Experience with Python, SQL, or data analysis tools.
• Experience working on RLHF, model evaluation, synthetic data generation, or LLM benchmarking projects.
• Familiarity with recently released strategy or tabletop games and the ability to quickly learn new rule systems.

Perks of Freelancing With Turing

• Work in a fully remote environment.
• Opportunity to work on cutting-edge AI projects with leading LLM companies.

Offer Details

• Commitments Required: At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST. 
• Engagement type : Contractor assignment (no medical/paid leave)
• Duration of contract : 2 months; [expected start date is next week]

Evaluation Process

1. Take home Assessment

Skills: Game Development