Board Game Reasoning Expert (AI Training & Evaluation)

• Create and review game-based reasoning tasks designed to evaluate AI systems.
• Analyze board game scenarios, strategic decision trees, and rule-based systems.
• Evaluate AI-generated responses for correctness, consistency, and reasoning quality.
• Develop prompts, rubrics, and evaluation guidelines for board game and strategy-focused tasks.
• Identify logical errors, rule violations, and flawed reasoning in AI outputs.
• Contribute to benchmark creation and quality assurance processes for AI evaluation projects.
• Collaborate with project teams to improve dataset quality and evaluation methodologies.

• 2+ years of professional or semi-professional experience in board game design, playtesting, tabletop game communities, or related strategy-focused environments.
• Strong understanding of logic, probabilistic reasoning, game mechanics, and complex rule systems.
• Background in game theory, behavioral economics, decision science, or formal logic.
• Familiarity with modern board games, trading card games (TCGs), tabletop RPGs, strategy games, or competitive game systems.
• Strong analytical and problem-solving skills.
• Excellent written communication skills.

• Prior experience in data annotation, AI training, prompt engineering, QA, game design, puzzle design, or rules-based system analysis.
• Experience creating evaluation rubrics, benchmark datasets, or quality assurance frameworks.
• Experience with Python, SQL, or data analysis tools.
• Experience working on RLHF, model evaluation, synthetic data generation, or LLM benchmarking projects.
• Familiarity with recently released strategy or tabletop games and the ability to quickly learn new rule systems.

RequiredAlso useful

Also listed: analytical skills.

Project and contracting process: Turing. Applications continue on the provider's website.