paper-with-me

Papers

MastermindEval: A Simple But Scalable Reasoning Benchmark

2025-03-07 · Jonas Golde, Patrick Haller, Fabio Barth, Alan Akbik

Recent advancements in large language models (LLMs) have led to remarkable performance across a wide range of language understanding and mathematical tasks. As a result, increasing attention has been given to assessing the true reasoning capabilities of LLMs, driving research into commonsense, numerical, logical, and qualitative reasoning. However, with the rapid progress of reasoning-focused models such as OpenAI's o1 and DeepSeek's R1, there has been a growing demand for reasoning benchmarks that can keep pace with ongoing model developments. In this paper, we introduce MastermindEval, a simple, scalable, and interpretable deductive reasoning benchmark inspired by the board game Mastermind. Our benchmark supports two evaluation paradigms: (1) agentic evaluation, in which the model autonomously plays the game, and (2) deductive reasoning evaluation, in which the model is given a pre-played game state with only one possible valid code to infer. In our experimental results we (1) find that even easy Mastermind instances are difficult for current models and (2) demonstrate that the benchmark is scalable to possibly more advanced models in the future Furthermore, we investigate possible reasons why models cannot deduce the final solution and find that current models are limited in deducing the concealed code as the number of statement to combine information from is increasing.

📄 PDF Abstract BibTeX arXiv:2503.05891

Code (1)

flairNLP/mastermind 공식 구현

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

TTT-Bench: A Benchmark for Evaluating Reasoning Ability with Simple and Novel Tic-Tac-Toe-style Games

2025-06-11 · Prakamya Mishra, Jiang Liu, Jialian Wu, Xiaodong Yu 외

Large reasoning models (LRMs) have demonstrated impressive reasoning capabilities across a broad range of tasks including Olympiad-level mathematical problems, indicating evidence of their complex reasoning abilities. Wh…

Logical ReasoningMath

Evaluating Gender Bias in Large Language Models via Chain-of-Thought Prompting

2024-01-28 · Masahiro Kaneko, Danushka Bollegala, Naoaki Okazaki, Timothy Baldwin

There exist both scalable tasks, like reading comprehension and fact-checking, where model performance improves with model size, and unscalable tasks, like arithmetic reasoning and symbolic reasoning, where model perform…

Arithmetic ReasoningFact CheckingReading Comprehension

L0-Reasoning Bench: Evaluating Procedural Correctness in Language Models via Simple Program Execution

2025-03-28 · Simeng Sun, Cheng-Ping Hsieh, Faisal Ladhak, Erik Arakelyan 외

Complex reasoning tasks often rely on the ability to consistently and accurately apply simple rules across incremental steps, a foundational capability which we term "level-0" reasoning. To systematically evaluate this c…

Probing How Scalable Table Data Enhances General Long-Context Reasoning

2026-03-23 · Huaibing Xie, Guoliang Zhao, Yang Liu, Shihan Dou 외 arxiv

As real-world tasks grow increasingly complex, long-context reasoning has become a core capability for Large Language Models (LLMs). However, few studies explore which data types are effective for long-context reasoning …

SCoRE: Benchmarking Long-Chain Reasoning in Commonsense Scenarios

2025-03-08 · Weidong Zhan, Yue Wang, Nan Hu, Liming Xiao 외

Currently, long-chain reasoning remains a key challenge for large language models (LLMs) because natural texts lack sufficient explicit reasoning data. However, existing benchmarks suffer from limitations such as narrow …

BenchmarkingDiagnosticLogical ReasoningMultiple-choice