paper-with-me

Papers

Explaining Puzzle Solutions in Natural Language: An Exploratory Study on 6x6 Sudoku

2025-05-21 · Anirudh Maiya, Razan Alghamdi, Maria Leonor Pacheco, Ashutosh Trivedi, Fabio Somenzi

The success of Large Language Models (LLMs) in human-AI collaborative decision-making hinges on their ability to provide trustworthy, gradual, and tailored explanations. Solving complex puzzles, such as Sudoku, offers a canonical example of this collaboration, where clear and customized explanations often hold greater importance than the final solution. In this study, we evaluate the performance of five LLMs in solving and explaining \sixsix{} Sudoku puzzles. While one LLM demonstrates limited success in solving puzzles, none can explain the solution process in a manner that reflects strategic reasoning or intuitive problem-solving. These findings underscore significant challenges that must be addressed before LLMs can become effective partners in human-AI collaborative decision-making.

📄 PDF Abstract BibTeX arXiv:2505.15993

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Similar Papers 제목 키워드 기반

Explaining Hitori Puzzles: Neurosymbolic Proof Staging for Sequential Decisions

2025-08-19 · Maria Leonor Pacheco, Fabio Somenzi, Dananjay Srinivas, Ashutosh Trivedi arxiv

We propose a neurosymbolic approach to the explanation of complex sequences of decisions that combines the strengths of decision procedures and Large Language Models (LLMs). We demonstrate this approach by producing expl…

Solving Zebra Puzzles Using Constraint-Guided Multi-Agent Systems

2024-07-04 · Shmuel Berman, Kathleen McKeown, Baishakhi Ray

Prior research has enhanced the ability of Large Language Models (LLMs) to solve logic puzzles using techniques such as chain-of-thought prompting or introducing a symbolic representation. These frameworks are still usua…

A Cognitive Account of the Puzzle of Ideography

2023-04-29 · Xerxes D. Arsiwalla

In this commentary article to 'The Puzzle of Ideography' by Morin, we put forth a new cognitive account of the puzzle of ideography, that complements the standardization account of Morin. Efficient standardization of spo…

Chunking

Programming Puzzles

2021-06-10 · Tal Schuster, Ashwin Kalyan, Oleksandr Polozov, Adam Tauman Kalai

We introduce a new type of programming challenge called programming puzzles, as an objective and comprehensive evaluation of program synthesis, and release an open-source dataset of Python Programming Puzzles (P3). Each …

Code GenerationNatural Language UnderstandingProgram Synthesis

A Puzzle-Based Dataset for Natural Language Inference

2021-12-10 · Roxana Szomiu, Adrian Groza

We provide here a dataset for tasks related to natural language understanding and natural language inference. The dataset contains logical puzzles in natural language from three domains: comparing puzzles, knighs and kna…

Natural Language InferenceNatural Language UnderstandingReading Comprehension