paper-with-me

Papers

K-Level Reasoning: Establishing Higher Order Beliefs in Large Language Models for Strategic Reasoning

2024-02-02 · Yadong Zhang, Shaoguang Mao, Tao Ge, Xun Wang, Yan Xia, Man Lan, Furu Wei

Strategic reasoning is a complex yet essential capability for intelligent agents. It requires Large Language Model (LLM) agents to adapt their strategies dynamically in multi-agent environments. Unlike static reasoning tasks, success in these contexts depends on anticipating other agents' beliefs and actions while continuously adjusting strategies to achieve individual goals. LLMs and LLM agents often struggle with strategic reasoning due to the absence of a reasoning framework that enables them to dynamically infer others' perspectives and adapt to changing environments. Inspired by the Level-K framework from game theory and behavioral economics, which extends reasoning from simple reactions to structured strategic depth, we propose a novel framework: "K-Level Reasoning with Large Language Models (K-R)." This framework employs recursive mechanisms to enable LLMs to achieve varying levels of strategic depth, allowing agents to form higher order beliefs - beliefs about others' beliefs. We validate this framework through rigorous testing on four testbeds: two classical game theory problems and two social intelligence tasks. The results demonstrate the advantages of K-R in strategic reasoning. Our work presents the first recursive implementation of strategic depth in large language models (LLMs). It establishes a foundation for future research into theory of mind and strategic reasoning in LLMs.

📄 PDF Abstract BibTeX arXiv:2402.01521

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingLanguage ModellingLarge Language Model

Similar Papers 제목 키워드 기반

TimeToM: Temporal Space is the Key to Unlocking the Door of Large Language Models' Theory-of-Mind

2024-07-01 · Guiyang Hou, Wenqi Zhang, Yongliang Shen, Linjuan Wu 외

Theory of Mind (ToM)-the cognitive ability to reason about mental states of ourselves and others, is the foundation of social interaction. Although ToM comes naturally to humans, it poses a significant challenge to even …

Measuring Higher-Order Rationality with Belief Control

2023-09-14 · Wei James Chen, Meng-Jhang Fong, Po-Hsuan Lin

Determining an individual's strategic reasoning capability based solely on choice data is a complex task. This complexity arises because sophisticated players might have non-equilibrium beliefs about others, leading to n…

Mind the Perspective: Let's Reason Recursively for Theory of Mind

2026-06-10 · Chao Lei, Guang Hu, Meng Yang, Yanbei Jiang 외 arxiv

Theory of Mind (ToM) reasoning requires inferring agents' beliefs from partial and asymmetric observations, which remains an open challenge for LLMs. Existing prompting-based approaches improve ToM reasoning through obse…

Higher Order Reasoning for Collaborative Communicationless Mobile Robot Operations

2026-05-21 · Jonathan Reasoner, Nicola Bezzo arxiv

In communicationless environments, multi-robot systems must operate without the constant information exchange that many coordination strategies typically assume. This paper presents a novel dynamic epistemic planning fra…

Bayesian Inference

HI-TOM: A Benchmark for Evaluating Higher-Order Theory of Mind Reasoning in Large Language Models

2023-10-25 · Yinghui He, Yufan Wu, Yilin Jia, Rada Mihalcea 외

Theory of Mind (ToM) is the ability to reason about one's own and others' mental states. ToM plays a critical role in the development of intelligence, language understanding, and cognitive processes. While previous work …