paper-with-me

Papers

LLM Reasoning Is Latent, Not the Chain of Thought

2026-04-17 · Wenshuo Wang arxiv

This position paper argues that large language model (LLM) reasoning should be studied as latent-state trajectory formation rather than as faithful surface chain-of-thought (CoT). This matters because claims about faithfulness, interpretability, reasoning benchmarks, and inference-time intervention all depend on what the field takes the primary object of reasoning to be. We ask what that object should be once three often-confounded factors are separated and formalize three competing hypotheses: H1, reasoning is primarily mediated by latent-state trajectories; H2, reasoning is primarily mediated by explicit surface CoT; and H0, most apparent reasoning gains are better explained by generic serial compute than by any privileged representational object. Reorganizing recent empirical, mechanistic, and survey work under this framework, and adding compute-audited worked exemplars that factorize surface traces, latent interventions, and matched budget expansions, we find that current evidence most strongly supports H1 as a default working hypothesis rather than as a task-independent verdict. We therefore make two recommendations: the field should treat latent-state dynamics as the default object of study for LLM reasoning, and it should evaluate reasoning with designs that explicitly disentangle surface traces, latent states, and serial compute.

📄 PDF Abstract BibTeX arXiv:2604.15726

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughts

2026-06-30 · Lianyu Hu, Shengqian Qin, Zeqin Liao, Qing Guo 외 arxiv

Chain-of-thought (CoT) reasoning has enabled multi-modal large language models (MLLMs) to tackle complex visual reasoning tasks by generating explicit intermediate reasoning steps in natural language. However, this text-…

Visual Reasoning

Thoughts-as-Planning: Latent World Models for Chain-of-Thoughts Optimization via Reinforcement Planning

2026-04-27 · Dong Liu, Yanxuan Yu, Ying Nian Wu arxiv

The success of large language models (LLMs) across diverse NLP tasks has elevated the importance of reasoning chain optimization as a critical step in aligning model behavior with task objectives. Existing reasoning chai…

Reinforcement Learning

A Formal Comparison Between Chain of Thought and Latent Thought

2025-09-25 · Kevin Xu, Issei Sato arxiv

Chain of thought (CoT) elicits reasoning in large language models by explicitly generating intermediate tokens. In contrast, latent thought reasoning operates directly in the continuous latent space, enabling computation…

Parallel Continuous Chain-of-Thought with Jacobi Iteration

2025-06-23 · HaoYi Wu, Zhihao Teng, Kewei Tu

Continuous chain-of-thought has been shown to be effective in saving reasoning tokens for large language models. By reasoning with continuous latent thought tokens, continuous CoT is able to perform implicit reasoning in…

Ulterior Motives: Detecting Misaligned Reasoning in Continuous Thought Models

2026-04-25 · Sharan Ramjee arxiv

Chain-of-Thought (CoT) reasoning has emerged as a key technique for eliciting complex reasoning in Large Language Models (LLMs). Although interpretable, its dependence on natural language limits the model's expressive ba…