paper-with-me

홈 › Papers

An Algorithmic Information-Theoretic Perspective on the Symbol Grounding Problem

2025-10-02 · Zhangchi Liu arxiv

This paper provides a definitive, unifying framework for the Symbol Grounding Problem (SGP) by reformulating it within Algorithmic Information Theory (AIT). We demonstrate that the grounding of meaning is a process fundamentally constrained by information-theoretic limits, thereby unifying the Gödelian (self-reference) and No Free Lunch (statistical) perspectives. We model a symbolic system as a universal Turing machine and define grounding as an act of information compression. The argument proceeds in four stages. First, we prove that a purely symbolic system cannot ground almost all possible "worlds" (data strings), as they are algorithmically random and thus incompressible. Second, we show that any statically grounded system, specialized for compressing a specific world, is inherently incomplete because an adversarial, incompressible world relative to the system can always be constructed. Third, the "grounding act" of adapting to a new world is proven to be non-inferable, as it requires the input of new information (a shorter program) that cannot be deduced from the system's existing code. Finally, we use Chaitin's Incompleteness Theorem to prove that any algorithmic learning process is itself a finite system that cannot comprehend or model worlds whose complexity provably exceeds its own. This establishes that meaning is the open-ended process of a system perpetually attempting to overcome its own information-theoretic limitations.

📄 PDF Abstract BibTeX arXiv:2510.05153

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

SATURN: Symbolic Spatial Reasoning for Multi-Perspective Grounding

2026-06-21 · Danial Kamali, Tanawan Premsri, Shreya Rajpal, Amir Zadeh 외 arxiv

Vision-Language Models (VLMs) remain unreliable when spatial reasoning requires composing relations whose meanings depend on frames of reference. Existing neuro-symbolic methods make reasoning more explicit, but often de…

Referring ExpressionSpatial Reasoning

A Unified Formal Theory on the Logical Limits of Symbol Grounding

2025-09-24 · Zhangchi Liu arxiv

This paper synthesizes a series of formal proofs to construct a unified theory on the logical limits of the Symbol Grounding Problem. We distinguish between internal meaning (sense), which formal systems can possess via …

Beyond Accuracy: Introducing a Symbolic-Mechanistic Approach to Interpretable Evaluation

2026-03-06 · Reza Habibi, Darian Lee, Magy Seif El-Nasr arxiv

Accuracy-based evaluation cannot reliably distinguish genuine generalization from shortcuts like memorization, leakage, or brittle heuristics, especially in small-data regimes. In this position paper, we argue for mechan…

Grounding from an AI and Cognitive Science Lens

2024-02-19 · Goonmeet Bajaj, Srinivasan Parthasarathy, Valerie L. Shalin, Amit Sheth

Grounding is a challenging problem, requiring a formal definition and different levels of abstraction. This article explores grounding from both cognitive science and machine learning perspectives. It identifies the subt…

Looking forward: Linguistic theory and methods

2025-02-25 · John Mansfield, Ethan Gotlieb Wilcox

This chapter examines current developments in linguistic theory and methods, focusing on the increasing integration of computational, cognitive, and evolutionary perspectives. We highlight four major themes shaping conte…