paper-with-me

Papers

Metacognition Should Be the Scientific Framework for Bounded and Effective Self-Governance in Generative AI

2026-05-13 · Eugene Yu Ji, Igor Grossmann, Amir-Hossein Karimi arxiv

Generative AI research increasingly confronts a shared problem: systems must sustain yet govern their own generative activity when uncertainty is high, evidence is missing, or context is insufficient. This position paper argues that metacognition should become the scientific framework for bounded and effective self governance in generative AI, where output generation is properly evaluated together with the capacities through which generative systems navigate and regulate their own activity. We advance this position by showing that bounded and effective AI self-governance requires metacognitive alignment across computational, algorithmic, and ecological levels. At the computational level, metacognition specifies the meta-level functions a system is meant to serve, such as monitoring, evaluation, control, and adaptation. At the algorithmic level, these functions are realized through procedures such as elicitation, iteration, and modularization. At the ecological level, metacognitive signals become meaningful, actionable, and accountable within the interface, workflow, and accountability arrangements. Metacognition thus makes it possible to conceive generative AI as both capable and well-governed, rather than treating capability and governance as competing aims.

📄 PDF Abstract BibTeX arXiv:2605.23981

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Human Cognition in Machines: A Unified Perspective of World Models

2026-04-17 · Timothy Rupprecht, Pu Zhao, Amir Taherin, Arash Akbari 외 arxiv

This report of world models distinguishes prior works by the cognitive functions they innovate. Many works claim an almost human-like cognitive capability in their world models. To evaluate these claims requires a proper…

MEDLEY-BENCH: Scale Buys Evaluation but Not Control in AI Metacognition

2026-04-17 · Farhad Abtahi, Abdolamir Karbalaie, Eduardo Illueca-Fernandez, Fernando Seoane arxiv

Metacognition, the ability to monitor and regulate one's own reasoning, remains under-evaluated in AI benchmarking. We introduce MEDLEY-BENCH, a benchmark of behavioural metacognition that separates independent reasoning…

Metacognitive AI: Framework and the Case for a Neurosymbolic Approach

2024-06-17 · Hua Wei, Paulo Shakarian, Christian Lebiere, Bruce Draper 외

Metacognition is the concept of reasoning about an agent's own internal processes and was originally introduced in the field of developmental psychology. In this position paper, we examine the concept of applying metacog…

Position

Learning a metacognition for object perception

2020-11-30 · NeurIPS Workshop SVRHM 2020 12 · Marlene Berke, Mario Belledonne, Julian Jara-Ettinger

Beyond representing the external world, humans also represent their own cognitive processes. In the context of perception, this metacognition helps us identify unreliable percepts, such as when we recognize that we are s…

Object

Metacognition in LLMs: Foundations, Progress, and Opportunities

2026-07-13 · Gabrielle Kaili-May Liu, Areeb Gani, Jacqueline Lu, Jordan Thomas 외 hf

Metacognition is a foundational component of intelligence critical to effective learning, problem solving, decision-making, communication, and more. In recent years, it has become increasingly recognized as a cornerstone…