paper-with-me

Papers

A Framework for Inherently Safer AGI through Language-Mediated Active Inference

2025-08-07 · Bo Wen arxiv

This paper proposes a novel framework for developing safe Artificial General Intelligence (AGI) by combining Active Inference principles with Large Language Models (LLMs). We argue that traditional approaches to AI safety, focused on post-hoc interpretability and reward engineering, have fundamental limitations. We present an architecture where safety guarantees are integrated into the system's core design through transparent belief representations and hierarchical value alignment. Our framework leverages natural language as a medium for representing and manipulating beliefs, enabling direct human oversight while maintaining computational tractability. The architecture implements a multi-agent system where agents self-organize according to Active Inference principles, with preferences and safety constraints flowing through hierarchical Markov blankets. We outline specific mechanisms for ensuring safety, including: (1) explicit separation of beliefs and preferences in natural language, (2) bounded rationality through resource-aware free energy minimization, and (3) compositional safety through modular agent structures. The paper concludes with a research agenda centered on the Abstraction and Reasoning Corpus (ARC) benchmark, proposing experiments to validate our framework's safety properties. Our approach offers a path toward AGI development that is inherently safer, rather than retrofitted with safety measures.

📄 PDF Abstract BibTeX arXiv:2508.05766

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

AgenticPay: A Multi-Agent LLM Negotiation System for Buyer-Seller Transactions

2026-02-05 · Xianyang Liu, Shangding Gu, Dawn Song arxiv

Large language model (LLM)-based agents are increasingly expected to negotiate, coordinate, and transact autonomously, yet existing benchmarks lack principled settings for evaluating language-mediated economic interactio…

Path-Specific Objectives for Safer Agent Incentives

2022-04-21 · Sebastian Farquhar, Ryan Carey, Tom Everitt

We present a general framework for training safe agents whose naive incentives are unsafe. As an example, manipulative or deceptive behaviour can improve rewards but should be avoided. Most approaches fail here: agents m…

SafeRun: Enabling Determinism in LLM Planning for Running

2026-06-08 · Meilin Chen, Zepeng Zhai, Jiaxuan Zhao, Yuan Lu arxiv

Large Language Models enable flexible natural-language planning but remain unreliable in determinism-critical domains due to their probabilistic nature. This limitation is especially problematic in running planning, wher…

Safety Aware Task Planning via Large Language Models in Robotics

2025-03-19 · Azal Ahmad Khan, Michael Andrev, Muhammad Ali Murtaza, Sergio Aguilera 외

The integration of large language models (LLMs) into robotic task planning has unlocked better reasoning capabilities for complex, long-horizon workflows. However, ensuring safety in LLM-driven plans remains a critical c…

Task Planning

Secure Coding Drift in LLM-Assisted Post-Quantum Cryptography Development: A Gamified Fix

2026-06-17 · R. D. N. Shakya, C. P. Wijesiriwardana, S. M. Vidanagamachchi, Nalin A. G. Arachchilage arxiv

The transition to Post Quantum Cryptography (PQC) introduces considerable implementation complexity, requiring strict adherence to constant-time execution, side channel resistance, and precise parametrisation. Simultaneo…