paper-with-me

홈 › Papers

Contemplative Wisdom for Superalignment

2025-04-21 · Ruben Laukkonen, Fionn Inglis, Shamil Chandaria, Lars Sandved-Smith, Jakob Hohwy, Jonathan Gold, Adam Elwood

As artificial intelligence (AI) improves, traditional alignment strategies may falter in the face of unpredictable self-improvement, hidden subgoals, and the sheer complexity of intelligent systems. Rather than externally constraining behavior, we advocate designing AI with intrinsic morality built into its cognitive architecture and world model. Inspired by contemplative wisdom traditions, we show how four axiomatic principles can instil a resilient Wise World Model in AI systems. First, mindfulness enables self-monitoring and recalibration of emergent subgoals. Second, emptiness forestalls dogmatic goal fixation and relaxes rigid priors. Third, non-duality dissolves adversarial self-other boundaries. Fourth, boundless care motivates the universal reduction of suffering. We find that prompting AI to reflect on these principles improves performance on the AILuminate Benchmark using GPT-4o, particularly when combined. We offer detailed implementation strategies for state-of-the-art models, including contemplative architectures, constitutions, and reinforcement of chain-of-thought. For future systems, the active inference framework may offer the self-organizing and dynamic coupling capabilities needed to enact these insights in embodied agents. This interdisciplinary approach offers a self-correcting and resilient alternative to prevailing brittle control schemes.

📄 PDF Abstract BibTeX arXiv:2504.15125

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Research on Superalignment Should Advance Now with Parallel Optimization of Competence and Conformity

2025-03-08 · HyunJin Kim, Xiaoyuan Yi, Jing Yao, Muhua Huang 외

The recent leap in AI capabilities, driven by big generative models, has sparked the possibility of achieving Artificial General Intelligence (AGI) and further triggered discussions on Artificial Superintelligence (ASI),…

The Road to Artificial SuperIntelligence: A Comprehensive Survey of Superalignment

2024-12-21 · HyunJin Kim, Xiaoyuan Yi, Jing Yao, Jianxun Lian 외

The emergence of large language models (LLMs) has sparked the possibility of about Artificial Superintelligence (ASI), a hypothetical AI system surpassing human intelligence. However, existing alignment paradigms struggl…

Survey

Toward Contemplative LLM: A Modular Framework for Evaluating and Enhancing LLM Alignment in Mental Health

2026-07-12 · Asher Sprigler, Yang-Yang Feng, Iftach Amir, Jonathan E. Bogard 외 arxiv

Contemplative traditions have long guided ethical behavior and prosocial interaction, and recent work suggests that contemplative principles (e.g., mindfulness, compassion, non-dual reasoning) may offer a promising parad…

The Superalignment of Superhuman Intelligence with Large Language Models

2024-12-15 · Minlie Huang, Yingkang Wang, Shiyao Cui, Pei Ke 외

We have witnessed superhuman intelligence thanks to the fast development of large language models and multimodal language models. As the application of such superhuman models becomes more and more popular, a critical que…

A Moral Imperative: The Need for Continual Superalignment of Large Language Models

2024-03-13 · Gokul Puthumanaillam, Manav Vora, Pranay Thangeda, Melkior Ornik

This paper examines the challenges associated with achieving life-long superalignment in AI systems, particularly large language models (LLMs). Superalignment is a theoretical framework that aspires to ensure that superi…

Ethics