paper-with-me

Papers

When Autonomy Breaks: The Hidden Existential Risk of AI

2025-03-28 · Joshua Krook

AI risks are typically framed around physical threats to humanity, a loss of control or an accidental error causing humanity's extinction. However, I argue in line with the gradual disempowerment thesis, that there is an underappreciated risk in the slow and irrevocable decline of human autonomy. As AI starts to outcompete humans in various areas of life, a tipping point will be reached where it no longer makes sense to rely on human decision-making, creativity, social care or even leadership. What may follow is a process of gradual de-skilling, where we lose skills that we currently take for granted. Traditionally, it is argued that AI will gain human skills over time, and that these skills are innate and immutable in humans. By contrast, I argue that humans may lose such skills as critical thinking, decision-making and even social care in an AGI world. The biggest threat to humanity is therefore not that machines will become more like humans, but that humans will become more like machines.

📄 PDF Abstract BibTeX arXiv:2503.22151

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Similar Papers 제목 키워드 기반

ForesightSafety Bench: A Frontier Risk Evaluation and Governance Framework towards Safe AI

2026-02-15 · Haibo Tong, Feifei Zhao, Linghao Feng, Ruoyu Wu 외 arxiv

Rapidly evolving AI exhibits increasingly strong autonomy and goal-directed capabilities, accompanied by derivative systemic risks that are more unpredictable, difficult to control, and potentially irreversible. However,…

AI Agents Should be Regulated Based on the Extent of Their Autonomous Operations

2025-02-07 · Takayuki Osogami

This position paper argues that AI agents should be regulated by the extent to which they operate autonomously. AI agents with long-term planning and strategic capabilities can pose significant risks of human extinction …

Position

A Review of the Evidence for Existential Risk from AI via Misaligned Power-Seeking

2023-10-27 · Rose Hadshar

Rapid advancements in artificial intelligence (AI) have sparked growing concerns among experts, policymakers, and world leaders regarding the potential for increasingly advanced AI systems to pose existential risks. This…

AI Consciousness and Existential Risk

2025-11-24 · Rufin VanRullen arxiv

In AI, the existential risk denotes the hypothetical threat posed by an artificial system that would possess both the capability and the objective, either directly or indirectly, to eradicate humanity. This issue is gain…

Current and Near-Term AI as a Potential Existential Risk Factor

2022-09-21 · Benjamin S. Bucknall, Shiri Dori-Hacohen

There is a substantial and ever-growing corpus of evidence and literature exploring the impacts of Artificial intelligence (AI) technologies on society, politics, and humanity as a whole. A separate, parallel body of wor…