AI Agents Should be Regulated Based on the Extent of Their Autonomous Operations
This position paper argues that AI agents should be regulated by the extent to which they operate autonomously. AI agents with long-term planning and strategic capabilities can pose significant risks of human extinction and irreversible global catastrophes. While existing regulations often focus on computational scale as a proxy for potential harm, we argue that such measures are insufficient for assessing the risks posed by agents whose capabilities arise primarily from inference-time computation. To support our position, we discuss relevant regulations and recommendations from scientists regarding existential risks, as well as the advantages of using action sequences -- which reflect the degree of an agent's autonomy -- as a more suitable measure of potential impact than existing metrics that rely on observing environmental states.
Code (0)
등록된 구현이 없습니다.
Tasks
PositionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Neuro-Symbolic Agents for Regulated Process Automation: Challenges and Research Agenda
LLM-based agents are entering regulated industries where they automate judgment intensive quality management processes. We argue that symbolic structures already embedded in these domains, including regulations, typed pr…
Tip cell overtaking occurs as a side effect of sprouting in computational models of angiogenesis
During angiogenesis, endothelial cells compete for the tip position during angiogenesis: a phenomenon named tip cell overtaking. It is still unclear to what extent tip cell overtaking is a side effect of sprouting or to …
PositionSmart Close-out Netting
Smart Close-out Netting aims to standardise and automate specific operational aspects of the legal and regulatory processes of close-out netting for prudentially regulated financial institutions. This article provides a …
Energentic Intelligence: From Self-Sustaining Systems to Enduring Artificial Life
This paper introduces Energentic Intelligence, a class of autonomous systems defined not by task performance, but by their capacity to sustain themselves through internal energy regulation. Departing from conventional re…
Artificial LifeEnhancing Human Experience in Human-Agent Collaboration: A Human-Centered Modeling Approach Based on Positive Human Gain
Existing game AI research mainly focuses on enhancing agents' abilities to win games, but this does not inherently make humans have a better experience when collaborating with these agents. For example, agents may domina…
Human Agent Collaboration