paper-with-me

홈 › Papers

Agency in Artificial Intelligence Systems

2025-02-09 · Parashar Das

There is a general concern that present developments in artificial intelligence (AI) research will lead to sentient AI systems, and these may pose an existential threat to humanity. But why cannot sentient AI systems benefit humanity instead? This paper endeavours to put this question in a tractable manner. I ask whether a putative AI system will develop an altruistic or a malicious disposition towards our society, or what would be the nature of its agency? Given that AI systems are being developed into formidable problem solvers, we can reasonably expect these systems to preferentially take on conscious aspects of human problem solving. I identify the relevant phenomenal aspects of agency in human problem solving. The functional aspects of conscious agency can be monitored using tools provided by functionalist theories of consciousness. A recent expert report (Butlin et al. 2023) has identified functionalist indicators of agency based on these theories. I show how to use the Integrated Information Theory (IIT) of consciousness, to monitor the phenomenal nature of this agency. If we are able to monitor the agency of AI systems as they develop, then we can dissuade them from becoming a menace to society while encouraging them to be an aid.

📄 PDF Abstract BibTeX arXiv:2502.10434

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Artificial Intelligence (AI) and the Relationship between Agency, Autonomy, and Moral Patiency

2025-04-11 · Paul Formosa, Inês Hipólito, Thomas Montefiore

The proliferation of Artificial Intelligence (AI) systems exhibiting complex and seemingly agentive behaviours necessitates a critical philosophical examination of their agency, autonomy, and moral status. In this paper …

Decision Making

Intent-aligned AI systems deplete human agency: the need for agency foundations research in AI safety

2023-05-30 · Catalin Mitelut, Ben Smith, Peter Vamplew

The rapid advancement of artificial intelligence (AI) systems suggests that artificial general intelligence (AGI) systems may soon arrive. Many researchers are concerned that AIs and AGIs will harm humans via intentional…

A three-dimensional typology of agency for advanced AI systems

2026-08-20 · Willem Fourie arxiv

Research on the agency of advanced artificial intelligence (AI) systems focuses on agency as a normative concept and on the agency of particularly agentic AI systems. While recent work also focuses on the different profi…

Exploring Agentic Artificial Intelligence Systems: Towards a Typological Framework

2025-07-07 · Christopher Wissuchek, Patrick Zschech arxiv

Artificial intelligence (AI) systems are evolving beyond passive tools into autonomous agents capable of reasoning, adapting, and acting with minimal human intervention. Despite their growing presence, a structured frame…

Low impact agency: review and discussion

2023-03-06 · Danilo Naiff, Shashwat Goel

Powerful artificial intelligence poses an existential threat if the AI decides to drastically change the world in pursuit of its goals. The hope of low-impact artificial intelligence is to incentivize AI to not do that j…