paper-with-me

Papers

Explainable Interface for Human-Autonomy Teaming: A Survey

2024-05-04 · Xiangqi Kong, Yang Xing, Antonios Tsourdos, Ziyue Wang, Weisi Guo, Adolfo Perrusquia, Andreas Wikander

Nowadays, large-scale foundation models are being increasingly integrated into numerous safety-critical applications, including human-autonomy teaming (HAT) within transportation, medical, and defence domains. Consequently, the inherent 'black-box' nature of these sophisticated deep neural networks heightens the significance of fostering mutual understanding and trust between humans and autonomous systems. To tackle the transparency challenges in HAT, this paper conducts a thoughtful study on the underexplored domain of Explainable Interface (EI) in HAT systems from a human-centric perspective, thereby enriching the existing body of research in Explainable Artificial Intelligence (XAI). We explore the design, development, and evaluation of EI within XAI-enhanced HAT systems. To do so, we first clarify the distinctions between these concepts: EI, explanations and model explainability, aiming to provide researchers and practitioners with a structured understanding. Second, we contribute to a novel framework for EI, addressing the unique challenges in HAT. Last, our summarized evaluation framework for ongoing EI offers a holistic perspective, encompassing model performance, human-centered factors, and group task objectives. Based on extensive surveys across XAI, HAT, psychology, and Human-Computer Interaction (HCI), this review offers multiple novel insights into incorporating XAI into HAT systems and outlines future directions.

📄 PDF Abstract BibTeX arXiv:2405.02583

Code (0)

등록된 구현이 없습니다.

Tasks

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)Survey

Similar Papers 제목 키워드 기반

The Safe Trusted Autonomy for Responsible Space Program

2025-01-10 · Kerianne L. Hobbs, Sean Phillips, Michelle Simon, Joseph B. Lyons 외

The Safe Trusted Autonomy for Responsible Space (STARS) program aims to advance autonomy technologies for space by leveraging machine learning technologies while mitigating barriers to trust, such as uncertainty, opaquen…

reinforcement-learningReinforcement Learning

Incorporating Explanations into Human-Machine Interfaces for Trust and Situation Awareness in Autonomous Vehicles

2024-04-10 · Shahin Atakishiyev, Mohammad Salameh, Randy Goebel

Autonomous vehicles often make complex decisions via machine learning-based predictive models applied to collected sensor data. While this combination of methods provides a foundation for real-time actions, self-driving …

Autonomous VehiclesScene Understanding

How Human-Centered Explainable AI Interface Are Designed and Evaluated: A Systematic Survey

2024-03-21 · Thu Nguyen, Alessandro Canossa, Jichen Zhu

Despite its technological breakthroughs, eXplainable Artificial Intelligence (XAI) research has limited success in producing the {\em effective explanations} needed by users. In order to improve XAI systems' usability, p…

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)Survey

Flight Testing an Optionally Piloted Aircraft: a Case Study on Trust Dynamics in Human-Autonomy Teaming

2025-03-20 · Jeremy C. -H. Wang, Ming Hou, David Dunwoody, Marko Ilievski 외

This paper examines how trust is formed, maintained, or diminished over time in the context of human-autonomy teaming with an optionally piloted aircraft. Whereas traditional factor-based trust models offer a static repr…

Copiloting Autonomous Multi-Robot Missions: A Game-inspired Supervisory Control Interface

2022-04-13 · Marcel Kaufmann, Robert Trybula, Ryan Stonebraker, Michael Milano 외

Real-world deployment of new technology and capabilities can be daunting. The recent DARPA Subterranean (SubT) Challenge, for instance, aimed at the advancement of robotic platforms and autonomy capabilities in three one…

Task Planning