paper-with-me

홈 › Papers

Self-Evolving Human-Centered Framework for Explainable Depression Symptom Annotation

2026-07-16 · Hoang-Loc Cao, Van Pham, Truong Thanh Hung Nguyen, Phuc Truong Loc Nguyen, Phuc Ho, Veronica Whitford, Hung Cao arxiv

Annotation quality is a major bottleneck in building reliable and explainable artificial intelligence (XAI) systems for mental health research. In depression-related datasets, labels are often assigned without structured evidence, symptom-level justification, or traceable alignment with the criteria of the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition, Text Revision (DSM-5-TR), limiting both transparency and downstream model interpretability. We propose a self-evolving, expert-in-the-loop annotation framework for Major Depressive Disorder (MDD) that combines large language model (LLM)-assisted labeling with expert verification. The framework is intended to support the construction of explainable, DSM-5-TR-aligned datasets rather than to perform clinical diagnosis. It operates in three stages: candidate evidence selection from textual records, criterion-level DSM-5-TR analysis, and case-level synthesis that produces label-level diagnostic and severity annotations. A dual-memory architecture, composed of Example Memory and Reflection Memory, is designed to internalize expert feedback and iteratively improve future annotations without retraining. We describe this mechanism and leave its evaluation across multiple feedback cycles to future work. In addition to final labels, the framework exports clinical evidence, reasoning traces, and edit histories, enabling comprehensive auditability. In a pilot study using expert-reviewed samples, the proposed approach improves annotation consistency and explainability while reducing manual revision effort.

📄 PDF Abstract BibTeX arXiv:2607.15202

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Who's Thinking? A Push for Human-Centered Evaluation of LLMs using the XAI Playbook

2023-03-10 · Teresa Datta, John P. Dickerson

Deployed artificial intelligence (AI) often impacts humans, and there is no one-size-fits-all metric to evaluate these tools. Human-centered evaluation of AI-based systems combines quantitative and qualitative analysis a…

Explainable Artificial Intelligence (XAI)

A Multi-Layered Research Framework for Human-Centered AI: Defining the Path to Explainability and Trust

2025-04-14 · Chameera De Silva, Thilina Halloluwa, Dhaval Vyas

The integration of Artificial Intelligence (AI) into high-stakes domains such as healthcare, finance, and autonomous systems is often constrained by concerns over transparency, interpretability, and trust. While Human-Ce…

Decision Making

A Survey on Human-Centered Evaluation of Explainable AI Methods in Clinical Decision Support Systems

2025-02-14 · Alessandro Gambetti, Qiwei Han, Hong Shen, Claudia Soares

Explainable AI (XAI) has become a crucial component of Clinical Decision Support Systems (CDSS) to enhance transparency, trust, and clinical adoption. However, while many XAI methods have been proposed, their effectivene…

Principles of Explanation in Human-AI Systems

2021-02-09 · Shane T. Mueller, Elizabeth S. Veinott, Robert R. Hoffman, Gary Klein 외

Explainable Artificial Intelligence (XAI) has re-emerged in response to the development of modern AI and ML systems. These systems are complex and sometimes biased, but they nevertheless make decisions that impact our li…

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)

Mind the XAI Gap: A Human-Centered LLM Framework for Democratizing Explainable AI

2025-06-13 · Eva Paraschou, Ioannis Arapakis, Sofia Yfantidou, Sebastian Macaluso 외

Artificial Intelligence (AI) is rapidly embedded in critical decision-making systems, however their foundational ``black-box'' models require eXplainable AI (XAI) solutions to enhance transparency, which are mostly orien…

BenchmarkingIn-Context Learning