paper-with-me

Papers

Trust Modeling in Counseling Conversations: A Benchmark Study

2025-01-06 · Aseem Srivastava, Zuhair Hasan Shaik, Tanmoy Chakraborty, Md Shad Akhtar

In mental health counseling, a variety of earlier studies have focused on dialogue modeling. However, most of these studies give limited to no emphasis on the quality of interaction between a patient and a therapist. The therapeutic bond between a patient and a therapist directly correlates with effective mental health counseling. It involves developing the patient's trust on the therapist over the course of counseling. To assess the therapeutic bond in counseling, we introduce trust as a therapist-assistive metric. Our definition of trust involves patients' willingness and openness to express themselves and, consequently, receive better care. We conceptualize it as a dynamic trajectory observable through textual interactions during the counseling. To facilitate trust modeling, we present MENTAL-TRUST, a novel counseling dataset comprising manual annotation of 212 counseling sessions with first-of-its-kind seven expert-verified ordinal trust levels. We project our problem statement as an ordinal classification task for trust quantification and propose a new benchmark, TrustBench, comprising a suite of classical and state-of-the-art language models on MENTAL-TRUST. We evaluate the performance across a suite of metrics and lay out an exhaustive set of findings. Our study aims to unfold how trust evolves in therapeutic interactions.

📄 PDF Abstract BibTeX arXiv:2501.03064

Code (0)

등록된 구현이 없습니다.

Tasks

Ordinal Classification

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Large-scale Analysis of Counseling Conversations: An Application of Natural Language Processing to Mental Health

2016-05-14 · TACL 2016 1 · Tim Althoff, Kevin Clark, Jure Leskovec

Mental illness is one of the most pressing public health issues of our time. While counseling and psychotherapy can be effective treatments, our knowledge about how to conduct successful counseling conversations has been…

ClusteringLanguage ModelingLanguage Modelling

OnCoCo 1.0: A Public Dataset for Fine-Grained Message Classification in Online Counseling Conversations

2025-12-10 · Jens Albrecht, Robert Lehmann, Aleksandra Poltermann, Eric Rudolph 외 arxiv

This paper presents OnCoCo 1.0, a new public dataset for fine-grained message classification in online counseling. It is based on a new, integrative system of categories, designed to improve the automated analysis of psy…

Enhancing Psychotherapy Counseling: A Data Augmentation Pipeline Leveraging Large Language Models for Counseling Conversations

2024-06-13 · Jun-Woo Kim, Ji-Eun Han, Jun-Seok Koh, Hyeon-Tae Seo 외

We introduce a pipeline that leverages Large Language Models (LLMs) to transform single-turn psychotherapy counseling sessions into multi-turn interactions. While AI-supported online counseling services for individuals w…

Data Augmentation

Analyzing the Quality of Counseling Conversations: the Tell-Tale Signs of High-quality Counseling

2018-05-01 · LREC 2018 5 · Ver{\'o}nica P{\'e}rez-Rosas, Xuetong Sun, Christy Li, Yuchen Wang 외

Towards Understanding Counseling Conversations: Domain Knowledge and Large Language Models

2024-02-22 · Younghun Lee, Dan Goldwasser, Laura Schwab Reese

Understanding the dynamics of counseling conversations is an important task, yet it is a challenging NLP problem regardless of the recent advance of Transformer-based pre-trained language models. This paper proposes a sy…