paper-with-me

Papers

Towards Understanding Counseling Conversations: Domain Knowledge and Large Language Models

2024-02-22 · Younghun Lee, Dan Goldwasser, Laura Schwab Reese

Understanding the dynamics of counseling conversations is an important task, yet it is a challenging NLP problem regardless of the recent advance of Transformer-based pre-trained language models. This paper proposes a systematic approach to examine the efficacy of domain knowledge and large language models (LLMs) in better representing conversations between a crisis counselor and a help seeker. We empirically show that state-of-the-art language models such as Transformer-based models and GPT models fail to predict the conversation outcome. To provide richer context to conversations, we incorporate human-annotated domain knowledge and LLM-generated features; simple integration of domain knowledge and LLM features improves the model performance by approximately 15%. We argue that both domain knowledge and LLM-generated features can be exploited to better characterize counseling conversations when they are used as an additional context to conversations.

📄 PDF Abstract BibTeX arXiv:2402.14200

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Residual Connection 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Weight Decay 설명 없음
Linear Warmup With Cosine Annealing Linear Warmup With Cosine Annealing is a learning rate schedule where we increase the learning rate linearly for $n$ updates and then anneal according to a cosine schedule…
Discriminative Fine-Tuning Discriminative Fine-Tuning is a fine-tuning strategy that is used for ULMFiT type models. Instead of using the same learning rate…

Similar Papers 제목 키워드 기반

Large-scale Analysis of Counseling Conversations: An Application of Natural Language Processing to Mental Health

2016-05-14 · TACL 2016 1 · Tim Althoff, Kevin Clark, Jure Leskovec

Mental illness is one of the most pressing public health issues of our time. While counseling and psychotherapy can be effective treatments, our knowledge about how to conduct successful counseling conversations has been…

ClusteringLanguage ModelingLanguage Modelling

ChatCounselor: A Large Language Models for Mental Health Support

2023-09-27 · June M. Liu, Donghao Li, He Cao, Tianhe Ren 외

This paper presents ChatCounselor, a large language model (LLM) solution designed to provide mental health support. Unlike generic chatbots, ChatCounselor is distinguished by its foundation in real conversations between …

Language ModelingLanguage ModellingLarge Language Model

Enhancing Psychotherapy Counseling: A Data Augmentation Pipeline Leveraging Large Language Models for Counseling Conversations

2024-06-13 · Jun-Woo Kim, Ji-Eun Han, Jun-Seok Koh, Hyeon-Tae Seo 외

We introduce a pipeline that leverages Large Language Models (LLMs) to transform single-turn psychotherapy counseling sessions into multi-turn interactions. While AI-supported online counseling services for individuals w…

Data Augmentation

Knowledge Enhanced Reflection Generation for Counseling Dialogues

2022-05-01 · ACL 2022 5 · Siqi Shen, Veronica Perez-Rosas, Charles Welch, Soujanya Poria 외

In this paper, we study the effect of commonsense and domain knowledge while generating responses in counseling conversations using retrieval and generative methods for knowledge integration. We propose a pipeline that c…

Retrieval

OnCoCo 1.0: A Public Dataset for Fine-Grained Message Classification in Online Counseling Conversations

2025-12-10 · Jens Albrecht, Robert Lehmann, Aleksandra Poltermann, Eric Rudolph 외 arxiv

This paper presents OnCoCo 1.0, a new public dataset for fine-grained message classification in online counseling. It is based on a new, integrative system of categories, designed to improve the automated analysis of psy…