paper-with-me

Papers

ChatCounselor: A Large Language Models for Mental Health Support

2023-09-27 · June M. Liu, Donghao Li, He Cao, Tianhe Ren, Zeyi Liao, Jiamin Wu

This paper presents ChatCounselor, a large language model (LLM) solution designed to provide mental health support. Unlike generic chatbots, ChatCounselor is distinguished by its foundation in real conversations between consulting clients and professional psychologists, enabling it to possess specialized knowledge and counseling skills in the field of psychology. The training dataset, Psych8k, was constructed from 260 in-depth interviews, each spanning an hour. To assess the quality of counseling responses, the counseling Bench was devised. Leveraging GPT-4 and meticulously crafted prompts based on seven metrics of psychological counseling assessment, the model underwent evaluation using a set of real-world counseling questions. Impressively, ChatCounselor surpasses existing open-source models in the counseling Bench and approaches the performance level of ChatGPT, showcasing the remarkable enhancement in model capability attained through high-quality domain-specific data.

📄 PDF Abstract BibTeX arXiv:2309.15461

Code (1)

emocareai/chatpsychiatrist 공식 구현 pytorch

Tasks

Language ModelingLanguage ModellingLarge Language Model

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

The Typing Cure: Experiences with Large Language Model Chatbots for Mental Health Support

2024-01-25 · Inhwa Song, Sachin R. Pendse, Neha Kumar, Munmun De Choudhury

People experiencing severe distress increasingly use Large Language Model (LLM) chatbots as mental health support tools. Discussions on social media have described how engagements were lifesaving for some, but evidence s…

Language ModelingLanguage ModellingLarge Language ModelNavigate

Severity Prediction in Mental Health: LLM-based Creation, Analysis, Evaluation of a Novel Multilingual Dataset

2024-09-25 · Konstantinos Skianis, John Pavlopoulos, A. Seza Doğruöz

Large Language Models (LLMs) are increasingly integrated into various medical fields, including mental health support systems. However, there is a gap in research regarding the effectiveness of LLMs in non-English mental…

severity prediction

Understanding Student Sentiment on Mental Health Support in Colleges Using Large Language Models

2024-11-18 · Palak Sood, Chengyang He, Divyanshu Gupta, Yue Ning 외

Mental health support in colleges is vital in educating students by offering counseling services and organizing supportive events. However, evaluating its effectiveness faces challenges like data collection difficulties …

Decision MakingManagementSentiment Analysis

Leveraging LLMs for Translating and Classifying Mental Health Data

2024-10-16 · Konstantinos Skianis, A. Seza Doğruöz, John Pavlopoulos

Large language models (LLMs) are increasingly used in medical fields. In mental health support, the early identification of linguistic markers associated with mental health conditions can provide valuable support to ment…

The opportunities and risks of large language models in mental health

2024-03-21 · Hannah R. Lawrence, Renee A. Schneider, Susan B. Rubin, Maja J. Mataric 외

Global rates of mental health concerns are rising, and there is increasing realization that existing models of mental health care will not adequately expand to meet the demand. With the emergence of large language models…