paper-with-me

Papers

Unveiling and Mitigating Bias in Mental Health Analysis with Large Language Models

2024-06-17 · Yuqing Wang, Yun Zhao, Sara Alessandra Keller, Anne de Hond, Marieke M. van Buchem, Malvika Pillai, Tina Hernandez-Boussard

The advancement of large language models (LLMs) has demonstrated strong capabilities across various applications, including mental health analysis. However, existing studies have focused on predictive performance, leaving the critical issue of fairness underexplored, posing significant risks to vulnerable populations. Despite acknowledging potential biases, previous works have lacked thorough investigations into these biases and their impacts. To address this gap, we systematically evaluate biases across seven social factors (e.g., gender, age, religion) using ten LLMs with different prompting methods on eight diverse mental health datasets. Our results show that GPT-4 achieves the best overall balance in performance and fairness among LLMs, although it still lags behind domain-specific models like MentalRoBERTa in some cases. Additionally, our tailored fairness-aware prompts can effectively mitigate bias in mental health predictions, highlighting the great potential for fair analysis in this field.

📄 PDF Abstract BibTeX arXiv:2406.12033

Code (1)

eternityyw/biaseval-llm-mentalhealth 공식 구현 pytorch

Tasks

Fairness

Methods 이 논문이 사용한 방법론

Residual Connection 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

Style Transfer as Bias Mitigation: Diffusion Models for Synthetic Mental Health Text for Arabic

2026-01-20 · Saad Mankarious, Aya Zirikly arxiv

Synthetic data offers a promising solution for mitigating data scarcity and demographic bias in mental health analysis, yet existing approaches largely rely on pretrained large language models (LLMs), which may suffer fr…

Text GenerationStyle Transfer

A Data-Centric Approach to Detecting and Mitigating Demographic Bias in Pediatric Mental Health Text: A Case Study in Anxiety Detection

2024-12-30 · Julia Ive, Paulina Bondaronek, Vishal Yadav, Daniel Santel 외

Introduction: Healthcare AI models often inherit biases from their training data. While efforts have primarily targeted bias in structured data, mental health heavily depends on unstructured data. This study aims to dete…

Anxiety DetectionDiagnostic

Faces of the Mind: Unveiling Mental Health States Through Facial Expressions in 11,427 Adolescents

2024-05-30 · Xiao Xu, Keyin Zhou, Yan Zhang, Yang Wang 외

Mood disorders, including depression and anxiety, often manifest through facial expressions. While previous research has explored the connection between facial features and emotions, machine learning algorithms for estim…

Unveiling and Mitigating Generalized Biases of DNNs through the Intrinsic Dimensions of Perceptual Manifolds

2024-04-22 · Yanbiao Ma, Licheng Jiao, Fang Liu, Lingling Li 외

Building fair deep neural networks (DNNs) is a crucial step towards achieving trustworthy artificial intelligence. Delving into deeper factors that affect the fairness of DNNs is paramount and serves as the foundation fo…

Fairness

Then and Now: Quantifying the Longitudinal Validity of Self-Disclosed Depression Diagnoses

2022-06-22 · NAACL (CLPsych) 2022 7 · Keith Harrigian, Mark Dredze

Self-disclosed mental health diagnoses, which serve as ground truth annotations of mental health status in the absence of clinical measures, underpin the conclusions behind most computational studies of mental health lan…

Selection bias