paper-with-me

홈 › Papers

Harnessing the Power of Hugging Face Transformers for Predicting Mental Health Disorders in Social Networks

2023-06-29 · Alireza Pourkeyvan, Ramin Safa, Ali Sorourkhah

Early diagnosis of mental disorders and intervention can facilitate the prevention of severe injuries and the improvement of treatment results. Using social media and pre-trained language models, this study explores how user-generated data can be used to predict mental disorder symptoms. Our study compares four different BERT models of Hugging Face with standard machine learning techniques used in automatic depression diagnosis in recent literature. The results show that new models outperform the previous approach with an accuracy rate of up to 97%. Analyzing the results while complementing past findings, we find that even tiny amounts of data (like users' bio descriptions) have the potential to predict mental disorders. We conclude that social media data is an excellent source of mental health screening, and pre-trained models can effectively automate this critical task.

📄 PDF Abstract BibTeX arXiv:2306.16891

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Weight Decay 설명 없음
Multi-Head Attention 설명 없음
Residual Connection 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Do Protein Transformers Have Biological Intelligence?

2025-06-07 · Fudong Lin, Wanrou Du, Jinchan Liu, Tarikul Milon 외

Deep neural networks, particularly Transformers, have been widely adopted for predicting the functional properties of proteins. In this work, we focus on exploring whether Protein Transformers can capture biological inte…

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)

HuggingFace's Transformers: State-of-the-art Natural Language Processing

2019-10-09 · Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond 외

Recent progress in natural language processing has been driven by advances in both model architecture and model pretraining. Transformer architectures have facilitated building higher-capacity models and pretraining has …

Text GenerationTransfer Learning

The last Dance : Robust backdoor attack via diffusion models and bayesian approach

2024-02-05 · Orson Mengara

Diffusion models are state-of-the-art deep learning generative models that are trained on the principle of learning forward and backward diffusion processes via the progressive addition of noise and denoising. In this pa…

Backdoor AttackDenoising

Evaluating natural language processing models with generalization metrics that do not need access to any training or testing data

2022-02-06 · Yaoqing Yang, Ryan Theisen, Liam Hodgkinson, Joseph E. Gonzalez 외

Selecting suitable architecture parameters and training hyperparameters is essential for enhancing machine learning (ML) model performance. Several recent empirical studies conduct large-scale correlational analysis on n…

Model Selection

HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face

2023-03-30 · NeurIPS 2023 11 · Yongliang Shen, Kaitao Song, Xu Tan, Dongsheng Li 외

Solving complicated AI tasks with different domains and modalities is a key step toward artificial general intelligence. While there are numerous AI models available for various domains and modalities, they cannot handle…

Automatic Machine Learning Model SelectionModel SelectionPhilosophyTask Planning