DeepBlues@LT-EDI-ACL2022: Depression level detection modelling through domain specific BERT and short text Depression classifiers
We discuss a variety of approaches to build a robust Depression level detection model from longer social media posts (i.e., Reddit Depression forum posts) using a mental health text pre-trained BERT model. Further, we report our experimental results based on a strategy to select excerpts from long text and then fine-tune the BERT model to combat the issue of memory constraints while processing such texts. We show that, with domain specific BERT, we can achieve reasonable accuracy with fixed text size (in this case 200 tokens) for this task. In addition we can use short text classifiers to extract relevant text from the long text and achieve slightly better accuracy, albeit, trading off with the processing time for extracting such excerpts.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Deep Temporal Modelling of Clinical Depression through Social Media Text
We describe the development of a model to detect user-level clinical depression based on a user's temporal social media posts. Our model uses a Depression Symptoms Detection (DSD) classifier, which is trained on the larg…
Depression DetectionTwo-stage Temporal Modelling Framework for Video-based Depression Recognition using Graph Representation
Video-based automatic depression analysis provides a fast, objective and repeatable self-assessment solution, which has been widely developed in recent years. While depression clues may be reflected by human facial behav…
Depression Symptoms Modelling from Social Media Text: A Semi-supervised Learning Approach
A fundamental component of user-level social media language based clinical depression modelling is depression symptoms detection (DSD). Unfortunately, there does not exist any DSD dataset that reflects both the clinical …
Active LearningDepression DetectionLanguage ModellingZero-Shot LearningEfficient Long Speech Sequence Modelling for Time-Domain Depression Level Estimation
Depression significantly affects emotions, thoughts, and daily activities. Recent research indicates that speech signals contain vital cues about depression, sparking interest in audio-based deep-learning methods for est…
Context-Aware Deep Learning for Multi Modal Depression Detection
In this study, we focus on automated approaches to detect depression from clinical interviews using multi-modal machine learning (ML). Our approach differentiates from other successful ML methods such as context-aware an…
Data AugmentationDeep LearningDepression DetectionFeature Engineering