paper-with-me

Papers

"Is depression related to cannabis?": A knowledge-infused model for Entity and Relation Extraction with Limited Supervision

2021-02-01 · Kaushik Roy, Usha Lokala, Vedant Khandelwal, Amit Sheth

With strong marketing advocacy of the benefits of cannabis use for improved mental health, cannabis legalization is a priority among legislators. However, preliminary scientific research does not conclusively associate cannabis with improved mental health. In this study, we explore the relationship between depression and consumption of cannabis in a targeted social media corpus involving personal use of cannabis with the intent to derive its potential mental health benefit. We use tweets that contain an association among three categories annotated by domain experts - Reason, Effect, and Addiction. The state-of-the-art Natural Langauge Processing techniques fall short in extracting these relationships between cannabis phrases and the depression indicators. We seek to address the limitation by using domain knowledge; specifically, the Drug Abuse Ontology for addiction augmented with Diagnostic and Statistical Manual of Mental Disorders lexicons for mental health. Because of the lack of annotations due to the limited availability of the domain experts' time, we use supervised contrastive learning in conjunction with GPT-3 trained on a vast corpus to achieve improved performance even with limited supervision. Experimental results show that our method can significantly extract cannabis-depression relationships better than the state-of-the-art relation extractor. High-quality annotations can be provided using a nearest neighbor approach using the learned representations that can be used by the scientific community to understand the association between cannabis and depression better.

📄 PDF Abstract BibTeX arXiv:2102.01222

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningDiagnosticMarketingRelation Extraction

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Contrastive Learning 설명 없음
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

"When they say weed causes depression, but it's your fav antidepressant": Knowledge-aware Attention Framework for Relationship Extraction

2020-09-21 · Shweta Yadav, Usha Lokala, Raminta Daniulaityte, Krishnaprasad Thirunarayan 외

With the increasing legalization of medical and recreational use of cannabis, more research is needed to understand the association between depression and consumer behavior related to cannabis consumption. Big social med…

PositionSentence

KSAT: Knowledge-infused Self Attention Transformer -- Integrating Multiple Domain-Specific Contexts

2022-10-09 · Kaushik Roy, Yuxin Zi, Vignesh Narayanan, Manas Gaur 외

Domain-specific language understanding requires integrating multiple pieces of relevant contextual information. For example, we see both suicide and depression-related behavior (multiple contexts) in the text ``I have a …

Specificity

Deep Knowledge-Infusion For Explainable Depression Detection

2024-09-01 · Sumit Dalal, Sarika Jain, Mayank Dave

Discovering individuals depression on social media has become increasingly important. Researchers employed ML/DL or lexicon-based methods for automated depression detection. Lexicon based methods, explainable and easy to…

Depression Detection

DepressionX: Knowledge Infused Residual Attention for Explainable Depression Severity Assessment

2025-01-24 · Yusif Ibrahimov, Tarique Anwar, Tommy Yuan

In today's interconnected society, social media platforms have become an important part of our lives, where individuals virtually express their thoughts, emotions, and moods. These expressions offer valuable insights int…

Decision Making

A Cross Attention Approach to Diagnostic Explainability using Clinical Practice Guidelines for Depression

2023-11-23 · Sumit Dalal, Deepa Tilwani, Kaushik Roy, Manas Gaur 외

The lack of explainability using relevant clinical knowledge hinders the adoption of Artificial Intelligence-powered analysis of unstructured clinical dialogue. A wealth of relevant, untapped Mental Health (MH) data is a…

Clinical KnowledgeDiagnosticLanguage Modelling