IIITN NLP at SMM4H 2021 Tasks: Transformer Models for Classification on Health-Related Imbalanced Twitter Datasets
With increasing users sharing health-related information on social media, there has been a rise in using social media for health monitoring and surveillance. In this paper, we present a system that addresses classic health-related binary classification problems presented in Tasks 1a, 4, and 8 of the 6th edition of Social Media Mining for Health Applications (SMM4H) shared tasks. We developed a system based on RoBERTa (for Task 1a & 4) and BioBERT (for Task 8). Furthermore, we address the challenge of the imbalanced dataset and propose techniques such as undersampling, oversampling, and data augmentation to overcome the imbalanced nature of a given health-related dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Binary ClassificationData AugmentationSimilar Papers 제목 키워드 기반
Benchmarking of Transformer-Based Pre-Trained Models on Social Media Text Classification Datasets
Free text data from social media is now widely used in natural language processing research, and one of the most common machine learning tasks performed on this data is classification. Generally speaking, performances of…
BenchmarkingClassificationtext-classificationText ClassificationIdentification of profession & occupation in Health-related Social Media using tweets in Spanish
In this paper we present our approach and system description on Task 7a in ProfNer-ST: Identification of profession & occupation in Health related Social Media. Our main contribution is to show the effectiveness of using…
ARGUABLY@SMM4H’22: Classification of Health Related Tweets using Ensemble, Zero-Shot and Fine-Tuned Language Model
With the increase in the use of social media, people have become more outspoken and are using platforms like Reddit, Facebook, and Twitter to express their views and share the medical challenges they are facing. This dat…
Language ModelingLanguage ModellingCorrelated Attention in Transformers for Multivariate Time Series
Multivariate time series (MTS) analysis prevails in real-world applications such as finance, climate science and healthcare. The various self-attention mechanisms, the backbone of the state-of-the-art Transformer-based m…
Anomaly DetectionImputationRepresentation LearningTime SeriesDoes Multi-Task Learning Always Help?: An Evaluation on Health Informatics
Multi-Task Learning (MTL) has been an attractive approach to deal with limited labeled datasets or leverage related tasks, for a variety of NLP problems. We examine the benefit of MTL for three specific pairs of health i…
ClassificationGeneral ClassificationMulti-Task LearningRelevance Detection