Text Augmentations with R-drop for Classification of Tweets Self Reporting Covid-19
This paper presents models created for the Social Media Mining for Health 2023 shared task. Our team addressed the first task, classifying tweets that self-report Covid-19 diagnosis. Our approach involves a classification model that incorporates diverse textual augmentations and utilizes R-drop to augment data and mitigate overfitting, boosting model efficacy. Our leading model, enhanced with R-drop and augmentations like synonym substitution, reserved words, and back translations, outperforms the task mean and median scores. Our system achieves an impressive F1 score of 0.877 on the test set.
Code (0)
등록된 구현이 없습니다.
Tasks
COVID-19 DiagnosisSimilar Papers 제목 키워드 기반
Which Augmentation Should I Use? An Empirical Investigation of Augmentations for Self-Supervised Phonocardiogram Representation Learning
Despite recent advancements in deep learning, its application in real-world medical settings, such as phonocardiogram (PCG) classification, remains limited. A significant barrier is the lack of high-quality annotated dat…
Contrastive LearningRepresentation LearningSelf-Supervised LearningDiscriminating between standard Romanian and Moldavian tweets using filtered character ngrams
We applied word unigram models, character ngram models, and CNNs to the task of distinguishing tweets of two related dialects of Romanian (standard Romanian and Moldavian) for the VarDial 2020 RDI shared task (Gaman et a…
Articlestext-classificationText ClassificationSelf-supervised Temporal Learning
Self-supervised learning (SSL) has shown its powerful ability in discriminative representations for various visual, audio, and video applications. However, most recent works still focus on the different paradigms of spat…
Contrastive LearningRetrievalSelf-Supervised LearningVideo Classification+1BAKSA at SemEval-2020 Task 9: Bolstering CNN with Self-Attention for Sentiment Analysis of Code Mixed Text
Sentiment Analysis of code-mixed text has diversified applications in opinion mining ranging from tagging user reviews to identifying social or political sentiments of a sub-population. In this paper, we present an ensem…
General ClassificationOpinion MiningSentiment AnalysisConnect Later: Improving Fine-tuning for Robustness with Targeted Augmentations
Models trained on a labeled source domain (e.g., labeled images from wildlife camera traps) often generalize poorly when deployed on an out-of-distribution (OOD) target domain (e.g., images from new camera trap locations…
Contrastive LearningDomain AdaptationTime SeriesTime Series Classification