Domain Generalization for Text Classification with Memory-Based Supervised Contrastive Learning
While there is much research on cross-domain text classification, most existing approaches focus on one-to-one or many-to-one domain adaptation. In this paper, we tackle the more challenging task of domain generalization, in which domain-invariant representations are learned from multiple source domains, without access to any data from the target domains, and classification decisions are then made on test documents in unseen target domains. We propose a novel framework based on supervised contrastive learning with a memory-saving queue. In this way, we explicitly encourage examples of the same class to be closer and examples of different classes to be further apart in the embedding space. We have conducted extensive experiments on two Amazon review sentiment datasets, and one rumour detection dataset. Experimental results show that our domain generalization method consistently outperforms state-of-the-art domain adaptation methods.
Code (1)
Tasks
Contrastive LearningCross-Domain Text ClassificationDomain AdaptationDomain GeneralizationRumour Detectiontext-classificationText ClassificationSimilar Papers 제목 키워드 기반
Improving out-of-distribution generalization via multi-task self-supervised pretraining
Self-supervised feature representations have been shown to be useful for supervised classification, few-shot learning, and adversarial robustness. We show that features obtained using self-supervised learning are compara…
Adversarial RobustnessDomain GeneralizationFew-Shot LearningMulti-Task Learning+2Learning to Generalize Unseen Domains via Multi-Source Meta Learning for Text Classification
With the rapid development of deep learning methods, there have been many breakthroughs in the field of text classification. Models developed for this task have been shown to achieve high accuracy. However, most of these…
Domain GeneralizationMeta-Learningtext-classificationText ClassificationAnalyzing ELMo and DistilBERT on Socio-political News Classification
This study evaluates the robustness of two state-of-the-art deep contextual language representations, ELMo and DistilBERT, on supervised learning of binary protest news classification (PC) and sentiment analysis (SA) of …
ClassificationGeneral ClassificationNews ClassificationSentiment AnalysisMultisource Semisupervised Adversarial Domain Generalization Network for Cross-Scene Sea-Land Clutter Classification
Deep learning (DL)-based sea\textendash land clutter classification for sky-wave over-the-horizon-radar (OTHR) has become a novel research topic. In engineering applications, real-time predictions of sea\textendash land …
Domain GeneralizationGenerative Adversarial NetworkLearning to Generalize Unseen Domains via Memory-based Multi-Source Meta-Learning for Person Re-Identification
Recent advances in person re-identification (ReID) obtain impressive accuracy in the supervised and unsupervised learning settings. However, most of the existing methods need to train a new model for a new domain by acce…
Domain GeneralizationMeta-LearningPerson Re-IdentificationUnsupervised Domain Adaptation