paper-with-me

Papers

Domain Generalization for Text Classification with Memory-Based Supervised Contrastive Learning

2022-10-01 · COLING 2022 10 · Qingyu Tan, Ruidan He, Lidong Bing, Hwee Tou Ng

While there is much research on cross-domain text classification, most existing approaches focus on one-to-one or many-to-one domain adaptation. In this paper, we tackle the more challenging task of domain generalization, in which domain-invariant representations are learned from multiple source domains, without access to any data from the target domains, and classification decisions are then made on test documents in unseen target domains. We propose a novel framework based on supervised contrastive learning with a memory-saving queue. In this way, we explicitly encourage examples of the same class to be closer and examples of different classes to be further apart in the embedding space. We have conducted extensive experiments on two Amazon review sentiment datasets, and one rumour detection dataset. Experimental results show that our domain generalization method consistently outperforms state-of-the-art domain adaptation methods.

📄 PDF Abstract BibTeX

Code (1)

tonytan48/mscl 공식 구현 pytorch

Tasks

Contrastive LearningCross-Domain Text ClassificationDomain AdaptationDomain GeneralizationRumour Detectiontext-classificationText Classification

Similar Papers 제목 키워드 기반

Improving out-of-distribution generalization via multi-task self-supervised pretraining

2020-03-30 · Isabela Albuquerque, Nikhil Naik, Junnan Li, Nitish Keskar 외

Self-supervised feature representations have been shown to be useful for supervised classification, few-shot learning, and adversarial robustness. We show that features obtained using self-supervised learning are compara…

Adversarial RobustnessDomain GeneralizationFew-Shot LearningMulti-Task Learning+2

Learning to Generalize Unseen Domains via Multi-Source Meta Learning for Text Classification

2024-09-20 · Yuxuan Hu, Chenwei Zhang, Min Yang, Xiaodan Liang 외

With the rapid development of deep learning methods, there have been many breakthroughs in the field of text classification. Models developed for this task have been shown to achieve high accuracy. However, most of these…

Domain GeneralizationMeta-Learningtext-classificationText Classification

Analyzing ELMo and DistilBERT on Socio-political News Classification

2020-05-01 · LREC 2020 5 · Berfu B{\"u}y{\"u}k{\"o}z, Ali H{\"u}rriyeto{\u{g}}lu, Arzucan {\"O}zg{\"u}r

This study evaluates the robustness of two state-of-the-art deep contextual language representations, ELMo and DistilBERT, on supervised learning of binary protest news classification (PC) and sentiment analysis (SA) of …

ClassificationGeneral ClassificationNews ClassificationSentiment Analysis

Multisource Semisupervised Adversarial Domain Generalization Network for Cross-Scene Sea-Land Clutter Classification

2024-02-09 · Xiaoxuan Zhang, Quan Pan, Salvador García

Deep learning (DL)-based sea\textendash land clutter classification for sky-wave over-the-horizon-radar (OTHR) has become a novel research topic. In engineering applications, real-time predictions of sea\textendash land …

Domain GeneralizationGenerative Adversarial Network

Learning to Generalize Unseen Domains via Memory-based Multi-Source Meta-Learning for Person Re-Identification

2020-12-01 · CVPR 2021 1 · Yuyang Zhao, Zhun Zhong, Fengxiang Yang, Zhiming Luo 외

Recent advances in person re-identification (ReID) obtain impressive accuracy in the supervised and unsupervised learning settings. However, most of the existing methods need to train a new model for a new domain by acce…

Domain GeneralizationMeta-LearningPerson Re-IdentificationUnsupervised Domain Adaptation