Co-Regularized Adversarial Learning for Multi-Domain Text Classification
Multi-domain text classification (MDTC) aims to leverage all available resources from multiple domains to learn a predictive model that can generalize well on these domains. Recently, many MDTC methods adopt adversarial learning, shared-private paradigm, and entropy minimization to yield state-of-the-art results. However, these approaches face three issues: (1) Minimizing domain divergence can not fully guarantee the success of domain alignment; (2) Aligning marginal feature distributions can not fully guarantee the discriminability of the learned features; (3) Standard entropy minimization may make the predictions on unlabeled data over-confident, deteriorating the discriminability of the learned features. In order to address the above issues, we propose a co-regularized adversarial learning (CRAL) mechanism for MDTC. This approach constructs two diverse shared latent spaces, performs domain alignment in each of them, and punishes the disagreements of these two alignments with respect to the predictions on unlabeled data. Moreover, virtual adversarial training (VAT) with entropy minimization is incorporated to impose consistency regularization to the CRAL method. Experiments show that our model outperforms state-of-the-art methods on two MDTC benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
Classificationtext-classificationText ClassificationSimilar Papers 제목 키워드 기반
Mixup Regularized Adversarial Networks for Multi-Domain Text Classification
Using the shared-private paradigm and adversarial training has significantly improved the performances of multi-domain text classification (MDTC) models. However, there are two issues for the existing methods. First, ins…
ClassificationGeneral Classificationtext-classificationText ClassificationRegularized Conditional Alignment for Multi-Domain Text Classification
The most successful multi-domain text classification (MDTC) approaches employ the shared-private paradigm to facilitate the enhancement of domain-invariant features through domain-specific attributes. Additionally, they …
Classificationtext-classificationText ClassificationPoison Attacks against Text Datasets with Conditional Adversarially Regularized Autoencoder
This paper demonstrates a fatal vulnerability in natural language inference (NLI) and text classification systems. More concretely, we present a 'backdoor poisoning' attack on NLP models. Our poisoning attack utilizes co…
ClassificationGeneral ClassificationNatural Language Inferencetext-classification+1BanditMTL: Bandit-based Multi-task Learning for Text Classification
Task variance regularization, which can be used to improve the generalization of Multi-task Learning (MTL) models, remains unexplored in multi-task text classification. Accordingly, to fill this gap, this paper investiga…
ClassificationMulti-Task Learningtext-classificationText ClassificationMLAN: Multi-Level Adversarial Network for Domain Adaptive Semantic Segmentation
Recent progresses in domain adaptive semantic segmentation demonstrate the effectiveness of adversarial learning (AL) in unsupervised domain adaptation. However, most adversarial learning based methods align source and t…
Domain AdaptationImage-to-Image TranslationSemantic SegmentationTranslation+1