Strong Baselines for Neural Semi-supervised Learning under Domain Shift
Novel neural models have been proposed in recent years for learning under domain shift. Most models, however, only evaluate on a single task, on proprietary datasets, or compare to weak baselines, which makes comparison of models difficult. In this paper, we re-evaluate classic general-purpose bootstrapping approaches in the context of neural networks under domain shifts vs. recent neural approaches and propose a novel multi-task tri-training method that reduces the time and space complexity of classic tri-training. Extensive experiments on two benchmarks are negative: while our novel method establishes a new state-of-the-art for sentiment analysis, it does not fare consistently the best. More importantly, we arrive at the somewhat surprising conclusion that classic tri-training, with some additions, outperforms the state of the art. We conclude that classic approaches constitute an important and strong baseline.
Code (2)
Tasks
Domain AdaptationMulti-Task LearningPart-Of-Speech TaggingSentiment AnalysisSimilar Papers 제목 키워드 기반
Domain-Guided Weight Modulation for Semi-Supervised Domain Generalization
Unarguably, deep learning models capable of generalizing to unseen domain data while leveraging a few labels are of great practical significance due to low developmental costs. In search of this endeavor, we study the ch…
Domain GeneralizationSemi-Supervised Domain GeneralizationSelf-training Improves Pre-training for Natural Language Understanding
Unsupervised pre-training has led to much recent progress in natural language understanding. In this paper, we study self-training as another way to leverage unlabeled data through semi-supervised learning. To obtain add…
Data AugmentationFew-Shot LearningKnowledge DistillationNatural Language Understanding+3Towards Generalizing to Unseen Domains with Few Labels
We approach the challenge of addressing semi-supervised domain generalization (SSDG). Specifically, our aim is to obtain a model that learns domain-generalizable features by leveraging a limited subset of labelled data a…
Domain GeneralizationPseudo LabelSemi-Supervised Domain GeneralizationVision-Language Enhanced Foundation Model for Semi-supervised Medical Image Segmentation
Semi-supervised learning (SSL) has emerged as an effective paradigm for medical image segmentation, reducing the reliance on extensive expert annotations. Meanwhile, vision-language models (VLMs) have demonstrated strong…
Semi-supervised Medical Image SegmentationTowards Multimodal Domain Generalization with Few Labels
Multimodal models ideally should generalize to unseen domains while remaining data-efficient to reduce annotation costs. To this end, we introduce and study a new problem, Semi-Supervised Multimodal Domain Generalization…
Domain Generalization