Task Refinement Learning for Improved Accuracy and Stability of Unsupervised Domain Adaptation
Pivot Based Language Modeling (PBLM) (Ziser and Reichart, 2018a), combining LSTMs with pivot-based methods, has yielded significant progress in unsupervised domain adaptation. However, this approach is still challenged by the large pivot detection problem that should be solved, and by the inherent instability of LSTMs. In this paper we propose a Task Refinement Learning (TRL) approach, in order to solve these problems. Our algorithms iteratively train the PBLM model, gradually increasing the information exposed about each pivot. TRL-PBLM achieves stateof- the-art accuracy in six domain adaptation setups for sentiment classification. Moreover, it is much more stable than plain PBLM across model configurations, making the model much better fitted for practical use.
Code (1)
Tasks
Domain AdaptationLanguage ModelingLanguage ModellingSentiment AnalysisSentiment ClassificationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
DMSA: Dynamic Multi-scale Unsupervised Semantic Segmentation Based on Adaptive Affinity
The proposed method in this paper proposes an end-to-end unsupervised semantic segmentation architecture DMSA based on four loss functions. The framework uses Atrous Spatial Pyramid Pooling (ASPP) module to enhance featu…
Semantic SegmentationUnsupervised Semantic SegmentationMulti-Stage Framework with Refinement Based Point Set Registration for Unsupervised Bi-Lingual Word Alignment
Cross-lingual alignment of word embeddings are important in knowledge transfer across languages, for improving machine translation and other multi-lingual applications. Current unsupervised approaches relying on learning…
Machine TranslationTransfer LearningTranslationWord Alignment+2Comparing Unsupervised Word Translation Methods Step by Step
Cross-lingual word vector space alignment is the task of mapping the vocabularies of two languages into a shared semantic space, which can be used for dictionary induction, unsupervised machine translation, and transfer …
Machine TranslationTransfer LearningTranslationUnsupervised Machine Translation+1"Teaching Independent Parts Separately" (TIPSy-GAN) : Improving Accuracy and Stability in Unsupervised Adversarial 2D to 3D Pose Estimation
We present TIPSy-GAN, a new approach to improve the accuracy and stability in unsupervised adversarial 2D to 3D human pose estimation. In our work we demonstrate that the human kinematic skeleton should not be assumed as…
3D Human Pose Estimation3D Pose EstimationKnowledge DistillationPose EstimationUnsupervised Word Translation Pairing using Refinement based Point Set Registration
Cross-lingual alignment of word embeddings play an important role in knowledge transfer across languages, for improving machine translation and other multi-lingual applications. Current unsupervised approaches rely on si…
Machine TranslationTransfer LearningTranslationWord Embeddings+1