Learning for Amalgamation: A Multi-Source Transfer Learning Framework For Sentiment Classification
Transfer learning plays an essential role in Deep Learning, which can remarkably improve the performance of the target domain, whose training data is not sufficient. Our work explores beyond the common practice of transfer learning with a single pre-trained model. We focus on the task of Vietnamese sentiment classification and propose LIFA, a framework to learn a unified embedding from several pre-trained models. We further propose two more LIFA variants that encourage the pre-trained models to either cooperate or compete with one another. Studying these variants sheds light on the success of LIFA by showing that sharing knowledge among the models is more beneficial for transfer learning. Moreover, we construct the AISIA-VN-Review-F dataset, the first large-scale Vietnamese sentiment classification database. We conduct extensive experiments on the AISIA-VN-Review-F and existing benchmarks to demonstrate the efficacy of LIFA compared to other techniques. To contribute to the Vietnamese NLP research, we publish our source code and datasets to the research community upon acceptance.
Code (1)
Tasks
Sentiment AnalysisSentiment ClassificationTransfer LearningSimilar Papers 제목 키워드 기반
Probing Sentiment-Oriented Pre-Training Inspired by Human Sentiment Perception Mechanism
Pre-training of deep convolutional neural networks (DCNNs) plays a crucial role in the field of visual sentiment analysis (VSA). Most proposed methods employ the off-the-shelf backbones pre-trained on large-scale obj…
Multi-Label LearningSentiment AnalysisSelf-Regulated Data-Free Knowledge Amalgamation for Text Classification
Recently, there has been a growing availability of pre-trained text models on various model repositories. These models greatly reduce the cost of training new models from scratch as they can be fine-tuned for specific ta…
text-classificationText ClassificationTransfer LearningKnowledge Amalgamation for Object Detection with Transformers
Knowledge amalgamation (KA) is a novel deep model reusing task aiming to transfer knowledge from several well-trained teachers to a multi-talented and compact student. Currently, most of these approaches are tailored for…
Objectobject-detectionObject DetectionTransferring Social Network Knowledge from Multiple GNN Teachers to Kolmogorov-Arnold Networks
Graph Neural Networks (GNNs) have shown strong performance on graph-structured data, but their reliance on graph connectivity often limits scalability and efficiency. Kolmogorov-Arnold Networks (KANs), a recent architect…
Node ClassificationMusic Sentiment Transfer
Music sentiment transfer is a completely novel task. Sentiment transfer is a natural evolution of the heavily-studied style transfer task, as sentiment transfer is rooted in applying the sentiment of a source to be the n…
Style Transfer