paper-with-me

홈 › Papers

Learning for Amalgamation: A Multi-Source Transfer Learning Framework For Sentiment Classification

2023-03-16 · Cuong V. Nguyen, Khiem H. Le, Anh M. Tran, Quang H. Pham, Binh T. Nguyen

Transfer learning plays an essential role in Deep Learning, which can remarkably improve the performance of the target domain, whose training data is not sufficient. Our work explores beyond the common practice of transfer learning with a single pre-trained model. We focus on the task of Vietnamese sentiment classification and propose LIFA, a framework to learn a unified embedding from several pre-trained models. We further propose two more LIFA variants that encourage the pre-trained models to either cooperate or compete with one another. Studying these variants sheds light on the success of LIFA by showing that sharing knowledge among the models is more beneficial for transfer learning. Moreover, we construct the AISIA-VN-Review-F dataset, the first large-scale Vietnamese sentiment classification database. We conduct extensive experiments on the AISIA-VN-Review-F and existing benchmarks to demonstrate the efficacy of LIFA compared to other techniques. To contribute to the Vietnamese NLP research, we publish our source code and datasets to the research community upon acceptance.

📄 PDF Abstract BibTeX arXiv:2303.09115

Code (1)

lhkhiem28/Learning-for-Amalgamation 공식 구현 pytorch

Tasks

Sentiment AnalysisSentiment ClassificationTransfer Learning

Similar Papers 제목 키워드 기반

Probing Sentiment-Oriented Pre-Training Inspired by Human Sentiment Perception Mechanism

2023-01-01 · CVPR 2023 1 · Tinglei Feng, Jiaxuan Liu, Jufeng Yang

Pre-training of deep convolutional neural networks (DCNNs) plays a crucial role in the field of visual sentiment analysis (VSA). Most proposed methods employ the off-the-shelf backbones pre-trained on large-scale obj…

Multi-Label LearningSentiment Analysis

Self-Regulated Data-Free Knowledge Amalgamation for Text Classification

2024-06-16 · Prashanth Vijayaraghavan, Hongzhi Wang, Luyao Shi, Tyler Baldwin 외

Recently, there has been a growing availability of pre-trained text models on various model repositories. These models greatly reduce the cost of training new models from scratch as they can be fine-tuned for specific ta…

text-classificationText ClassificationTransfer Learning

Knowledge Amalgamation for Object Detection with Transformers

2022-03-07 · Haofei Zhang, Feng Mao, Mengqi Xue, Gongfan Fang 외

Knowledge amalgamation (KA) is a novel deep model reusing task aiming to transfer knowledge from several well-trained teachers to a multi-talented and compact student. Currently, most of these approaches are tailored for…

Objectobject-detectionObject Detection

Transferring Social Network Knowledge from Multiple GNN Teachers to Kolmogorov-Arnold Networks

2025-08-08 · Yuan-Hung Chao, Chia-Hsun Lu, Chih-Ya Shen arxiv

Graph Neural Networks (GNNs) have shown strong performance on graph-structured data, but their reliance on graph connectivity often limits scalability and efficiency. Kolmogorov-Arnold Networks (KANs), a recent architect…

Node Classification

Music Sentiment Transfer

2021-10-12 · Miles Sigel, Michael Zhou, Jiebo Luo

Music sentiment transfer is a completely novel task. Sentiment transfer is a natural evolution of the heavily-studied style transfer task, as sentiment transfer is rooted in applying the sentiment of a source to be the n…

Style Transfer