paper-with-me

Papers

Towards Robust Low-Resource Fine-Tuning with Multi-View Compressed Representations

2022-11-16 · Linlin Liu, Xingxuan Li, Megh Thakkar, Xin Li, Shafiq Joty, Luo Si, Lidong Bing

Due to the huge amount of parameters, fine-tuning of pretrained language models (PLMs) is prone to overfitting in the low resource scenarios. In this work, we present a novel method that operates on the hidden representations of a PLM to reduce overfitting. During fine-tuning, our method inserts random autoencoders between the hidden layers of a PLM, which transform activations from the previous layers into multi-view compressed representations before feeding them into the upper layers. The autoencoders are plugged out after fine-tuning, so our method does not add extra parameters or increase computation cost during inference. Our method demonstrates promising performance improvement across a wide range of sequence- and token-level low-resource NLP tasks.

📄 PDF Abstract BibTeX arXiv:2211.08794

Code (1)

damo-nlp-sg/mvcr 공식 구현 pytorch

Similar Papers 제목 키워드 기반

FedBiOT: LLM Local Fine-tuning in Federated Learning without Full Model

2024-06-25 · Feijie Wu, Zitao Li, Yaliang Li, Bolin Ding 외

Large language models (LLMs) show amazing performance on many domain-specific tasks after fine-tuning with some appropriate data. However, many domain-specific data are privately distributed across multiple owners. Thus,…

Federated Learning

Efficient Fine-Tuning of Compressed Language Models with Learners

2022-08-03 · Danilo Vucetic, Mohammadreza Tayaranian, Maryam Ziaeefard, James J. Clark 외

Fine-tuning BERT-based models is resource-intensive in memory, computation, and time. While many prior works aim to improve inference efficiency via compression techniques, e.g., pruning, these works do not explicitly ad…

CoLANavigate

Compressed Video Prompt Tuning

2023-09-21 · NeurIPS 2023 11

Compressed videos offer a compelling alternative to raw videos, showing the possibility to significantly reduce the on-line computational and storage cost. However, current approaches to compressed video processing gener…

Alignment Adapter to Improve the Performance of Compressed Deep Learning Models

2026-02-16 · Rohit Raj Rai, Abhishek Dhaka, Amit Awekar arxiv

Compressed Deep Learning (DL) models are essential for deployment in resource-constrained environments. But their performance often lags behind their large-scale counterparts. To bridge this gap, we propose Alignment Ada…

PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression

2024-05-23 · Vladimir Malinovskii, Denis Mazur, Ivan Ilin, Denis Kuznedelev 외

There has been significant interest in "extreme" compression of large language models (LLMs), i.e., to 1-2 bits per parameter, which allows such models to be executed efficiently on resource-constrained devices. Existing…

Quantization