paper-with-me

Papers

Layer by Layer: Uncovering Where Multi-Task Learning Happens in Instruction-Tuned Large Language Models

2024-10-25 · Zheng Zhao, Yftah Ziser, Shay B. Cohen

Fine-tuning pre-trained large language models (LLMs) on a diverse array of tasks has become a common approach for building models that can solve various natural language processing (NLP) tasks. However, where and to what extent these models retain task-specific knowledge remains largely unexplored. This study investigates the task-specific information encoded in pre-trained LLMs and the effects of instruction tuning on their representations across a diverse set of over 60 NLP tasks. We use a set of matrix analysis tools to examine the differences between the way pre-trained and instruction-tuned LLMs store task-specific information. Our findings reveal that while some tasks are already encoded within the pre-trained LLMs, others greatly benefit from instruction tuning. Additionally, we pinpointed the layers in which the model transitions from high-level general representations to more task-oriented representations. This finding extends our understanding of the governing mechanisms of LLMs and facilitates future research in the fields of parameter-efficient transfer learning and multi-task learning.

📄 PDF Abstract BibTeX arXiv:2410.20008

Code (0)

등록된 구현이 없습니다.

Tasks

Multi-Task LearningTransfer Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Recovering the Lowest Layer of Deep Networks with High Threshold Activations

2019-03-21 · ICLR 2019 5 · Surbhi Goel, Rina Panigrahy

Giving provable guarantees for learning neural networks is a core challenge of machine learning theory. Most prior work gives parameter recovery guarantees for one hidden layer networks, however, the networks used in pra…

BIG-bench Machine LearningLearning TheoryVocal Bursts Intensity Prediction

Layer-Wise Evolution of Representations in Fine-Tuned Transformers: Insights from Sparse AutoEncoders

2025-02-23 · Suneel Nadipalli

Fine-tuning pre-trained transformers is a powerful technique for enhancing the performance of base models on specific tasks. From early applications in models like BERT to fine-tuning Large Language Models (LLMs), this a…

Representation Learning

Layer by Layer: Uncovering Hidden Representations in Language Models

2025-02-04 · Oscar Skean, Md Rifat Arefin, Dan Zhao, Niket Patel 외

From extracting features to generating text, the outputs of large language models (LLMs) typically rely on their final layers, following the conventional wisdom that earlier layers capture only low-level cues. However, o…

State Space Models

Structure Amplification on Multi-layer Stochastic Block Models

2021-07-31 · Xiaodong Xin, Kun He, Jialu Bao, Bart Selman 외

Much of the complexity of social, biological, and engineered systems arises from a network of complex interactions connecting many basic components. Network analysis tools have been successful at uncovering latent struct…

Stochastic Block Model

Mechanism and Emergence of Stacked Attention Heads in Multi-Layer Transformers

2024-11-18 · Tiberiu Musat

In this paper, I introduce the retrieval problem, a simple yet common reasoning task that can be solved only by transformers with a minimum number of layers, which grows logarithmically with the input size. I empirically…

Retrieval