paper-with-me

홈 › Papers

FIRST: Teach A Reliable Large Language Model Through Efficient Trustworthy Distillation

2024-08-22 · Kashun Shum, Minrui Xu, Jianshu Zhang, Zixin Chen, Shizhe Diao, Hanze Dong, Jipeng Zhang, Muhammad Omer Raza

Large language models (LLMs) have become increasingly prevalent in our daily lives, leading to an expectation for LLMs to be trustworthy -- - both accurate and well-calibrated (the prediction confidence should align with its ground truth correctness likelihood). Nowadays, fine-tuning has become the most popular method for adapting a model to practical usage by significantly increasing accuracy on downstream tasks. Despite the great accuracy it achieves, we found fine-tuning is still far away from satisfactory trustworthiness due to "tuning-induced mis-calibration". In this paper, we delve deeply into why and how mis-calibration exists in fine-tuned models, and how distillation can alleviate the issue. Then we further propose a brand new method named Efficient Trustworthy Distillation (FIRST), which utilizes a small portion of teacher's knowledge to obtain a reliable language model in a cost-efficient way. Specifically, we identify the "concentrated knowledge" phenomenon during distillation, which can significantly reduce the computational burden. Then we apply a "trustworthy maximization" process to optimize the utilization of this small portion of concentrated knowledge before transferring it to the student. Experimental results demonstrate the effectiveness of our method, where better accuracy (+2.3%) and less mis-calibration (-10%) are achieved on average across both in-domain and out-of-domain scenarios, indicating better trustworthiness.

📄 PDF Abstract BibTeX arXiv:2408.12168

Code (1)

shumkashun/first 공식 구현 pytorch

Tasks

Language ModelingLanguage ModellingLarge Language Model

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Trust Region On-Policy Distillation

2026-05-31 · Xingrun Xing, Haoqing Wang, Boyan Gao, Ziheng Li 외 arxiv

On-Policy Distillation (OPD) is a fundamental technique for efficient post-training of large language models (LLMs), with broad applications in agent learning, multi-task enhancement, and model compression. However, OPD …

Mathematical ReasoningModel CompressionCode Generation

Distill Not Only Data but Also Rewards: Can Smaller Language Models Surpass Larger Ones?

2025-02-26 · Yudi Zhang, Lu Wang, Meng Fang, Yali Du 외

Distilling large language models (LLMs) typically involves transferring the teacher model's responses through supervised fine-tuning (SFT). However, this approach neglects the potential to distill both data (output conte…

GSM8KMMLUReinforcement Learning (RL)

Uni-OPD: Unifying On-Policy Distillation with a Dual-Perspective Recipe

2026-05-05 · Wenjin Hou, Shangpin Peng, Weinong Wang, Zheng Ruan 외 arxiv

On-policy distillation (OPD) has recently emerged as an effective post-training paradigm for consolidating the capabilities of specialized expert models into a single student model. Despite its empirical success, the con…

Gold-Guided Programmatic Distillation for Financial Reasoning over Hybrid Tables and Text

2026-07-16 · Yun Dong, Erica Zhao, Elana Chen arxiv

Financial question answering over hybrid tabular and textual data may require multi-source reasoning and precise numerical computation. While large language models (LLMs) can generate intermediate reasoning steps, natura…

Question AnsweringProgram Synthesis

Beyond Single-Sample: Reliable Multi-Sample Distillation for Video Understanding

2026-03-12 · Songlin Li, Xin Zhu, Zechao Guan, Peipeng Chen 외 arxiv

Traditional black-box distillation for Large Vision-Language Models (LVLMs) typically relies on a single teacher response per input, which often yields high-variance responses and format inconsistencies in multimodal or …