paper-with-me

Papers

Distilling Script Knowledge from Large Language Models for Constrained Language Planning

2023-05-09 · Siyu Yuan, Jiangjie Chen, Ziquan Fu, Xuyang Ge, Soham Shah, Charles Robert Jankowski, Yanghua Xiao, Deqing Yang

In everyday life, humans often plan their actions by following step-by-step instructions in the form of goal-oriented scripts. Previous work has exploited language models (LMs) to plan for abstract goals of stereotypical activities (e.g., "make a cake"), but leaves more specific goals with multi-facet constraints understudied (e.g., "make a cake for diabetics"). In this paper, we define the task of constrained language planning for the first time. We propose an overgenerate-then-filter approach to improve large language models (LLMs) on this task, and use it to distill a novel constrained language planning dataset, CoScript, which consists of 55,000 scripts. Empirical results demonstrate that our method significantly improves the constrained language planning ability of LLMs, especially on constraint faithfulness. Furthermore, CoScript is demonstrated to be quite effective in endowing smaller LMs with constrained language planning ability.

📄 PDF Abstract BibTeX arXiv:2305.05252

Code (1)

siyuyuan/coscript 공식 구현

Tasks

Knowledge Distillation

Similar Papers 제목 키워드 기반

Mind's Mirror: Distilling Self-Evaluation Capability and Comprehensive Thinking from Large Language Models

2023-11-15 · Weize Liu, Guocong Li, Kai Zhang, Bang Du 외

Large language models (LLMs) have achieved remarkable advancements in natural language processing. However, the massive scale and computational demands of these models present formidable challenges when considering their…

Transfer Learning

Co-training and Co-distillation for Quality Improvement and Compression of Language Models

2023-11-06 · Hayeon Lee, Rui Hou, Jongpil Kim, Davis Liang 외

Knowledge Distillation (KD) compresses computationally expensive pre-trained language models (PLMs) by transferring their knowledge to smaller models, allowing their use in resource-constrained or real-time settings. How…

Data AugmentationKnowledge Distillation

Leveraging Foundation Models for Efficient Federated Learning in Resource-restricted Edge Networks

2024-09-14 · Submitted to ICASSP2025 2024 9 · S. Kawa Atapour, S. Jamal Seyedmohammadi, S. Mohammad Sheikholeslami, Jamshid Abouei 외

Recently pre-trained Foundation Models (FMs) have been combined with Federated Learning (FL) to improve training of downstream tasks while preserving privacy. However, deploying FMs over edge networks with resource-const…

Data-free Knowledge DistillationFederated Learningimage-classificationImage Classification+1

Distilling 3D Spatial Reasoning into a Lightweight Vision-Language Model with CoT

2026-05-10 · Alaa Asfour, Christopher Indris, Leihan Chen, Tejas Vyas 외 arxiv

Large-scale 3D vision-language models (VLMs) like LLaVA-3D offer strong spatial reasoning but are difficult to deploy due to high computational costs. We propose a knowledge distillation framework that transfers spatial …

Knowledge DistillationSpatial ReasoningAnswer GenerationDepth Estimation

LLMs Meet VLMs: Boost Open Vocabulary Object Detection with Fine-grained Descriptors

2024-02-07 · Sheng Jin, Xueying Jiang, Jiaxing Huang, Lewei Lu 외

Inspired by the outstanding zero-shot capability of vision language models (VLMs) in image classification tasks, open-vocabulary object detection has attracted increasing interest by distilling the broad VLM knowledge in…

image-classificationImage Classificationobject-detectionObject Detection+2