paper-with-me

Papers

Deep Supervised Summarization: Algorithm and Application to Learning Instructions

2019-12-01 · NeurIPS 2019 12 · Chengguang Xu, Ehsan Elhamifar

We address the problem of finding representative points of datasets by learning from multiple datasets and their ground-truth summaries. We develop a supervised subset selection framework, based on the facility location utility function, which learns to map datasets to their ground-truth representatives. To do so, we propose to learn representations of data so that the input of transformed data to the facility location recovers their ground-truth representatives. Given the NP-hardness of the utility function, we consider its convex relaxation based on sparse representation and investigate conditions under which the solution of the convex optimization recovers ground-truth representatives of each dataset. We design a loss function whose minimization over the parameters of the data representation network leads to satisfying the theoretical conditions, hence guaranteeing recovering ground-truth summaries. Given the non-convexity of the loss function, we develop an efficient learning scheme that alternates between representation learning by minimizing our proposed loss given the current assignments of points to ground-truth representatives and updating assignments given the current data representation. By experiments on the problem of learning key-steps (subactivities) of instructional videos, we show that our proposed framework improves the state-of-the-art supervised subset selection algorithms.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

Zero-shot Conversational Summarization Evaluations with small Large Language Models

2023-11-29 · Ramesh Manuvinakurike, Saurav Sahay, Sangeeta Manepalli, Lama Nachman

Large Language Models (LLMs) exhibit powerful summarization abilities. However, their capabilities on conversational summarization remains under explored. In this work we evaluate LLMs (approx. 10 billion parameters) on …

PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization

2019-12-18 · ICML 2020 1 · Jingqing Zhang, Yao Zhao, Mohammad Saleh, Peter J. Liu

Recent work pre-training Transformers with self-supervised objectives on large text corpora has shown great success when fine-tuned on downstream NLP tasks including text summarization. However, pre-training objectives t…

Abstractive Text SummarizationDecoderText Summarization

Privacy-Preserving Instructions for Aligning Large Language Models

2024-02-21 · Da Yu, Peter Kairouz, Sewoong Oh, Zheng Xu

Service providers of large language model (LLM) applications collect user instructions in the wild and use them in further aligning LLMs with users' intentions. These instructions, which potentially contain sensitive inf…

Language ModelingLanguage ModellingLarge Language ModelPrivacy Preserving

Incorporating Domain Knowledge for Extractive Summarization of Legal Case Documents

2021-06-30 · Paheli Bhattacharya, Soham Poddar, Koustav Rudra, Kripabandhu Ghosh 외

Automatic summarization of legal case documents is an important and practical challenge. Apart from many domain-independent text summarization algorithms that can be used for this purpose, several algorithms have been de…

Extractive SummarizationText Summarization

Automatic Summarization of Natural Language

2018-12-18 · Marc Everett Johnson

Automatic summarization of natural language is a current topic in computer science research and industry, studied for decades because of its usefulness across multiple domains. For example, summarization is necessary to …

Abstractive Text SummarizationExtractive Summarization