Information Condensing Active Learning
We introduce Information Condensing Active Learning (ICAL), a batch mode model agnostic Active Learning (AL) method targeted at Deep Bayesian Active Learning that focuses on acquiring labels for points which have as much information as possible about the still unacquired points. ICAL uses the Hilbert Schmidt Independence Criterion (HSIC) to measure the strength of the dependency between a candidate batch of points and the unlabeled set. We develop key optimizations that allow us to scale our method to large unlabeled sets. We show significant improvements in terms of model accuracy and negative log likelihood (NLL) on several image datasets compared to state of the art batch mode AL methods for deep learning.
Code (1)
Tasks
Active LearningSimilar Papers 제목 키워드 기반
FocusLLM: Precise Understanding of Long Context by Dynamic Condensing
Empowering LLMs with the ability to precisely understand long contexts is crucial for many downstream applications. However, handling long contexts with conventional transformer architecture requires substantial training…
8kDecoderLanguage ModelingLanguage ModellingWeighted Distance Nearest Neighbor Condensing
The problem of nearest neighbor condensing has enjoyed a long history of study, both in its theoretical and practical aspects. In this paper, we introduce the problem of weighted distance nearest neighbor condensing, whe…
Generalization BoundsExtractive Summarization of Call Transcripts
Text summarization is the process of extracting the most important information from the text and presenting it concisely in fewer sentences. Call transcript is a text that involves textual description of a phone conversa…
Extractive SummarizationPunctuation RestorationSentenceText SummarizationInformative and Controllable Opinion Summarization
Opinion summarization is the task of automatically generating summaries for a set of reviews about a specific target (e.g., a movie or a product). Since the number of reviews for each target can be prohibitively large, n…
Opinion SummarizationAudio Summarization with Audio Features and Probability Distribution Divergence
The automatic summarization of multimedia sources is an important task that facilitates the understanding of an individual by condensing the source while maintaining relevant information. In this paper we focus on audio …
Extractive SummarizationInformativenessPosition