paper-with-me

Papers

Influence Selection for Active Learning

2021-08-20 · ICCV 2021 10 · Zhuoming Liu, Hao Ding, Huaping Zhong, Weijia Li, Jifeng Dai, Conghui He

The existing active learning methods select the samples by evaluating the sample's uncertainty or its effect on the diversity of labeled datasets based on different task-specific or model-specific criteria. In this paper, we propose the Influence Selection for Active Learning(ISAL) which selects the unlabeled samples that can provide the most positive Influence on model performance. To obtain the Influence of the unlabeled sample in the active learning scenario, we design the Untrained Unlabeled sample Influence Calculation(UUIC) to estimate the unlabeled sample's expected gradient with which we calculate its Influence. To prove the effectiveness of UUIC, we provide both theoretical and experimental analyses. Since the UUIC just depends on the model gradients, which can be obtained easily from any neural network, our active learning algorithm is task-agnostic and model-agnostic. ISAL achieves state-of-the-art performance in different active learning settings for different tasks with different datasets. Compared with previous methods, our method decreases the annotation cost at least by 12%, 13% and 16% on CIFAR10, VOC2012 and COCO, respectively.

📄 PDF Abstract BibTeX arXiv:2108.09331

Code (1)

dragonlzm/ISAL 공식 구현 pytorch

Tasks

Active LearningDiversity

Similar Papers 제목 키워드 기반

Grain: Improving Data Efficiency of Graph Neural Networks via Diversified Influence Maximization

2021-07-31 · Wentao Zhang, Zhi Yang, Yexin Wang, Yu Shen 외

Data selection methods, such as active learning and core-set selection, are useful tools for improving the data efficiency of deep learning models on large-scale datasets. However, recent deep learning models have moved …

Active LearningKnowledge Graphs

ActiveDPO: Active Direct Preference Optimization for Sample-Efficient Alignment

2025-05-25 · Xiaoqiang Lin, Arun Verma, Zhongxiang Dai, Daniela Rus 외

The recent success of using human preferences to align large language models (LLMs) has significantly improved their performance in various downstream tasks like question answering, mathematical reasoning, and code gener…

Code GenerationMathematical ReasoningQuestion Answering

RIM: Reliable Influence-based Active Learning on Graphs

2021-10-28 · NeurIPS 2021 12 · Wentao Zhang, Yexin Wang, Zhenbang You, Meng Cao 외

Message passing is the core of most graph models such as Graph Convolutional Network (GCN) and Label Propagation (LP), which usually require a large number of clean labeled data to smooth out the neighborhood over the gr…

Active Learning

Multi-Label Active Learning from Crowds

2015-08-04 · Shao-Yuan Li, Yuan Jiang, Zhi-Hua Zhou

Multi-label active learning is a hot topic in reducing the label cost by optimally choosing the most valuable instance to query its label from an oracle. In this paper, we consider the poolbased multi-label active learni…

Active LearningDiversity

Influence Diagnostics in High-dimensional M-estimation: Precise Asymptotics

2026-07-10 · Hugo Cui arxiv

The impact of a given training point on a statistical model is classically measured through its leave-one-out influence, which quantifies the effect of its removal from the training set on the model accuracy. While the s…

Active Learning