paper-with-me

Papers

Aligning Data Selection with Performance: Performance-driven Reinforcement Learning for Active Learning in Object Detection

2023-10-12 · Zhixuan Liang, Xingyu Zeng, Rui Zhao, Ping Luo

Active learning strategies aim to train high-performance models with minimal labeled data by selecting the most informative instances for labeling. However, existing methods for assessing data informativeness often fail to align directly with task model performance metrics, such as mean average precision (mAP) in object detection. This paper introduces Mean-AP Guided Reinforced Active Learning for Object Detection (MGRAL), a novel approach that leverages the concept of expected model output changes as informativeness for deep detection networks, directly optimizing the sampling strategy using mAP. MGRAL employs a reinforcement learning agent based on LSTM architecture to efficiently navigate the combinatorial challenge of batch sample selection and the non-differentiable nature between performance and selected batches. The agent optimizes selection using policy gradient with mAP improvement as the reward signal. To address the computational intensity of mAP estimation with unlabeled samples, we implement fast look-up tables, ensuring real-world feasibility. We evaluate MGRAL on PASCAL VOC and MS COCO benchmarks across various backbone architectures. Our approach demonstrates strong performance, establishing a new paradigm in reinforcement learning-based active learning for object detection.

📄 PDF Abstract BibTeX arXiv:2310.08387

Code (0)

등록된 구현이 없습니다.

Tasks

Active LearningActive Object DetectionInformativenessNavigateObjectobject-detectionObject Detectionreinforcement-learningReinforcement Learning

Methods 이 논문이 사용한 방법론

Tanh Activation 설명 없음
Sigmoid Activation 설명 없음
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

Language Models Improve When Pretraining Data Matches Target Tasks

2025-07-16 · David Mizrahi, Anders Boesen Lindbo Larsen, Jesse Allardice, Suzie Petryk 외 arxiv

Every data selection method inherently has a target. In practice, these targets often emerge implicitly through benchmark-driven iteration: researchers develop selection strategies, train models, measure benchmark perfor…

LKV: End-to-End Learning of Head-wise Budgets and Token Selection for LLM KV Cache Eviction

2026-04-22 · Enshuai Zhou, Yifan Hao, Chao Wang, Rui Zhang 외 arxiv

Long-context inference in Large Language Models (LLMs) is bottlenecked by the linear growth of Key-Value (KV) cache memory. Existing KV cache compression paradigms are fundamentally limited by heuristics: heuristic budge…

Investigating the Impact of Data Selection Strategies on Language Model Performance

2025-01-07 · Jiayao Gu, Liting Chen, Yihong Li

Data selection is critical for enhancing the performance of language models, particularly when aligning training datasets with a desired target distribution. This study explores the effects of different data selection me…

Language ModelingLanguage Modelling

Extracting Search Trees from LLM Reasoning Traces Reveals Myopic Planning

2026-05-07 · Sixing Chen, Ji-An Li, Saner Cakir, Sinan Akcali 외 arxiv

Large language models (LLMs), especially reasoning models, generate extended chain-of-thought (CoT) reasoning that often contains explicit deliberation over future outcomes. Yet whether this deliberation constitutes genu…

DiffusionGPT: LLM-Driven Text-to-Image Generation System

2024-01-18 · Jie Qin, Jie Wu, Weifeng Chen, Yuxi Ren 외

Diffusion models have opened up new avenues for the field of image generation, resulting in the proliferation of high-quality models shared on open-source platforms. However, a major challenge persists in current text-to…

Image GenerationModel SelectionText to Image GenerationText-to-Image Generation