Heterogeneous Diversity Driven Active Learning for Multi-Object Tracking
The existing one-stage multi-object tracking (MOT) algorithms have achieved satisfactory performance benefiting from a large amount of labeled data. However, acquiring plenty of laborious annotated frames is not practical in real applications. To reduce the cost of human annotations, we propose Heterogeneous Diversity driven Active Multi-Object Tracking (HD-AMOT), to infer the most informative frames for any MOT tracker by observing the heterogeneous cues of samples. HD-AMOT defines the diversified informative representation by encoding the geometric and semantic information, and formulates the frame inference strategy as a Markov decision process to learn an optimal sampling policy based on the designed informative representation. Specifically, HD-AMOT consists of a diversified informative representation module as well as an informative frame selection network. The former produces the signal characterizing the diversity and distribution of frames, and the latter receives the signal and conducts multi-frame cooperation to enable batch frame sampling. Extensive experiments conducted on the MOT15, MOT17, MOT20, and Dancetrack datasets demonstrate the efficacy and effectiveness of HD-AMOT. Experiments show that under 50% budget our HD-AMOT can achieve similar or even higher performance as fully-supervised learning.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningDiversityMulti-Object TrackingObject TrackingSimilar Papers 제목 키워드 기반
IDEAL-M3D: Instance Diversity-Enriched Active Learning for Monocular 3D Detection
Monocular 3D detection relies on just a single camera and is therefore easy to deploy. Yet, achieving reliable 3D understanding from monocular images requires substantial annotation, and 3D labels are especially costly. …
Monocular 3D Object DetectionActive LearningMulti-Objective Evolutionary Design of Composite Data-Driven Models
In this paper, a multi-objective approach for the design of composite data-driven mathematical models is proposed. It allows automating the identification of graph-based heterogeneous pipelines that consist of different …
AutoMLBIG-bench Machine LearningDiversityCompressed Heterogeneous Graph for Abstractive Multi-Document Summarization
Multi-document summarization (MDS) aims to generate a summary for a number of related documents. We propose HGSUM, an MDS model that extends an encoder-decoder architecture, to incorporate a heterogeneous graph to repres…
DecoderDiversityDocument SummarizationGraph Similarity+1Unity in Diversity: Learning Distributed Heterogeneous Sentence Representation for Extractive Summarization
Automated multi-document extractive text summarization is a widely studied research problem in the field of natural language understanding. Such extractive mechanisms compute in some form the worthiness of a sentence to …
DiversityExtractive SummarizationExtractive Text SummarizationNatural Language Understanding+3Exploring Model Learning Heterogeneity for Boosting Ensemble Robustness
Deep neural network ensembles hold the potential of improving generalization performance for complex learning tasks. This paper presents formal analysis and empirical evaluation to show that heterogeneous deep ensembles …
Diversityobject-detectionObject DetectionSemantic Segmentation