Collaborative Deep Reinforcement Learning for Multi-Object Tracking
In this paper, we propose a collaborative deep reinforcement learning (C-DRL) method for multi-object tracking. Most existing multi-object tracking methods employ the tracking-by-detection strategy which first detects objects in each frame and then associates them across different frames. However, the performance of these methods rely heavily on the detection results, which are usually unsatisfied in many real applications, especially in crowded scenes. To address this, we develop a deep prediction-decision network in our C-DRL, which simultaneously detects and predicts objects under a unified network via deep reinforcement learning. Specifically, we consider each object as an agent and track it via the prediction network, and seek the optimal tracked results by exploiting the collaborative interactions of different agents and environments via the decision network, so that the influences of occlusions and noisy detection results can be well alleviated. Experimental results on the challenging MOT15 and MOT16 benchmarks are presented to show the efficiency of our approach.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Reinforcement LearningMulti-Object TrackingObjectObject Trackingreinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
CSAOT: Cooperative Multi-Agent System for Active Object Tracking
Object Tracking is essential for many computer vision applications, such as autonomous navigation, surveillance, and robotics. Unlike Passive Object Tracking (POT), which relies on static camera viewpoints to detect and …
Autonomous NavigationDeep Reinforcement LearningMixture-of-ExpertsObject+1CDTS: Collaborative Detection, Tracking, and Segmentation for Online Multiple Object Segmentation in Videos
A novel online algorithm to segment multiple objects in a video sequence is proposed in this work. We develop the collaborative detection, tracking, and segmentation (CDTS) technique to extract multiple segment tracks ac…
ObjectSegmentationSemantic SegmentationVideo Object Recognition in Mobile Edge Networks: Local Tracking or Edge Detection?
Fast and accurate video object recognition, which relies on frame-by-frame video analytics, remains a challenge for resource-constrained devices such as traffic cameras. Recent advances in mobile edge computing have made…
Reinforcement LearningObject RecognitionFederated LearningObject DetectionCML-MOTS: Collaborative Multi-task Learning for Multi-Object Tracking and Segmentation
The advancement of computer vision has pushed visual analysis tasks from still images to the video domain. In recent years, video instance segmentation, which aims to track and segment multiple objects in video frames, h…
Autonomous DrivingInstance SegmentationMulti-Object TrackingMulti-Object Tracking and Segmentation+7Local Subspace Collaborative Tracking
Subspace models have been widely used for appearance based object tracking. Most existing subspace based trackers employ a linear subspace to represent object appearances, which are not accurate enough to model large var…
ObjectObject TrackingVisual Tracking