Online Video Object Detection Using Association LSTM
Video object detection is a fundamental tool for many applications. Since direct application of image-based object detection cannot leverage the rich temporal information inherent in video data, we advocate to the detection of long-range video object pattern. While the Long Short-Term Memory (LSTM) has been the de facto choice for such detection, currently LSTM cannot fundamentally model object association between consecutive frames. In this paper, we propose the association LSTM to address this fundamental association problem. Association LSTM not only regresses and classifiy directly on object locations and categories but also associates features to represent each output object. By minimizing the matching error between these features, we learn how to associate objects in two consecutive frames. Additionally, our method works in an online manner, which is important for most video tasks. Compared to the traditional video object detection methods, our approach outperforms them on standard video datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Objectobject-detectionObject DetectionVideo Object DetectionSimilar Papers 제목 키워드 기반
Temporally Identity-Aware SSD with Attentional LSTM
Temporal object detection has attracted significant attention, but most popular detection methods cannot leverage rich temporal information in videos. Very recently, many algorithms have been developed for video detectio…
object-detectionObject DetectionLearning to Track: Online Multi-Object Tracking by Decision Making
Online Multi-Object Tracking (MOT) has wide applications in time-critical video analysis scenarios, such as robot navigation and autonomous driving. In tracking-by-detection, a major challenge of online MOT is how to rob…
Autonomous DrivingDecision MakingMulti-Object TrackingMultiple Object Tracking+5Mobile Video Object Detection with Temporally-Aware Feature Maps
This paper introduces an online model for object detection in videos designed to run in real-time on low-powered mobile and embedded devices. Our approach combines fast single-image object detection with convolutional lo…
CPUObjectobject-detectionObject Detection+1Tracking Objects with 3D Representation from Videos
Data association is a knotty problem for 2D Multiple Object Tracking due to the object occlusion. However, in 3D space, data association is not so hard. Only with a 3D Kalman Filter, the online object tracker can associa…
Multiple Object TrackingObjectObject TrackingRepresentation LearningOnline multi-object tracking via robust collaborative model and sample selection
The past decade has witnessed significant progress in object detection and tracking in videos. In this paper, we present a collaborative model between a pre-trained object detector and a number of single-object online tr…
Multi-Object TrackingObjectobject-detectionObject Detection+2