Detecting Temporally Consistent Objects in Videos through Object Class Label Propagation
Object proposals for detecting moving or static video objects need to address issues such as speed, memory complexity and temporal consistency. We propose an efficient Video Object Proposal (VOP) generation method and show its efficacy in learning a better video object detector. A deep-learning based video object detector learned using the proposed VOP achieves state-of-the-art detection performance on the Youtube-Objects dataset. We further propose a clustering of VOPs which can efficiently be used for detecting objects in video in a streaming fashion. As opposed to applying per-frame convolutional neural network (CNN) based object detection, our proposed method called Objects in Video Enabler thRough LAbel Propagation (OVERLAP) needs to classify only a small fraction of all candidate proposals in every video frame through streaming clustering of object proposals and class-label propagation. Source code will be made available soon.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringObjectobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
Videoshop: Localized Semantic Video Editing with Noise-Extrapolated Diffusion Inversion
We introduce Videoshop, a training-free video editing algorithm for localized semantic edits. Videoshop allows users to use any editing software, including Photoshop and generative inpainting, to modify the first frame; …
Video EditingA Detection Method of Temporally Operated Videos Using Robust Hashing
SNS providers are known to carry out the recompression and resizing of uploaded videos/images, but most conventional methods for detecting tampered videos/images are not robust enough against such operations. In addition…
Temporally Consistent Motion Segmentation from RGB-D Video
We present a method for temporally consistent motion segmentation from RGB-D videos assuming a piecewise rigid motion model. We formulate global energies over entire RGB-D sequences in terms of the segmentation of each f…
Motion SegmentationObjectSegmentationGenMM: Geometrically and Temporally Consistent Multimodal Data Generation for Video and LiDAR
Multimodal synthetic data generation is crucial in domains such as autonomous driving, robotics, augmented/virtual reality, and retail. We propose a novel approach, GenMM, for jointly editing RGB videos and LiDAR scans b…
Autonomous DrivingDepth EstimationMonocular Depth EstimationSemantic Segmentation+2Temporal Unknown Incremental Clustering (TUIC) Model for Analysis of Traffic Surveillance Videos
Optimized scene representation is an important characteristic of a framework for detecting abnormalities on live videos. One of the challenges for detecting abnormalities in live videos is real-time detection of objects …
ClusteringOptical Flow Estimation