DeepPBM: Deep Probabilistic Background Model Estimation from Video Sequences
This paper presents a novel unsupervised probabilistic model estimation of visual background in video sequences using a variational autoencoder framework. Due to the redundant nature of the backgrounds in surveillance videos, visual information of the background can be compressed into a low-dimensional subspace in the encoder part of the variational autoencoder, while the highly variant information of its moving foreground gets filtered throughout its encoding-decoding process. Our deep probabilistic background model (DeepPBM) estimation approach is enabled by the power of deep neural networks in learning compressed representations of video frames and reconstructing them back to the original domain. We evaluated the performance of our DeepPBM in background subtraction on 9 surveillance videos from the background model challenge (BMC2012) dataset, and compared that with a standard subspace learning technique, robust principle component analysis (RPCA), which similarly estimates a deterministic low dimensional representation of the background in videos and is widely used for this application. Our method outperforms RPCA on BMC2012 dataset with 23% in average in F-measure score, emphasizing that background subtraction using the trained model can be done in more than 10 times faster.
Code (1)
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
G-LBM:Generative Low-dimensional Background Model Estimation from Video Sequences
In this paper, we propose a computationally tractable and theoretically supported non-linear low-dimensional generative model to represent real-world data in the presence of noise and sparse outliers. The non-linear low-…
A Batch-Incremental Video Background Estimation Model using Weighted Low-Rank Approximation of Matrices
Principal component pursuit (PCP) is a state-of-the-art approach for background estimation problems. Due to their higher computational cost, PCP algorithms, such as robust principal component analysis (RPCA) and its vari…
Robust Statistical Approach for Extraction of Moving Human Silhouettes from Videos
Human pose estimation is one of the key problems in computer vision that has been studied in the recent years. The significance of human pose estimation is in the higher level tasks of understanding human actions applica…
Action ClassificationAction RecognitionPose EstimationTemporal Action LocalizationSpatio-Temporal Alignment of Non-Overlapping Sequences From Independently Panning Cameras
This paper addresses the problem of spatio-temporal alignment of multiple video sequences. We identify and tackle a novel scenario of this problem referred to as Nonoverlapping Sequences (NOS). NOS are captured by multip…
3D Vehicle Trajectory Reconstruction in Monocular Video Data Using Environment Structure Constraints
We present a framework to reconstruct three-dimensional vehicle trajectories using monocular video data. We track two-dimensional vehicle shapes on pixel level exploiting instance-aware semantic segmentation techniques a…
Optical Flow EstimationSemantic Segmentation