Automatic Foreground Extraction from Imperfect Backgrounds using Multi-Agent Consensus Equilibrium
Extracting accurate foreground objects from a scene is an essential step for many video applications. Traditional background subtraction algorithms can generate coarse estimates, but generating high quality masks requires professional softwares with significant human interventions, e.g., providing trimaps or labeling key frames. We propose an automatic foreground extraction method in applications where a static but imperfect background is available. Examples include filming and surveillance where the background can be captured before the objects enter the scene or after they leave the scene. Our proposed method is very robust and produces significantly better estimates than state-of-the-art background subtraction, video segmentation and alpha matting methods. The key innovation of our method is a novel information fusion technique. The fusion framework allows us to integrate the individual strengths of alpha matting, background subtraction and image denoising to produce an overall better estimate. Such integration is particularly important when handling complex scenes with imperfect background. We show how the framework is developed, and how the individual components are built. Extensive experiments and ablation studies are conducted to evaluate the proposed method.
Code (0)
등록된 구현이 없습니다.
Tasks
DenoisingImage DenoisingImage MattingSemantic SegmentationVideo SegmentationVideo Semantic SegmentationSimilar Papers 제목 키워드 기반
A Robust Local Binary Similarity Pattern for Foreground Object Detection
Accurate and fast extraction of the foreground object is one of the most significant issues to be solved due to its important meaning for object tracking and recognition in video surveillance. Although many foreground ob…
Objectobject-detectionObject DetectionObject TrackingAutomated Background Swapping for Robustness against Spurious Backgrounds
Classifiers based on Deep Neural Networks exhibit strong performance across domains, yet can fail catastrophically if they rely on spurious correlations, i.e., features that are predictive of the target label in the trai…
Image ClassificationA lightweight multi-scale context network for salient object detection in optical remote sensing images
Due to the more dramatic multi-scale variations and more complicated foregrounds and backgrounds in optical remote sensing images (RSIs), the salient object detection (SOD) for optical RSIs becomes a huge challenge. Howe…
object-detectionObject DetectionSalient Object DetectionBackMix: Regularizing Open Set Recognition by Removing Underlying Fore-Background Priors
Open set recognition (OSR) requires models to classify known samples while detecting unknown samples for real-world applications. Existing studies show impressive progress using unknown samples from auxiliary datasets to…
Open Set LearningCombining Background Subtraction Algorithms with Convolutional Neural Network
Accurate and fast extraction of foreground object is a key prerequisite for a wide range of computer vision applications such as object tracking and recognition. Thus, enormous background subtraction methods for foregrou…
DecoderObjectobject-detectionObject Detection+1