Encoding Based Saliency Detection for Videos and Images
We present a novel video saliency detection method to support human activity recognition and weakly supervised training of activity detection algorithms. Recent research has emphasized the need for analyzing salient information in videos to minimize dataset bias or to supervise weakly labeled training of activity detectors. In contrast to previous methods we do not rely on training information given by either eye-gaze or annotation data, but propose a fully unsupervised algorithm to find salient regions within videos. In general, we enforce the Gestalt principle of figure-ground segregation for both appearance and motion cues. We introduce an encoding approach that allows for efficient computation of saliency by approximating joint feature distributions. We evaluate our approach on several datasets, including challenging scenarios with cluttered background and camera motion, as well as salient object detection in images. Overall, we demonstrate favorable performance compared to state-of-the-art methods in estimating both ground-truth eye-gaze and activity annotations.
Code (0)
등록된 구현이 없습니다.
Tasks
Action DetectionActivity DetectionActivity RecognitionHuman Activity Recognitionobject-detectionObject DetectionRGB Salient Object DetectionSaliency DetectionSalient Object DetectionVideo Saliency DetectionSimilar Papers 제목 키워드 기반
Sphere-GAN: a GAN-based Approach for Saliency Estimation in 360° Videos
The recent success of immersive applications is pushing the research community to define new approaches to process 360° images and videos and optimize their transmission. Among these, saliency estimation provides a power…
Saliency DetectionFast and Accurate Light Field Saliency Detection through Deep Encoding
Light field saliency detection -- important due to utility in many vision tasks -- still lacks speed and can improve in accuracy. Due to the formulation of the saliency detection problem in light fields as a segmentation…
CPUSaliency DetectionFlow Guided Recurrent Neural Encoder for Video Salient Object Detection
Image saliency detection has recently witnessed significant progress due to deep convolutional neural networks. However, extending state-of-the-art saliency detectors from image to video is challenging. The performance o…
Objectobject-detectionObject DetectionOptical Flow Estimation+4Saliency Detection in 360° Videos
This paper presents a novel spherical convolutional neural network based scheme for saliency detection for 360° videos. Specifically, in our spherical convolution neural network definition, kernel is defined on a spheri…
Saliency DetectionVideo Saliency DetectionA Benchmark Dataset and Saliency-guided Stacked Autoencoders for Video-based Salient Object Detection
Image-based salient object detection (SOD) has been extensively studied in the past decades. However, video-based SOD is much less explored since there lack large-scale video datasets within which salient objects are una…
BenchmarkingObjectobject-detectionObject Detection+2