Flow Guided Recurrent Neural Encoder for Video Salient Object Detection
Image saliency detection has recently witnessed significant progress due to deep convolutional neural networks. However, extending state-of-the-art saliency detectors from image to video is challenging. The performance of salient object detection suffers from object or camera motion and the dramatic change of the appearance contrast in videos. In this paper, we present flow guided recurrent neural encoder(FGRNE), an accurate and end-to-end learning framework for video salient object detection. It works by enhancing the temporal coherence of the per-frame feature by exploiting both motion information in terms of optical flow and sequential feature evolution encoding in terms of LSTM networks. It can be considered as a universal framework to extend any FCN based static saliency detector to video salient object detection. Intensive experimental results verify the effectiveness of each part of FGRNE and confirm that our proposed method significantly outperforms state-of-the-art methods on the public benchmarks of DAVIS and FBMS.
Code (0)
등록된 구현이 없습니다.
Tasks
Objectobject-detectionObject DetectionOptical Flow EstimationRGB Salient Object DetectionSaliency DetectionSalient Object DetectionVideo Salient Object DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Motion Guided Attention for Video Salient Object Detection
Video salient object detection aims at discovering the most visually distinctive objects in a video. How to effectively take object motion into consideration during video salient object detection is a critical issue. Exi…
Objectobject-detectionObject DetectionOptical Flow Estimation+4Saliency-guided video classification via adaptively weighted learning
Video classification is productive in many practical applications, and the recent deep learning has greatly improved its accuracy. However, existing works often model video frames indiscriminately, but from the view of m…
ClassificationGeneral ClassificationOptical Flow EstimationVideo ClassificationTransFlow: Motion Knowledge Transfer from Video Diffusion Models to Video Salient Object Detection
Video salient object detection (SOD) relies on motion cues to distinguish salient objects from backgrounds, but training such models is limited by scarce video datasets compared to abundant image datasets. Existing appro…
Video Salient Object DetectionORSIFlow: Saliency-Guided Rectified Flow for Optical Remote Sensing Salient Object Detection
Optical Remote Sensing Image Salient Object Detection (ORSI-SOD) remains challenging due to complex backgrounds, low contrast, irregular object shapes, and large variations in object scale. Existing discriminative method…
Salient Object DetectionA Benchmark Dataset and Saliency-guided Stacked Autoencoders for Video-based Salient Object Detection
Image-based salient object detection (SOD) has been extensively studied in the past decades. However, video-based SOD is much less explored since there lack large-scale video datasets within which salient objects are una…
BenchmarkingObjectobject-detectionObject Detection+2