Weakly Supervised Video Salient Object Detection
Significant performance improvement has been achieved for fully-supervised video salient object detection with the pixel-wise labeled training datasets, which are time-consuming and expensive to obtain. To relieve the burden of data annotation, we present the first weakly supervised video salient object detection model based on relabeled "fixation guided scribble annotations". Specifically, an "Appearance-motion fusion module" and bidirectional ConvLSTM based framework are proposed to achieve effective multi-modal learning and long-term temporal context modeling based on our new weak annotations. Further, we design a novel foreground-background similarity loss to further explore the labeling similarity across frames. A weak annotation boosting strategy is also introduced to boost our model performance with a new pseudo-label generation technique. Extensive experimental results on six benchmark video saliency detection datasets illustrate the effectiveness of our solution.
Code (1)
Tasks
Objectobject-detectionObject DetectionPseudo LabelSaliency DetectionSalient Object DetectionVideo Saliency DetectionVideo Salient Object DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Encoding Based Saliency Detection for Videos and Images
We present a novel video saliency detection method to support human activity recognition and weakly supervised training of activity detection algorithms. Recent research has emphasized the need for analyzing salient inf…
Action DetectionActivity DetectionActivity RecognitionHuman Activity Recognition+6Learning Video Salient Object Detection Progressively from Unlabeled Videos
Recent deep learning-based video salient object detection (VSOD) has achieved some breakthrough, but these methods rely on expensive annotated videos with pixel-wise annotations, weak annotations, or part of the pixel-wi…
Objectobject-detectionObject DetectionOptical Flow Estimation+2Weakly Supervised Learning for Salient Object Detection
Recent advances in supervised salient object detection has resulted in significant performance on benchmark datasets. Training such models, however, requires expensive pixel-wise annotations of salient objects. Moreover,…
Objectobject-detectionObject DetectionRGB Salient Object Detection+3Weakly Supervised Video Salient Object Detection via Point Supervision
Video salient object detection models trained on pixel-wise dense annotation have achieved excellent performance, yet obtaining pixel-by-pixel annotated datasets is laborious. Several works attempt to use scribble annota…
Objectobject-detectionObject DetectionOptical Flow Estimation+2Weakly-Supervised Salient Object Detection Using Point Supervision
Current state-of-the-art saliency detection models rely heavily on large datasets of accurate pixel-wise annotations, but manually labeling pixels is time-consuming and labor-intensive. There are some weakly supervised m…
Objectobject-detectionObject DetectionSaliency Detection+1