A Fixation-based 360° Benchmark Dataset for Salient Object Detection
Fixation prediction (FP) in panoramic contents has been widely investigated along with the booming trend of virtual reality (VR) applications. However, another issue within the field of visual saliency, salient object detection (SOD), has been seldom explored in 360{\deg} (or omnidirectional) images due to the lack of datasets representative of real scenes with pixel-level annotations. Toward this end, we collect 107 equirectangular panoramas with challenging scenes and multiple object classes. Based on the consistency between FP and explicit saliency judgements, we further manually annotate 1,165 salient objects over the collected images with precise masks under the guidance of real human eye fixation maps. Six state-of-the-art SOD models are then benchmarked on the proposed fixation-based 360{\deg} image dataset (F-360iSOD), by applying a multiple cubic projection-based fine-tuning method. Experimental results show a limitation of the current methods when used for SOD in panoramic images, which indicates the proposed dataset is challenging. Key issues for 360{\deg} SOD is also discussed. The proposed dataset is available at https://github.com/PanoAsh/F-360iSOD.
Code (2)
Tasks
object-detectionObject DetectionRGB Salient Object DetectionSalient Object DetectionSimilar Papers 제목 키워드 기반
The Secrets of Salient Object Segmentation
In this paper we provide an extensive evaluation of fixation prediction and salient object segmentation algorithms as well as statistics of major datasets. Our analysis identifies serious design flaws of existing salient…
ObjectSegmentationSemantic SegmentationWhat is a salient object? A dataset and a baseline model for salient object detection
Salient object detection or salient region detection models, diverging from fixation prediction models, have traditionally been dealing with locating and segmenting the most salient object or region in a scene. While the…
Objectobject-detectionObject DetectionRGB Salient Object Detection+3Salient Object Detection Driven by Fixation Prediction
Research in visual saliency has been focused on two major types of models namely fixation prediction and salient object detection. The relationship between the two, however, has been less explored. In this paper, we prop…
Objectobject-detectionObject DetectionPrediction+3Salient Structure Detection by Context-Guided Visual Search
We define the task of salient structure (SS) detection to unify the saliency-related tasks like fixation prediction, salient object detection, and other detection of structures of interest. In this study, we propose a un…
Bayesian InferenceObjectobject-detectionObject Detection+3ASOD60K: An Audio-Induced Salient Object Detection Dataset for Panoramic Videos
Exploring to what humans pay attention in dynamic panoramic scenes is useful for many fundamental applications, including augmented reality (AR) in retail, AR-powered recruitment, and visual language navigation. With thi…
4kObjectobject-detectionObject Detection+2