F3Net: Fusion, Feedback and Focus for Salient Object Detection
Most of existing salient object detection models have achieved great progress by aggregating multi-level features extracted from convolutional neural networks. However, because of the different receptive fields of different convolutional layers, there exists big differences between features generated by these layers. Common feature fusion strategies (addition or concatenation) ignore these differences and may cause suboptimal solutions. In this paper, we propose the F3Net to solve above problem, which mainly consists of cross feature module (CFM) and cascaded feedback decoder (CFD) trained by minimizing a new pixel position aware loss (PPA). Specifically, CFM aims to selectively aggregate multi-level features. Different from addition and concatenation, CFM adaptively selects complementary components from input features before fusion, which can effectively avoid introducing too much redundant information that may destroy the original features. Besides, CFD adopts a multi-stage feedback mechanism, where features closed to supervision will be introduced to the output of previous layers to supplement them and eliminate the differences between features. These refined features will go through multiple similar iterations before generating the final saliency maps. Furthermore, different from binary cross entropy, the proposed PPA loss doesn't treat pixels equally, which can synthesize the local structure information of a pixel to guide the network to focus more on local details. Hard pixels from boundaries or error-prone parts will be given more attention to emphasize their importance. F3Net is able to segment salient object regions accurately and provide clear local details. Comprehensive experiments on five benchmark datasets demonstrate that F3Net outperforms state-of-the-art approaches on six evaluation metrics.
Code (4)
Tasks
Camouflaged Object SegmentationDichotomous Image SegmentationObjectobject-detectionObject DetectionRGB Salient Object DetectionSalient Object DetectionSimilar Papers 제목 키워드 기반
IRDFusion: Iterative Relation-Map Difference guided Feature Fusion for Multispectral Object Detection
Current multispectral object detection methods often retain extraneous background or noise during feature fusion, limiting perceptual performance. To address this, we propose an innovative feature fusion framework based …
Multispectral Object DetectionEGNet:Edge Guidance Network for Salient Object Detection
Fully convolutional neural networks (FCNs) have shown their advantages in the salient object detection task. However, most existing FCNs-based methods still suffer from coarse object boundaries. In this paper, to solve t…
Objectobject-detectionObject DetectionRGB Salient Object Detection+1EGNet: Edge Guidance Network for Salient Object Detection
Fully convolutional neural networks (FCNs) have shown their advantages in the salient object detection task. However, most existing FCNs-based methods still suffer from coarse object boundaries. In this paper, to solve t…
Camouflaged Object SegmentationCo-Salient Object DetectionObjectobject-detection+3KD-SCFNet: Towards More Accurate and Efficient Salient Object Detection via Knowledge Distillation
Most existing salient object detection (SOD) models are difficult to apply due to the complex and huge model structures. Although some lightweight models are proposed, the accuracy is barely satisfactory. In this paper, …
Knowledge Distillationobject-detectionObject DetectionSalient Object DetectionSalFAU-Net: Saliency Fusion Attention U-Net for Salient Object Detection
Salient object detection (SOD) remains an important task in computer vision, with applications ranging from image segmentation to autonomous driving. Fully convolutional network (FCN)-based methods have made remarkable p…
Autonomous DrivingDecoderImage Segmentationobject-detection+4