CoADNet: Collaborative Aggregation-and-Distribution Networks for Co-Salient Object Detection
Co-Salient Object Detection (CoSOD) aims at discovering salient objects that repeatedly appear in a given query group containing two or more relevant images. One challenging issue is how to effectively capture co-saliency cues by modeling and exploiting inter-image relationships. In this paper, we present an end-to-end collaborative aggregation-and-distribution network (CoADNet) to capture both salient and repetitive visual patterns from multiple images. First, we integrate saliency priors into the backbone features to suppress the redundant background information through an online intra-saliency guidance structure. After that, we design a two-stage aggregate-and-distribute architecture to explore group-wise semantic interactions and produce the co-saliency features. In the first stage, we propose a group-attentional semantic aggregation module that models inter-image relationships to generate the group-wise semantic representations. In the second stage, we propose a gated group distribution module that adaptively distributes the learned group semantics to different individuals in a dynamic gating mechanism. Finally, we develop a group consistency preserving decoder tailored for the CoSOD task, which maintains group constraints during feature decoding to predict more consistent full-resolution co-saliency maps. The proposed CoADNet is evaluated on four prevailing CoSOD benchmark datasets, which demonstrates the remarkable performance improvement over ten state-of-the-art competitors.
Code (1)
Tasks
Co-Salient Object DetectionDecoderobject-detectionObject DetectionSalient Object DetectionSimilar Papers 제목 키워드 기반
Global-and-Local Collaborative Learning for Co-Salient Object Detection
The goal of co-salient object detection (CoSOD) is to discover salient objects that commonly appear in a query group containing two or more relevant images. Therefore, how to effectively extract inter-image correspondenc…
8kCo-Salient Object Detectionobject-detectionObject Detection+1Multistep feature aggregation framework for salient object detection
Recent works on salient object detection have made use of multi-scale features in a way such that high-level features and low-level features can collaborate in locating salient objects. Many of the previous methods have …
Objectobject-detectionObject DetectionSalient Object DetectionGuidance and Teaching Network for Video Salient Object Detection
Owing to the difficulties of mining spatial-temporal cues, the existing approaches for video salient object detection (VSOD) are limited in understanding complex and noisy scenarios, and often fail in inferring prominent…
GPUObjectobject-detectionObject Detection+2Object-aware Aggregation with Bidirectional Temporal Graph for Video Captioning
Video captioning aims to automatically generate natural language descriptions of video content, which has drawn a lot of attention recent years. Generating accurate and fine-grained captions needs to not only understand …
ObjectVideo CaptioningGroup Collaborative Learning for Co-Salient Object Detection
We present a novel group collaborative learning framework (GCoNet) capable of detecting co-salient objects in real time (16ms), by simultaneously mining consensus representations at group level based on the two necessary…
Co-Salient Object DetectionObjectobject-detectionObject Detection+1