Multi-label Classification with Panoptic Context Aggregation Networks
Context modeling is crucial for visual recognition, enabling highly discriminative image representations by integrating both intrinsic and extrinsic relationships between objects and labels in images. A limitation in current approaches is their focus on basic geometric relationships or localized features, often neglecting cross-scale contextual interactions between objects. This paper introduces the Deep Panoptic Context Aggregation Network (PanCAN), a novel approach that hierarchically integrates multi-order geometric contexts through cross-scale feature aggregation in a high-dimensional Hilbert space. Specifically, PanCAN learns multi-order neighborhood relationships at each scale by combining random walks with an attention mechanism. Modules from different scales are cascaded, where salient anchors at a finer scale are selected and their neighborhood features are dynamically fused via attention. This enables effective cross-scale modeling that significantly enhances complex scene understanding by combining multi-order and cross-scale context-aware features. Extensive multi-label classification experiments on NUS-WIDE, PASCAL VOC2007, and MS-COCO benchmarks demonstrate that PanCAN consistently achieves competitive results, outperforming state-of-the-art techniques in both quantitative and qualitative evaluations, thereby substantially improving multi-label classification performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi-Label ClassificationScene UnderstandingSimilar Papers 제목 키워드 기반
Contextual Image Parsing via Panoptic Segment Sorting
Visual context is versatile and hard to describe or label precisely. We aim to leverage the densely labeled task, image parsing, a.k.a panoptic segmentation, to learn a model that encodes and discovers object-centric co…
Metric LearningPanoptic SegmentationSegmentation1st Place Solution for PSG competition with ECCV'22 SenseHuman Workshop
Panoptic Scene Graph (PSG) generation aims to generate scene graph representations based on panoptic segmentation instead of rigid bounding boxes. Existing PSG methods utilize one-stage paradigm which simultaneously gene…
Multi-class ClassificationPanoptic SegmentationPredicate ClassificationRelation+4Open Vocabulary Panoptic Segmentation With Retrieval Augmentation
Given an input image and set of class names, panoptic segmentation aims to label each pixel in an image with class labels and instance labels. In comparison, Open Vocabulary Panoptic Segmentation aims to facilitate the s…
Open Vocabulary Panoptic SegmentationPANet: LiDAR Panoptic Segmentation with Sparse Instance Proposal and Aggregation
Reliable LiDAR panoptic segmentation (LPS), including both semantic and instance segmentation, is vital for many robotic applications, such as autonomous driving. This work proposes a new LPS framework named PANet to eli…
Autonomous DrivingInstance SegmentationPanoptic SegmentationSegmentation+1CPRAL: Collaborative Panoptic-Regional Active Learning for Semantic Segmentation
Acquiring the most representative examples via active learning (AL) can benefit many data-dependent computer vision tasks by minimizing efforts of image-level or pixel-wise annotations. In this paper, we propose a novel …
Active LearningSemantic Segmentation