Neuron-level Selective Context Aggregation for Scene Segmentation
Contextual information provides important cues for disambiguating visually similar pixels in scene segmentation. In this paper, we introduce a neuron-level Selective Context Aggregation (SCA) module for scene segmentation, comprised of a contextual dependency predictor and a context aggregation operator. The dependency predictor is implicitly trained to infer contextual dependencies between different image regions. The context aggregation operator augments local representations with global context, which is aggregated selectively at each neuron according to its on-the-fly predicted dependencies. The proposed mechanism enables data-driven inference of contextual dependencies, and facilitates context-aware feature learning. The proposed method improves strong baselines built upon VGG16 on challenging scene segmentation datasets, which demonstrates its effectiveness in modeling context information.
Code (0)
등록된 구현이 없습니다.
Tasks
Scene SegmentationSegmentationSimilar Papers 제목 키워드 기반
Category-Selective Neurons in Deep Networks: Comparing Purely Visual and Visual-Language Models
Category-selective regions in the human brain, such as the fusiform face area (FFA), extrastriate body area (EBA), parahippocampal place area (PPA), and visual word form area (VWFA), play a crucial role in high-level vis…
SpecificitySparseDet: A Simple and Effective Framework for Fully Sparse LiDAR-based 3D Object Detection
LiDAR-based sparse 3D object detection plays a crucial role in autonomous driving applications due to its computational efficiency advantages. Existing methods either use the features of a single central voxel as an obje…
3D Object DetectionAutonomous DrivingComputational EfficiencyObject+2Scene Segmentation with Dual Relation-aware Attention Network
In this article, we propose a Dual Relation-aware Attention Network (DRANet) to handle the task of scene segmentation. How to efficiently exploit context is essential for pixel-level recognition. To address the issue, we…
RelationScene SegmentationSegmentationSemantic SegmentationSAVTrack: Selective Vote Aggregation for Reliability-Aware Point Cloud Tracking
3D single object tracking (SOT) in LiDAR point clouds is essential for autonomous systems, but remains challenging under sparse and incomplete observations. In such cases, different target points provide highly uneven co…
Object TrackingPoint CloudsLocate-then-Merge: Neuron-Level Parameter Fusion for Mitigating Catastrophic Forgetting in Multimodal LLMs
Although multimodal large language models (MLLMs) have achieved impressive performance, the multimodal instruction tuning stage often causes catastrophic forgetting of the base LLM's language ability, even in strong mode…
Hallucination