paper-with-me

홈 › Papers

Feature boosting with efficient attention for scene parsing

2024-02-29 · Vivek Singh, Shailza Sharma, Fabio Cuzzolin

The complexity of scene parsing grows with the number of object and scene classes, which is higher in unrestricted open scenes. The biggest challenge is to model the spatial relation between scene elements while succeeding in identifying objects at smaller scales. This paper presents a novel feature-boosting network that gathers spatial context from multiple levels of feature extraction and computes the attention weights for each level of representation to generate the final class labels. A novel `channel attention module' is designed to compute the attention weights, ensuring that features from the relevant extraction stages are boosted while the others are attenuated. The model also learns spatial context information at low resolution to preserve the abstract spatial relationships among scene elements and reduce computation cost. Spatial attention is subsequently concatenated into a final feature set before applying feature boosting. Low-resolution spatial attention features are trained using an auxiliary task that helps learning a coarse global scene structure. The proposed model outperforms all state-of-the-art models on both the ADE20K and the Cityscapes datasets.

📄 PDF Abstract BibTeX arXiv:2402.19250

Code (0)

등록된 구현이 없습니다.

Tasks

Scene Parsing

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Boosting Real-Time Driving Scene Parsing with Shared Semantics

2019-09-16 · Zhenzhen Xiang, Anbo Bao, Jie Li, Jianbo Su

Real-time scene parsing is a fundamental feature for autonomous driving vehicles with multiple cameras. In this letter we demonstrate that sharing semantics between cameras with different perspectives and overlapped view…

Autonomous DrivingScene ParsingSemantic Segmentation

Boosting Night-time Scene Parsing with Learnable Frequency

2022-08-30 · Zhifeng Xie, Sen Wang, Ke Xu, Zhizhong Zhang 외

Night-Time Scene Parsing (NTSP) is essential to many vision applications, especially for autonomous driving. Most of the existing methods are proposed for day-time scene parsing. They rely on modeling pixel intensity-bas…

Autonomous DrivingScene Parsing

CACFNet: Cross-Modal Attention Cascaded Fusion Network for RGB-T Urban Scene Parsing

2023-09-14 · journal 2023 9 · WuJie Zhou, Shaohua Dong, Meixin Fang, Lu Yu

Color–thermal (RGB-T) urban scene parsing has recently attracted widespread interest. However, most existing approaches to RGB-T urban scene parsing do not deeply explore the information complementarity between RGB-T fea…

Scene ParsingThermal Image Segmentation

HAPNet: Toward Superior RGB-Thermal Scene Parsing via Hybrid, Asymmetric, and Progressive Heterogeneous Feature Fusion

2024-04-04 · Jiahang Li, Peng Yun, Qijun Chen, Rui Fan

Data-fusion networks have shown significant promise for RGB-thermal scene parsing. However, the majority of existing studies have relied on symmetric duplex encoders for heterogeneous feature extraction and fusion, payin…

Scene ParsingSemantic SegmentationThermal Image Segmentation

PSANet: Point-wise Spatial Attention Network for Scene Parsing

2018-09-01 · ECCV 2018 9 · Hengshuang Zhao, Yi Zhang, Shu Liu, Jianping Shi 외

We notice information flow in convolutional neural networks is restricted inside local neighborhood regions due to the physical design of convolutional filters, which limits the overall understanding of complex scenes. I…

PositionScene ParsingSemantic Segmentation