Encoder-Decoder Based Convolutional Neural Networks with Multi-Scale-Aware Modules for Crowd Counting
In this paper, we propose two modified neural networks based on dual path multi-scale fusion networks (SFANet) and SegNet for accurate and efficient crowd counting. Inspired by SFANet, the first model, which is named M-SFANet, is attached with atrous spatial pyramid pooling (ASPP) and context-aware module (CAN). The encoder of M-SFANet is enhanced with ASPP containing parallel atrous convolutional layers with different sampling rates and hence able to extract multi-scale features of the target object and incorporate larger context. To further deal with scale variation throughout an input image, we leverage the CAN module which adaptively encodes the scales of the contextual information. The combination yields an effective model for counting in both dense and sparse crowd scenes. Based on the SFANet decoder structure, M-SFANet's decoder has dual paths, for density map and attention map generation. The second model is called M-SegNet, which is produced by replacing the bilinear upsampling in SFANet with max unpooling that is used in SegNet. This change provides a faster model while providing competitive counting performance. Designed for high-speed surveillance applications, M-SegNet has no additional multi-scale-aware module in order to not increase the complexity. Both models are encoder-decoder based architectures and are end-to-end trainable. We conduct extensive experiments on five crowd counting datasets and one vehicle counting dataset to show that these modifications yield algorithms that could improve state-of-the-art crowd counting methods. Codes are available at https://github.com/Pongpisit-Thanasutives/Variations-of-SFANet-for-Crowd-Counting.
Code (2)
Tasks
Crowd CountingDecoderObject CountingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
CANet: Context aware network with dual-stream pyramid for medical image segmentation
Owing to the various object types and scales, complicated backgrounds, and similar appearance between tissues in medical images, it is difficult to extract some valuable information from different medical images. In this…
2D Semantic SegmentationDecoderImage SegmentationMedical Image Segmentation+3Encoder-Decoder Based Convolutional Neural Network with Multi-Scale-Aware Modules for Crowd Counting
In this paper, we proposed two modified neural network architectures based on SFANet and SegNet respectively for accurate and efficient crowd counting. Inspired by SFANet, the first model is attached with two novel multi…
Crowd CountingDecoderOpen-Ended Long-Form Video Question Answering via Hierarchical Convolutional Self-Attention Networks
Open-ended video question answering aims to automatically generate the natural-language answer from referenced video contents according to the given question. Currently, most existing approaches focus on short-form video…
Answer GenerationDecoderFormQuestion Answering+1Towards Complex Backgrounds: A Unified Difference-Aware Decoder for Binary Segmentation
Binary segmentation is used to distinguish objects of interest from background, and is an active area of convolutional encoder-decoder network research. The current decoders are designed for specific objects based on the…
DecoderFIAS: Feature Imbalance-Aware Medical Image Segmentation with Dynamic Fusion and Mixing Attention
With the growing application of transformer in computer vision, hybrid architecture that combine convolutional neural networks (CNNs) and transformers demonstrates competitive ability in medical image segmentation. Howev…
DecoderImage SegmentationMedical Image SegmentationSegmentation+1