Encoder-Decoder Based Convolutional Neural Network with Multi-Scale-Aware Modules for Crowd Counting
In this paper, we proposed two modified neural network architectures based on SFANet and SegNet respectively for accurate and efficient crowd counting. Inspired by SFANet, the first model is attached with two novel multi-scale-aware modules called, ASSP and CAN. This model is called M-SFANet. The encoder of M-SFANet is enhanced with ASSP containing parallel atrous convolution with different sampling rates and hence able to extract multi-scale features of the target object and incorporate larger context. To further deal with scale variation throughout an input image, we leverage contextual module called CAN which adaptively encodes the scales of the contextual information. The combination yields an effective model for counting in both dense and sparse crowd scenes. Based on SFANet decoder structure, M-SFANet decoder has dual paths, for density map generation and attention map generation. The second model is called M-SegNet. For M-SegNet, we simply change bilinear upsampling used in SFANet to max unpooling originally from SegNet and propose the faster model while providing competitive counting performance. Designed for high-speed surveillance applications, M-SegNet has no additional multi-scale-aware module in order to not increase the complexity. Both models are encoder-decoder based architectures and end-to-end trainable. We also conduct extensive experiments on four crowd counting datasets and one vehicle counting dataset to show that these modifications yield algorithms that could outperform some of state-of-the-art crowd counting methods.
Code (1)
Tasks
Crowd CountingDecoderMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Encoder-Decoder Based Convolutional Neural Networks with Multi-Scale-Aware Modules for Crowd Counting
In this paper, we propose two modified neural networks based on dual path multi-scale fusion networks (SFANet) and SegNet for accurate and efficient crowd counting. Inspired by SFANet, the first model, which is named M-S…
Crowd CountingDecoderObject CountingCANet: Context aware network with dual-stream pyramid for medical image segmentation
Owing to the various object types and scales, complicated backgrounds, and similar appearance between tissues in medical images, it is difficult to extract some valuable information from different medical images. In this…
2D Semantic SegmentationDecoderImage SegmentationMedical Image Segmentation+3Open-Ended Long-Form Video Question Answering via Hierarchical Convolutional Self-Attention Networks
Open-ended video question answering aims to automatically generate the natural-language answer from referenced video contents according to the given question. Currently, most existing approaches focus on short-form video…
Answer GenerationDecoderFormQuestion Answering+1Towards Complex Backgrounds: A Unified Difference-Aware Decoder for Binary Segmentation
Binary segmentation is used to distinguish objects of interest from background, and is an active area of convolutional encoder-decoder network research. The current decoders are designed for specific objects based on the…
DecoderFIAS: Feature Imbalance-Aware Medical Image Segmentation with Dynamic Fusion and Mixing Attention
With the growing application of transformer in computer vision, hybrid architecture that combine convolutional neural networks (CNNs) and transformers demonstrates competitive ability in medical image segmentation. Howev…
DecoderImage SegmentationMedical Image SegmentationSegmentation+1