Rethinking Global Context in Crowd Counting
This paper investigates the role of global context for crowd counting. Specifically, a pure transformer is used to extract features with global information from overlapping image patches. Inspired by classification, we add a context token to the input sequence, to facilitate information exchange with tokens corresponding to image patches throughout transformer layers. Due to the fact that transformers do not explicitly model the tried-and-true channel-wise interactions, we propose a token-attention module (TAM) to recalibrate encoded features through channel-wise attention informed by the context token. Beyond that, it is adopted to predict the total person count of the image through regression-token module (RTM). Extensive experiments on various datasets, including ShanghaiTech, UCF-QNRF, JHU-CROWD++ and NWPU, demonstrate that the proposed context extraction techniques can significantly improve the performance over the baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
Crowd CountingSimilar Papers 제목 키워드 기반
Local Information Matters: A Rethink of Crowd Counting
The motivation of this paper originates from rethinking an essential characteristic of crowd counting: individuals (heads of humans) in the crowd counting task typically occupy a very small portion of the image. This cha…
Contrastive LearningCrowd CountingCrowdFormer: Weakly-supervised Crowd counting with Improved Generalizability
Convolutional neural networks (CNNs) have dominated the field of computer vision for nearly a decade due to their strong ability to learn local features. However, due to their limited receptive field, CNNs fail to model …
Crowd CountingCCTrans: Simplifying and Improving Crowd Counting with Transformer
Most recent methods used for crowd counting are based on the convolutional neural network (CNN), which has a strong ability to extract local features. But CNN inherently fails in modeling the global context due to the li…
Crowd CountingJoint CNN and Transformer Network via weakly supervised Learning for efficient crowd counting
Currently, for crowd counting, the fully supervised methods via density map estimation are the mainstream research directions. However, such methods need location-level annotation of persons in an image, which is time-co…
Crowd CountingWeakly-supervised LearningRegion-Aware Network: Model Human's Top-Down Visual Perception Mechanism for Crowd Counting
Background noise and scale variation are common problems that have been long recognized in crowd counting. Humans glance at a crowd image and instantly know the approximate number of human and where they are through atte…
Crowd Counting