paper-with-me

홈 › Papers

Locality-constrained Spatial Transformer Network for Video Crowd Counting

2019-07-18 · Yanyan Fang, Biyun Zhan, Wandi Cai, Shenghua Gao, Bo Hu

Compared with single image based crowd counting, video provides the spatial-temporal information of the crowd that would help improve the robustness of crowd counting. But translation, rotation and scaling of people lead to the change of density map of heads between neighbouring frames. Meanwhile, people walking in/out or being occluded in dynamic scenes leads to the change of head counts. To alleviate these issues in video crowd counting, a Locality-constrained Spatial Transformer Network (LSTN) is proposed. Specifically, we first leverage a Convolutional Neural Networks to estimate the density map for each frame. Then to relate the density maps between neighbouring frames, a Locality-constrained Spatial Transformer (LST) module is introduced to estimate the density map of next frame with that of current frame. To facilitate the performance evaluation, a large-scale video crowd counting dataset is collected, which contains 15K frames with about 394K annotated heads captured from 13 different scenes. As far as we know, it is the largest video crowd counting dataset. Extensive experiments on our dataset and other crowd counting datasets validate the effectiveness of our LSTN for crowd counting.

📄 PDF Abstract BibTeX arXiv:1907.07911

Code (1)

sweetyy83/Lstn_fdst_dataset 공식 구현

Tasks

Crowd CountingTranslation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Spatial Transformer A Spatial Transformer is an image model block that explicitly allows the spatial manipulation of data within a [convolutional neural…
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Crowd Counting via Weighted VLAD on Dense Attribute Feature Maps

2016-04-29 · Biyun Sheng, Chunhua Shen, Guosheng Lin, Jun Li 외

Crowd counting is an important task in computer vision, which has many applications in video surveillance. Although the regression-based framework has achieved great improvements for crowd counting, how to improve the di…

AttributeCrowd Counting

Video Swin Transformer

2021-06-24 · CVPR 2022 1 · Ze Liu, Jia Ning, Yue Cao, Yixuan Wei 외

The vision community is witnessing a modeling shift from CNNs to Transformers, where pure Transformer architectures have attained top accuracy on the major video recognition benchmarks. These video models are all built o…

Action ClassificationAction RecognitionGeneral ClassificationInductive Bias+3

Video Super-Resolution Transformer

2021-06-12 · JieZhang Cao, Yawei Li, Kai Zhang, Luc van Gool

Video super-resolution (VSR), with the aim to restore a high-resolution video from its corresponding low-resolution version, is a spatial-temporal sequence prediction problem. Recently, Transformer has been gaining popul…

Optical Flow EstimationSuper-ResolutionVideo Super-Resolution

FieldFormer: Locality-Aware Transformers for Spatio-Temporal Modeling on Sparse Sensor Networks

2025-10-04 · Ankit Bhardwaj, Ananth Balashankar, Lakshminarayanan Subramanian arxiv

Spatio-temporal sensor data in real-world systems is often sparse, noisy, and irregular, making latent field reconstruction fundamentally underconstrained. Under extreme sparsity, multiple physically plausible fields may…

Motion-guided Non-local Spatial-Temporal Network for Video Crowd Counting

2021-04-28 · Haoyue Bai, S. -H. Gary Chan

We study video crowd counting, which is to estimate the number of objects (people in this paper) in all the frames of a video sequence. Previous work on crowd counting is mostly on still images. There has been little wor…

Crowd Counting