Attention-based Dual-stream Vision Transformer for Radar Gait Recognition

2021-11-24 · Shiliang Chen, Wentao He, Jianfeng Ren, Xudong Jiang

Radar gait recognition is robust to light variations and less infringement on privacy. Previous studies often utilize either spectrograms or cadence velocity diagrams. While the former shows the time-frequency patterns, the latter encodes the repetitive frequency patterns. In this work, a dual-stream neural network with attention-based fusion is proposed to fully aggregate the discriminant information from these two representations. The both streams are designed based on the Vision Transformer, which well captures the gait characteristics embedded in these representations. The proposed method is validated on a large benchmark dataset for radar gait recognition, which shows that it significantly outperforms state-of-the-art solutions.

📄 PDF Abstract BibTeX arXiv:2111.12290

Code (0)

등록된 구현이 없습니다.

Tasks

Gait Recognition

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Position-Wise Feed-Forward Layer 설명 없음

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

physfusion: A Transformer-based Dual-Stream Radar and Vision Fusion Framework for Open Water Surface Object Detection

2026-03-02 · Yuting Wan, Liguo Sun, Jiuwu Hao, Zao Zhang 외 arxiv

Detecting water-surface targets for Unmanned Surface Vehicles (USVs) is challenging due to wave clutter, specular reflections, and weak appearance cues in long-range observations. Although 4D millimeter-wave radar comple…

Object Detection Point Clouds

RCBEVDet: Radar-camera Fusion in Bird's Eye View for 3D Object Detection

2024-03-25 · CVPR 2024 1 · Zhiwei Lin, Zhe Liu, Zhongyu Xia, Xinhao Wang 외

Three-dimensional object detection is one of the key tasks in autonomous driving. To reduce costs in practice, low-cost multi-view cameras for 3D object detection are proposed to replace the expansive LiDAR sensors. Howe…

3D Object Detection 3D Object Detection (RoI)Autonomous Driving Object+3

TransCAR: Transformer-based Camera-And-Radar Fusion for 3D Object Detection

2023-04-30 · Su Pang, Daniel Morris, Hayder Radha

Despite radar's popularity in the automotive industry, for fusion-based 3D object detection, most existing works focus on LiDAR and camera fusion. In this paper, we propose TransCAR, a Transformer-based Camera-And-Radar …

3D Object Detection Decoder Object object-detection+1

CORENet: Cross-Modal 4D Radar Denoising Network with LiDAR Supervision for Autonomous Driving

2025-08-19 · Fuyang Liu, Jilin Mei, Fangyuan Mao, Chen Min 외 arxiv

4D radar-based object detection has garnered great attention for its robustness in adverse weather conditions and capacity to deliver rich spatial information across diverse driving scenarios. Nevertheless, the sparse an…

Autonomous Driving Object Detection Point Clouds

Dual-Stream Attention Transformers for Sewer Defect Classification

2023-11-07 · Abdullah Al Redwan Newaz, Mahdi Abdeldguerfi, Kendall N. Niles, Joe Tom

We propose a dual-stream multi-scale vision transformer (DS-MSHViT) architecture that processes RGB and optical flow inputs for efficient sewer defect classification. Unlike existing methods that combine the predictions …

Classification Optical Flow Estimation