paper-with-me

Papers

SPiKE: 3D Human Pose from Point Cloud Sequences

2024-09-03 · Irene Ballester, Ondřej Peterka, Martin Kampel

3D Human Pose Estimation (HPE) is the task of locating keypoints of the human body in 3D space from 2D or 3D representations such as RGB images, depth maps or point clouds. Current HPE methods from depth and point clouds predominantly rely on single-frame estimation and do not exploit temporal information from sequences. This paper presents SPiKE, a novel approach to 3D HPE using point cloud sequences. Unlike existing methods that process frames of a sequence independently, SPiKE leverages temporal context by adopting a Transformer architecture to encode spatio-temporal relationships between points across the sequence. By partitioning the point cloud into local volumes and using spatial feature extraction via point spatial convolution, SPiKE ensures efficient processing by the Transformer while preserving spatial integrity per timestamp. Experiments on the ITOP benchmark for 3D HPE show that SPiKE reaches 89.19% mAP, achieving state-of-the-art performance with significantly lower inference times. Extensive ablations further validate the effectiveness of sequence exploitation and our algorithmic choices. Code and models are available at: https://github.com/iballester/SPiKE

📄 PDF Abstract BibTeX arXiv:2409.01879

Code (1)

iballester/SPiKE 공식 구현 pytorch

Tasks

3D Human Pose EstimationPose Estimation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Real-time 3D human action recognition based on Hyperpoint sequence

2021-11-16 · Xing Li, Qian Huang, Zhijian Wang, Zhenjie Hou 외

Real-time 3D human action recognition has broad industrial applications, such as surveillance, human-computer interaction, and healthcare monitoring. By relying on complex spatio-temporal local encoding, most existing po…

3D Action RecognitionAction RecognitionTemporal Action Localization

SpikeGrasp: A Benchmark for 6-DoF Grasp Pose Detection from Stereo Spike Streams

2025-10-12 · Zhuoheng Gao, Jiyao Zhang, Zhiyong Xie, Hao Dong 외 arxiv

Most robotic grasping systems rely on converting sensor data into explicit 3D point clouds, which is a computational step not found in biological intelligence. This paper explores a fundamentally different, neuro-inspire…

Robotic GraspingPoint Clouds

Efficient 3D Recognition with Event-driven Spike Sparse Convolution

2024-12-10 · Xuerui Qiu, Man Yao, Jieyuan Zhang, Yuhong Chou 외

Spiking Neural Networks (SNNs) provide an energy-efficient way to extract 3D spatio-temporal features. Point clouds are sparse 3D spatial data, which suggests that SNNs should be well-suited for processing them. However,…

Attribute

TPU-GAN: Learning temporal coherence from dynamic point cloud sequences

2021-09-29 · ICLR 2022 4 · Zijie Li, Tianqin Li, Amir Barati Farimani

Point cloud sequence is an important data representation that provides flexible shape and motion information. Prior work demonstrates that incorporating scene flow information into loss can make model learn temporally co…

Generative Adversarial Networkpoint cloud upsamplingSuper-Resolution

A No-reference Quality Assessment Metric for Point Cloud Based on Captured Video Sequences

2022-06-09 · Yu Fan, ZiCheng Zhang, Wei Sun, Xiongkuo Min 외

Point cloud is one of the most widely used digital formats of 3D models, the visual quality of which is quite sensitive to distortions such as downsampling, noise, and compression. To tackle the challenge of point cloud …

Point Cloud Quality Assessment