paper-with-me

홈 › Papers

STAR-Pose: Efficient Low-Resolution Video Human Pose Estimation via Spatial-Temporal Adaptive Super-Resolution

2025-06-19 · Yucheng Jin, Jinyan Chen, Ziyue He, Baojun Han, Furan An

Human pose estimation in low-resolution videos presents a fundamental challenge in computer vision. Conventional methods either assume high-quality inputs or employ computationally expensive cascaded processing, which limits their deployment in resource-constrained environments. We propose STAR-Pose, a spatial-temporal adaptive super-resolution framework specifically designed for video-based human pose estimation. Our method features a novel spatial-temporal Transformer with LeakyReLU-modified linear attention, which efficiently captures long-range temporal dependencies. Moreover, it is complemented by an adaptive fusion module that integrates parallel CNN branch for local texture enhancement. We also design a pose-aware compound loss to achieve task-oriented super-resolution. This loss guides the network to reconstruct structural features that are most beneficial for keypoint localization, rather than optimizing purely for visual quality. Extensive experiments on several mainstream video HPE datasets demonstrate that STAR-Pose outperforms existing approaches. It achieves up to 5.2% mAP improvement under extremely low-resolution (64x48) conditions while delivering 2.8x to 4.4x faster inference than cascaded approaches.

📄 PDF Abstract BibTeX arXiv:2506.16061

Code (0)

등록된 구현이 없습니다.

Tasks

Pose EstimationSuper-Resolution

Methods 이 논문이 사용한 방법론

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Transformer A Transformer is a model architecture that eschews recurrence and instead relies entirely on an [attention…

Similar Papers 제목 키워드 기반

Video Interpolation with Diffusion Models

2024-04-01 · CVPR 2024 1 · Siddhant Jain, Daniel Watson, Eric Tabellion, Aleksander Hołyński 외

We present VIDIM, a generative model for video interpolation, which creates short videos given a start and end frame. In order to achieve high fidelity and generate motions unseen in the input data, VIDIM uses cascaded d…

Super-Resolution

Space-Time-Aware Multi-Resolution Video Enhancement

2020-03-30 · CVPR 2020 6 · Muhammad Haris, Greg Shakhnarovich, Norimichi Ukita

We consider the problem of space-time super-resolution (ST-SR): increasing spatial resolution of video frames and simultaneously interpolating frames to increase the frame rate. Modern approaches handle these axes one at…

Super-ResolutionVideo EnhancementVideo Super-Resolution

InfinityStar: Unified Spacetime AutoRegressive Modeling for Visual Generation

2025-11-06 · Jinlai Liu, Jian Han, Bin Yan, Hui Wu 외 arxiv

We introduce InfinityStar, a unified spacetime autoregressive framework for high-resolution image and dynamic video synthesis. Building on the recent success of autoregressive modeling in both vision and language, our pu…

Video Generation

SuperTran: Reference Based Video Transformer for Enhancing Low Bitrate Streams in Real Time

2022-11-22 · Tejas Khot, Nataliya Shapovalova, Silviu Andrei, Walterio Mayol-Cuevas

This work focuses on low bitrate video streaming scenarios (e.g. 50 - 200Kbps) where the video quality is severely compromised. We present a family of novel deep generative models for enhancing perceptual video quality o…

Super-Resolution

Super Efficient Neural Network for Compression Artifacts Reduction and Super Resolution

2024-01-26 · Wen Ma, Qiuwen Lou, Arman Kazemi, Julian Faraone 외

Video quality can suffer from limited internet speed while being streamed by users. Compression artifacts start to appear when the bitrate decreases to match the available bandwidth. Existing algorithms either focus on r…

Efficient Neural NetworkSuper-Resolution