paper-with-me

Papers

Motion Adaptive Pose Estimation From Compressed Videos

2021-01-01 · ICCV 2021 10 · Zhipeng Fan, Jun Liu, Yao Wang

Human pose estimation from videos has many real-world applications. Existing methods focus on applying models with a uniform computation profile on fully de- coded frames, ignoring the freely available motion signals and motion-compensation residuals from the compressed stream. A novel model, called Motion Adaptive Pose Net is proposed to exploit the compressed streams to efficiently decode pose sequences from videos. The model incorporates a Motion Compensated ConvLSTM to propagate the spatially aligned features, along with an adaptive gate to dynamically determine if the computationally expensive features should be extracted from fully decoded frames to compensate the motion-warped features, solely based on the residual errors. Leveraging the informative yet readily available signals from compressed streams, we propagate the latent features through our Motion Adaptive Pose Net efficiently. Our model outperforms the state-of-the-art models in pose- estimation accuracy on two widely used datasets with only around half of the computation complexity.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Motion CompensationPose Estimation

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Tanh Activation 설명 없음
Sigmoid Activation 설명 없음
ConvLSTM ConvLSTM is a type of recurrent neural network for spatio-temporal prediction that has convolutional structures in both the input-to-state and state-to-state transitions. The…

Similar Papers 제목 키워드 기반

MVFlow: Deep Optical Flow Estimation of Compressed Videos with Motion Vector Prior

2023-08-03 · Shili Zhou, Xuhao Jiang, Weimin Tan, Ruian He 외

In recent years, many deep learning-based methods have been proposed to tackle the problem of optical flow estimation and achieved promising results. However, they hardly consider that most videos are compressed and thus…

Optical Flow Estimation

Leveraging Video Coding Knowledge for Deep Video Enhancement

2023-02-27 · Thong Bach, Thuong Nguyen Canh, Van-Quang Nguyen

Recent advancements in deep learning techniques have significantly improved the quality of compressed videos. However, previous approaches have not fully exploited the motion characteristics of compressed videos, such as…

Video CompressionVideo EnhancementVideo Restoration

Compressed-Domain-Aware Online Video Super-Resolution

2026-03-08 · Yuhang Wang, Hai Li, Shujuan Hou, Zhetao Dong 외 arxiv

In bandwidth-limited online video streaming, videos are usually downsampled and compressed. Although recent online video super-resolution (online VSR) approaches achieve promising results, they are still compute-intensiv…

Video Super-Resolution

You Can Ground Earlier than See: An Effective and Efficient Pipeline for Temporal Sentence Grounding in Compressed Videos

2023-03-14 · CVPR 2023 1 · Xiang Fang, Daizong Liu, Pan Zhou, Guoshun Nan

Given an untrimmed video, temporal sentence grounding (TSG) aims to locate a target moment semantically according to a sentence query. Although previous respectable works have made decent success, they only focus on high…

SentenceTemporal Sentence Grounding

A Codec Information Assisted Framework for Efficient Compressed Video Super-Resolution

2022-10-15 · Hengsheng Zhang, Xueyi Zou, Jiaming Guo, Youliang Yan 외

Online processing of compressed videos to increase their resolutions attracts increasing and broad attention. Video Super-Resolution (VSR) using recurrent neural network architecture is a promising solution due to its ef…

Motion EstimationOptical Flow EstimationSuper-ResolutionVideo Super-Resolution