paper-with-me

Papers

Dynamic Iterative Refinement for Efficient 3D Hand Pose Estimation

2021-11-11 · John Yang, Yash Bhalgat, Simyung Chang, Fatih Porikli, Nojun Kwak

While hand pose estimation is a critical component of most interactive extended reality and gesture recognition systems, contemporary approaches are not optimized for computational and memory efficiency. In this paper, we propose a tiny deep neural network of which partial layers are recursively exploited for refining its previous estimations. During its iterative refinements, we employ learned gating criteria to decide whether to exit from the weight-sharing loop, allowing per-sample adaptation in our model. Our network is trained to be aware of the uncertainty in its current predictions to efficiently gate at each iteration, estimating variances after each loop for its keypoint estimates. Additionally, we investigate the effectiveness of end-to-end and progressive training protocols for our recursive structure on maximizing the model capacity. With the proposed setting, our method consistently outperforms state-of-the-art 2D/3D hand pose estimation approaches in terms of both accuracy and efficiency for widely used benchmarks.

📄 PDF Abstract BibTeX arXiv:2111.06500

Code (0)

등록된 구현이 없습니다.

Tasks

3D Hand Pose EstimationGesture RecognitionHand Pose EstimationPose Estimation

Methods 이 논문이 사용한 방법론

AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…

Similar Papers 제목 키워드 기반

Coupled Iterative Refinement for 6D Multi-Object Pose Estimation

2022-04-26 · CVPR 2022 1 · Lahav Lipson, Zachary Teed, Ankit Goyal, Jia Deng

We address the task of 6D multi-object pose: given a set of known 3D objects and an RGB or RGB-D input image, we detect and estimate the 6D pose of each object. We propose a new approach to 6D object pose estimation whic…

6D Pose Estimation using RGBObjectPose Estimation

DIFT: Dynamic Iterative Field Transforms for Memory Efficient Optical Flow

2023-06-09 · Risheek Garrepalli, Jisoo Jeong, Rajeswaran C Ravindran, Jamie Menjay Lin 외

Recent advancements in neural network-based optical flow estimation often come with prohibitively high computational and memory requirements, presenting challenges in their model adaptation for mobile and low-power use c…

Optical Flow Estimation

FMA-Net: Flow-Guided Dynamic Filtering and Iterative Feature Refinement with Multi-Attention for Joint Video Super-Resolution and Deblurring

2024-01-08 · CVPR 2024 1 · Geunhyuk Youk, Jihyong Oh, Munchurl Kim

We present a joint learning scheme of video super-resolution and deblurring, called VSRDB, to restore clean high-resolution (HR) videos from blurry low-resolution (LR) ones. This joint restoration problem has drawn much …

DeblurringRepresentation LearningSuper-ResolutionVideo Super-Resolution

DifFlow3D: Toward Robust Uncertainty-Aware Scene Flow Estimation with Iterative Diffusion-Based Refinement

2024-01-01 · CVPR 2024 1 · Jiuming Liu, Guangming Wang, Weicai Ye, Chaokang Jiang 외

Scene flow estimation which aims to predict per-point 3D displacements of dynamic scenes is a fundamental task in the computer vision field. However previous works commonly suffer from unreliable correlation caused b…

DiversityScene Flow Estimation

Pushing the Envelope for RGB-based Dense 3D Hand Pose Estimation via Neural Rendering

2019-04-08 · CVPR 2019 6 · Seungryul Baek, Kwang In Kim, Tae-Kyun Kim

Estimating 3D hand meshes from single RGB images is challenging, due to intrinsic 2D-3D mapping ambiguities and limited training data. We adopt a compact parametric 3D hand model that represents deformable and articulate…

3D Hand Pose Estimation3D Pose EstimationData AugmentationHand Pose Estimation+2