paper-with-me

Papers

Hand-object reconstruction via interaction-aware graph attention mechanism

2024-09-26 · Taeyun Woo, Tae-Kyun Kim, Jinah Park

Estimating the poses of both a hand and an object has become an important area of research due to the growing need for advanced vision computing. The primary challenge involves understanding and reconstructing how hands and objects interact, such as contact and physical plausibility. Existing approaches often adopt a graph neural network to incorporate spatial information of hand and object meshes. However, these approaches have not fully exploited the potential of graphs without modification of edges within and between hand- and object-graphs. We propose a graph-based refinement method that incorporates an interaction-aware graph-attention mechanism to account for hand-object interactions. Using edges, we establish connections among closely correlated nodes, both within individual graphs and across different graphs. Experiments demonstrate the effectiveness of our proposed method with notable improvements in the realm of physical plausibility.

📄 PDF Abstract BibTeX arXiv:2409.17629

Code (0)

등록된 구현이 없습니다.

Tasks

Graph AttentionGraph Neural NetworkObjectObject Reconstruction

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음

Similar Papers 제목 키워드 기반

Dynamic Reconstruction of Hand-Object Interaction with Distributed Force-aware Contact Representation

2024-11-14 · Zhenjun Yu, Wenqiang Xu, Pengfei Xie, Yutong Li 외

We present ViTaM-D, a novel visual-tactile framework for dynamic hand-object interaction reconstruction, integrating distributed tactile sensing for more accurate contact modeling. While existing methods focus primarily …

Dynamic ReconstructionObjectObject Reconstruction

CHOIR: Contact-aware 4D Hand-Object Interaction Reconstruction

2026-05-20 · Hao Xu, Yilin Liu, Yinqiao Wang, Chi-Wing Fu 외 arxiv

We ask whether everyday open-world monocular videos can be turned into reusable 4D interaction primitives: articulated hand motion, object shape with 6D pose over time, and the when/where of contact. Such a capability wo…

GHOST: Fast Category-agnostic Hand-Object Interaction Reconstruction from RGB Videos using Gaussian Splatting

2026-03-19 · Ahmed Tawfik Aboukhadra, Marcel Rogge, Nadia Robertini, Abdalla Arafa 외 arxiv

Understanding realistic hand-object interactions from monocular RGB videos is essential for AR/VR, robotics, and embodied AI. Existing methods rely on category-specific templates or heavy computation, yet still produce p…

3D Reconstruction

Interaction-Aware 4D Gaussian Splatting for Dynamic Hand-Object Interaction Reconstruction

2025-11-18 · Hao Tian, Chenyangguang Zhang, Rui Liu, Wen Shen 외 arxiv

This paper focuses on a challenging setting of simultaneously modeling geometry and appearance of hand-object interaction scenes without any object priors. We follow the trend of dynamic 3D Gaussian Splatting based metho…

ShapeGraFormer: GraFormer-Based Network for Hand-Object Reconstruction from a Single Depth Map

2023-10-18 · Ahmed Tawfik Aboukhadra, Jameel Malik, Nadia Robertini, Ahmed Elhayek 외

3D reconstruction of hand-object manipulations is important for emulating human actions. Most methods dealing with challenging object manipulation scenarios, focus on hands reconstruction in isolation, ignoring physical …

3D ReconstructionObjectObject ReconstructionPose Estimation