paper-with-me

Papers

OOD-HOI: Text-Driven 3D Whole-Body Human-Object Interactions Generation Beyond Training Domains

2024-11-27 · Yixuan Zhang, Hui Yang, Chuanchen Luo, Junran Peng, Yuxi Wang, Zhaoxiang Zhang

Generating realistic 3D human-object interactions (HOIs) from text descriptions is a active research topic with potential applications in virtual and augmented reality, robotics, and animation. However, creating high-quality 3D HOIs remains challenging due to the lack of large-scale interaction data and the difficulty of ensuring physical plausibility, especially in out-of-domain (OOD) scenarios. Current methods tend to focus either on the body or the hands, which limits their ability to produce cohesive and realistic interactions. In this paper, we propose OOD-HOI, a text-driven framework for generating whole-body human-object interactions that generalize well to new objects and actions. Our approach integrates a dual-branch reciprocal diffusion model to synthesize initial interaction poses, a contact-guided interaction refiner to improve physical accuracy based on predicted contact areas, and a dynamic adaptation mechanism which includes semantic adjustment and geometry deformation to improve robustness. Experimental results demonstrate that our OOD-HOI could generate more realistic and physically plausible 3D interaction pose in OOD scenarios compared to existing methods.

📄 PDF Abstract BibTeX arXiv:2411.18660

Code (0)

등록된 구현이 없습니다.

Tasks

Human-Object Interaction Detection

Methods 이 논문이 사용한 방법론

Focus 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Motion-X++: A Large-Scale Multimodal 3D Whole-body Human Motion Dataset

2025-01-09 · Yuhong Zhang, Jing Lin, Ailing Zeng, Guanlin Wu 외

In this paper, we introduce Motion-X++, a large-scale multimodal 3D expressive whole-body human motion dataset. Existing motion datasets predominantly capture body-only poses, lacking facial expressions, hand gestures, a…

Human Mesh RecoveryMotion Generation

HumanTOMATO: Text-aligned Whole-body Motion Generation

2023-10-19 · Shunlin Lu, Ling-Hao Chen, Ailing Zeng, Jing Lin 외

This work targets a novel text-driven whole-body motion generation task, which takes a given textual description as input and aims at generating high-quality, diverse, and coherent facial expressions, hand gestures, and …

Motion GenerationMotion Synthesis

Forecasting of 3D Whole-body Human Poses with Grasping Objects

2024-01-01 · CVPR 2024 1 · Haitao Yan, Qiongjie Cui, Jiexin Xie, Shijie Guo

In the context of computer vision and human-robot interaction forecasting 3D human poses is crucial for understanding human behavior and enhancing the predictive capabilities of intelligent systems. While existing me…

Human motion predictionmotion predictionPose Prediction

HANDOFF: Humanoid Agentic Task-Space Whole-Body Control via Distilled Complementary Teachers

2026-06-04 · Lizhi Yang, Junheng Li, Nehar Poddar, Yiling Hou 외 arxiv

For a humanoid robot to be deployed in the real world, the choice of command space (i.e., the interface between task planning and whole-body control) is crucial. Existing whole-body controllers typically demand dense kin…

Diffgrasp: Whole-Body Grasping Synthesis Guided by Object Motion Using a Diffusion Model

2024-12-30 · Yonghao Zhang, Qiang He, Yanguang Wan, yinda zhang 외

Generating high-quality whole-body human object interaction motion sequences is becoming increasingly important in various fields such as animation, VR/AR, and robotics. The main challenge of this task lies in determinin…

Human-Object Interaction Detection