paper-with-me

홈 › Papers

Synthesizing Long-Term 3D Human Motion and Interaction in 3D Scenes

2020-12-10 · CVPR 2021 1 · Jiashun Wang, Huazhe Xu, Jingwei Xu, Sifei Liu, Xiaolong Wang

Synthesizing 3D human motion plays an important role in many graphics applications as well as understanding human activity. While many efforts have been made on generating realistic and natural human motion, most approaches neglect the importance of modeling human-scene interactions and affordance. On the other hand, affordance reasoning (e.g., standing on the floor or sitting on the chair) has mainly been studied with static human pose and gestures, and it has rarely been addressed with human motion. In this paper, we propose to bridge human motion synthesis and scene affordance reasoning. We present a hierarchical generative framework to synthesize long-term 3D human motion conditioning on the 3D scene structure. Building on this framework, we further enforce multiple geometry constraints between the human mesh and scene point clouds via optimization to improve realistic synthesis. Our experiments show significant improvements over previous approaches on generating natural and physically plausible human motion in a scene.

📄 PDF Abstract BibTeX arXiv:2012.05522

Code (1)

jiashunwang/Long-term-Motion-in-3D-Scenes pytorch

Tasks

Motion Synthesis

Similar Papers 제목 키워드 기반

Locomotion-Action-Manipulation: Synthesizing Human-Scene Interactions in Complex 3D Environments

2023-01-09 · ICCV 2023 1 · Jiye Lee, Hanbyul Joo

Synthesizing interaction-involved human motions has been challenging due to the high complexity of 3D environments and the diversity of possible human behaviors within. We present LAMA, Locomotion-Action-MAnipulation, to…

Diversity

COUCH: Towards Controllable Human-Chair Interactions

2022-05-01 · Xiaohan Zhang, Bharat Lal Bhatnagar, Vladimir Guzov, Sebastian Starke 외

Humans interact with an object in many different ways by making contact at different locations, creating a highly complex motion space that can be difficult to learn, particularly when synthesizing such human interaction…

Human-Object Interaction DetectionObject

Controllable Human-Object Interaction Synthesis

2023-12-06 · Jiaman Li, Alexander Clegg, Roozbeh Mottaghi, Jiajun Wu 외

Synthesizing semantic-aware, long-horizon, human-object interaction is critical to simulate realistic human behaviors. In this work, we address the challenging problem of generating synchronized object motion and human m…

Human-Object Interaction DetectionObject

GAN-based Reactive Motion Synthesis with Class-aware Discriminators for Human-human Interaction

2021-10-01 · Qianhui Men, Hubert P. H. Shum, Edmond S. L. Ho, Howard Leung

Creating realistic characters that can react to the users' or another character's movement can benefit computer graphics, games and virtual reality hugely. However, synthesizing such reactive motions in human-human inter…

Generative Adversarial NetworkMotion Synthesis

Human-Object Interaction from Human-Level Instructions

2024-06-25 · Zhen Wu, Jiaman Li, Pei Xu, C. Karen Liu

Intelligent agents must autonomously interact with the environments to perform daily tasks based on human-level instructions. They need a foundational understanding of the world to accurately interpret these instructions…

Common Sense ReasoningHuman-Object Interaction DetectionLanguage ModellingLarge Language Model+3