paper-with-me

홈 › Papers

Synthesizing Physically Plausible Human Motions in 3D Scenes

2023-08-17 · Liang Pan, Jingbo Wang, Buzhen Huang, Junyu Zhang, Haofan Wang, Xu Tang, Yangang Wang

We present a physics-based character control framework for synthesizing human-scene interactions. Recent advances adopt physics simulation to mitigate artifacts produced by data-driven kinematic approaches. However, existing physics-based methods mainly focus on single-object environments, resulting in limited applicability in realistic 3D scenes with multi-objects. To address such challenges, we propose a framework that enables physically simulated characters to perform long-term interaction tasks in diverse, cluttered, and unseen 3D scenes. The key idea is to decouple human-scene interactions into two fundamental processes, Interacting and Navigating, which motivates us to construct two reusable Controllers, namely InterCon and NavCon. Specifically, InterCon uses two complementary policies to enable characters to enter or leave the interacting state with a particular object (e.g., sitting on a chair or getting up). To realize navigation in cluttered environments, we introduce NavCon, where a trajectory following policy enables characters to track pre-planned collision-free paths. Benefiting from the divide and conquer strategy, we can train all policies in simple environments and directly apply them in complex multi-object scenes through coordination from a rule-based scheduler. Video and code are available at https://github.com/liangpan99/InterScene.

📄 PDF Abstract BibTeX arXiv:2308.09036

Code (1)

liangpan99/interscene 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Locomotion-Action-Manipulation: Synthesizing Human-Scene Interactions in Complex 3D Environments

2023-01-09 · ICCV 2023 1 · Jiye Lee, Hanbyul Joo

Synthesizing interaction-involved human motions has been challenging due to the high complexity of 3D environments and the diversity of possible human behaviors within. We present LAMA, Locomotion-Action-MAnipulation, to…

Diversity

Learning to Control Physically-simulated 3D Characters via Generating and Mimicking 2D Motions

2025-12-09 · Jianan Li, Xiao Chen, Tao Huang, Tien-Tsin Wong arxiv

Video data is more cost-effective than motion capture data for learning 3D character motion controllers, yet synthesizing realistic and diverse behaviors directly from videos remains challenging. Previous approaches typi…

MOGRAS: Human Motion with Grasping in 3D Scenes

2025-10-25 · Kunal Bhosikar, Siddharth Katageri, Vivek Madhavaram, Kai Han 외 arxiv

Generating realistic full-body motion interacting with objects is critical for applications in robotics, virtual reality, and human-computer interaction. While existing methods can generate full-body motion within 3D sce…

Neural Monocular 3D Human Motion Capture with Physical Awareness

2021-05-03 · Soshi Shimada, Vladislav Golyanik, Weipeng Xu, Patrick Pérez 외

We present a new trainable system for physically plausible markerless 3D human motion capture, which achieves state-of-the-art results in a broad range of challenging scenarios. Unlike most neural methods for human motio…

3D Pose EstimationPose Estimation

InteractMove: Text-Controlled Human-Object Interaction Generation in 3D Scenes with Movable Objects

2025-09-28 · Xinhao Cai, Minghang Zheng, Xin Jin, Yang Liu arxiv

We propose a novel task of text-controlled human object interaction generation in 3D scenes with movable objects. Existing human-scene interaction datasets suffer from insufficient interaction categories and typically on…

Collision AvoidanceVisual Grounding