paper-with-me

Papers

Diffuse-CLoC: Guided Diffusion for Physics-based Character Look-ahead Control

2025-03-14 · Xiaoyu Huang, Takara Truong, Yunbo Zhang, Fangzhou Yu, Jean Pierre Sleiman, Jessica Hodgins, Koushil Sreenath, Farbod Farshidian

We present Diffuse-CLoC, a guided diffusion framework for physics-based look-ahead control that enables intuitive, steerable, and physically realistic motion generation. While existing kinematics motion generation with diffusion models offer intuitive steering capabilities with inference-time conditioning, they often fail to produce physically viable motions. In contrast, recent diffusion-based control policies have shown promise in generating physically realizable motion sequences, but the lack of kinematics prediction limits their steerability. Diffuse-CLoC addresses these challenges through a key insight: modeling the joint distribution of states and actions within a single diffusion model makes action generation steerable by conditioning it on the predicted states. This approach allows us to leverage established conditioning techniques from kinematic motion generation while producing physically realistic motions. As a result, we achieve planning capabilities without the need for a high-level planner. Our method handles a diverse set of unseen long-horizon downstream tasks through a single pre-trained model, including static and dynamic obstacle avoidance, motion in-betweening, and task-space control. Experimental results show that our method significantly outperforms the traditional hierarchical framework of high-level motion diffusion and low-level tracking.

📄 PDF Abstract BibTeX arXiv:2503.11801

Code (0)

등록된 구현이 없습니다.

Tasks

Action GenerationMotion Generationmotion in-betweening

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

DiffuseBot: Breeding Soft Robots With Physics-Augmented Generative Diffusion Models

2023-11-28 · NeurIPS 2023 11

Nature evolves creatures with a high complexity of morphological and behavioral intelligence, meanwhile computational methods lag in approaching that diversity and efficacy. Co-optimization of artificial creatures' morph…

Diversity

BioMoDiffuse: Physics-Guided Biomechanical Diffusion for Controllable and Authentic Human Motion Synthesis

2025-03-08 · Zixi Kang, Xinghan Wang, Yadong Mu

Human motion generation holds significant promise in fields such as animation, film production, and robotics. However, existing methods often fail to produce physically plausible movements that adhere to biomechanical pr…

Electromyography (EMG)Motion GenerationMotion Synthesis

AbDiffuser: Full-Atom Generation of in vitro Functioning Antibodies

2023-07-28 · NeurIPS 2023 11 · Karolis Martinkus, Jan Ludwiczak, Kyunghyun Cho, Wei-Ching Liang 외

We introduce AbDiffuser, an equivariant and physics-informed diffusion model for the joint generation of antibody 3D structures and sequences. AbDiffuser is built on top of a new representation of protein structure, reli…

Denoising

Diffusion-based Generation, Optimization, and Planning in 3D Scenes

2023-01-15 · CVPR 2023 1 · Siyuan Huang, Zan Wang, Puhao Li, Baoxiong Jia 외

We introduce SceneDiffuser, a conditional generative model for 3D scene understanding. SceneDiffuser provides a unified model for solving scene-conditioned generation, optimization, and planning. In contrast to prior wor…

DenoisingGrasp GenerationMotion GenerationMotion Planning+1

MedDiffuseMix: Preserving Diagnostic Evidence with Saliency-Aware Diffusion Medical Image Data Augmentatio

2026-06-25 · Teerath Kumar, Raja Vavekanand, Muhammad Turab arxiv

Limited data availability, class imbalance, and domain variability remain major barriers to reliable medical image classification. Conventional augmentation can improve training diversity but may distort diagnostically i…

Medical Image ClassificationImage Augmentation