paper-with-me

Papers

Diverse Controllable Diffusion Policy with Signal Temporal Logic

2025-03-04 · Yue Meng, Chuchu Fan

Generating realistic simulations is critical for autonomous system applications such as self-driving and human-robot interactions. However, driving simulators nowadays still have difficulty in generating controllable, diverse, and rule-compliant behaviors for road participants: Rule-based models cannot produce diverse behaviors and require careful tuning, whereas learning-based methods imitate the policy from data but are not designed to follow the rules explicitly. Besides, the real-world datasets are by nature "single-outcome", making the learning method hard to generate diverse behaviors. In this paper, we leverage Signal Temporal Logic (STL) and Diffusion Models to learn controllable, diverse, and rule-aware policy. We first calibrate the STL on the real-world data, then generate diverse synthetic data using trajectory optimization, and finally learn the rectified diffusion policy on the augmented dataset. We test on the NuScenes dataset and our approach can achieve the most diverse rule-compliant trajectories compared to other baselines, with a runtime 1/17X to the second-best approach. In the closed-loop testing, our approach reaches the highest diversity, rule satisfaction rate, and the least collision rate. Our method can generate varied characteristics conditional on different STL parameters in testing. A case study on human-robot encounter scenarios shows our approach can generate diverse and closed-to-oracle trajectories. The annotation tool, augmented dataset, and code are available at https://github.com/mengyuest/pSTL-diffusion-policy.

📄 PDF Abstract BibTeX arXiv:2503.02924

Code (1)

mengyuest/pstl-diffusion-policy 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

DegDiT: Controllable Audio Generation with Dynamic Event Graph Guided Diffusion Transformer

2025-08-19 · Yisu Liu, Chenxing Li, Wanqian Zhang, Wenfu Wang 외 arxiv

Controllable text-to-audio generation aims to synthesize audio from textual descriptions while satisfying user-specified constraints, including event types, temporal sequences, and onset and offset timestamps. This enabl…

Temporal SequencesAudio Generation

Guided Conditional Diffusion for Controllable Traffic Simulation

2022-10-31 · Ziyuan Zhong, Davis Rempe, Danfei Xu, Yuxiao Chen 외

Controllable and realistic traffic simulation is critical for developing and verifying autonomous vehicles. Typical heuristic-based traffic models offer flexible control to make vehicles follow specific trajectories and …

Autonomous VehiclesCollision Avoidance

Controllable Expressive 3D Facial Animation via Diffusion in a Unified Multimodal Space

2025-04-14 · Kangwei Liu, Junwu Liu, Xiaowei Yi, Jinlin Guo 외

Audio-driven emotional 3D facial animation encounters two significant challenges: (1) reliance on single-modal control signals (videos, text, or emotion labels) without leveraging their complementary strengths for compre…

Contrastive LearningDiversity

Motion Synthesis with Sparse and Flexible Keyjoint Control

2025-03-18 · Inwoo Hwang, Jinseok Bae, Donggeun Lim, Young Min Kim

Creating expressive character animations is labor-intensive, requiring intricate manual adjustment of animators across space and time. Previous works on controllable motion generation often rely on a predefined set of de…

Motion GenerationMotion Synthesis

ViFeEdit: A Video-Free Tuner of Your Video Diffusion Transformer

2026-03-16 · Ruonan Yu, Zhenxiong Tan, Zigeng Chen, Songhua Liu 외 arxiv

Diffusion Transformers (DiTs) have demonstrated remarkable scalability and quality in image and video generation, prompting growing interest in extending them to controllable generation and editing tasks. However, compar…

Video Generation