paper-with-me

홈 › Papers

Sparse Diffusion Policy: A Sparse, Reusable, and Flexible Policy for Robot Learning

2024-07-01 · Yixiao Wang, Yifei Zhang, Mingxiao Huo, Ran Tian, Xiang Zhang, Yichen Xie, Chenfeng Xu, Pengliang Ji, Wei Zhan, Mingyu Ding, Masayoshi Tomizuka

The increasing complexity of tasks in robotics demands efficient strategies for multitask and continual learning. Traditional models typically rely on a universal policy for all tasks, facing challenges such as high computational costs and catastrophic forgetting when learning new tasks. To address these issues, we introduce a sparse, reusable, and flexible policy, Sparse Diffusion Policy (SDP). By adopting Mixture of Experts (MoE) within a transformer-based diffusion policy, SDP selectively activates experts and skills, enabling efficient and task-specific learning without retraining the entire model. SDP not only reduces the burden of active parameters but also facilitates the seamless integration and reuse of experts across various tasks. Extensive experiments on diverse tasks in both simulations and real world show that SDP 1) excels in multitask scenarios with negligible increases in active parameters, 2) prevents forgetting in continual learning of new tasks, and 3) enables efficient task transfer, offering a promising solution for advanced robotic applications. Demos and codes can be found in https://forrest-110.github.io/sparse_diffusion_policy/.

📄 PDF Abstract BibTeX arXiv:2407.01531

Code (0)

등록된 구현이 없습니다.

Tasks

Continual LearningMixture-of-Experts

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

A Knowledge-Driven Diffusion Policy for End-to-End Autonomous Driving Based on Expert Routing

2025-09-05 · Chengkai Xu, Jiaqi Liu, Yicheng Guo, Peng Hang 외 arxiv

End-to-end autonomous driving remains constrained by the difficulty of producing adaptive, robust, and interpretable decision-making across diverse scenarios. Existing methods often collapse diverse driving behaviors, la…

Autonomous Driving

PulseCol: Periodically Refreshed Column-Sparse Attention for Accelerating Diffusion Language Models

2026-05-20 · Yanyi Lyu, Letian Chen, Futing Sun, Miao Zhang 외 arxiv

Inference in diffusion large language models (dLLMs) is computationally expensive, as full self-attention must be repeatedly executed at each step of the denoising process without KV cache. Recent sparse attention method…

Computational Efficiency

PMA-Diffusion: A Physics-guided Mask-Aware Diffusion Framework for TSE from Sparse Observations

2025-12-05 · Lindong Liu, Zhixiong Jin, Seongjin Choi arxiv

High-resolution highway traffic state information is essential for Intelligent Transportation Systems, but typical traffic data acquired from loop detectors and probe vehicles are often too sparse and noisy to capture th…

Model-Agnostic Gender Bias Control for Text-to-Image Generation via Sparse Autoencoder

2025-07-28 · Chao Wu, Zhenyi Wang, Kangxian Xie, Naresh Kumar Devulapally 외 arxiv

Text-to-image (T2I) diffusion models often exhibit gender bias, particularly by generating stereotypical associations between professions and gendered subjects. This paper presents SAE Debias, a lightweight and model-agn…

Text-to-Image GenerationPrompt Engineering

Control-Augmented Autoregressive Diffusion for Data Assimilation

2025-10-08 · Prakhar Srivastava, Farrin Marouf Sofian, Francesco Immorlano, Kushagra Pandey 외 arxiv

Despite advances in test-time scaling and diffusion finetuning, guidance for Auto-Regressive Diffusion Models (ARDMs) remains underexplored. We introduce an amortized framework that augments a pretrained ARDM with an off…