paper-with-me

홈 › Papers

CollaFuse: Collaborative Diffusion Models

2024-06-20 · Simeon Allmendinger, Domenique Zipperling, Lukas Struppek, Niklas Kühl

In the landscape of generative artificial intelligence, diffusion-based models have emerged as a promising method for generating synthetic images. However, the application of diffusion models poses numerous challenges, particularly concerning data availability, computational requirements, and privacy. Traditional approaches to address these shortcomings, like federated learning, often impose significant computational burdens on individual clients, especially those with constrained resources. In response to these challenges, we introduce a novel approach for distributed collaborative diffusion models inspired by split learning. Our approach facilitates collaborative training of diffusion models while alleviating client computational burdens during image synthesis. This reduced computational burden is achieved by retaining data and computationally inexpensive processes locally at each client while outsourcing the computationally expensive processes to shared, more efficient server resources. Through experiments on the common CelebA dataset, our approach demonstrates enhanced privacy by reducing the necessity for sharing raw data. These capabilities hold significant potential across various application areas, including the design of edge computing solutions. Thus, our work advances distributed machine learning by contributing to the evolution of collaborative diffusion models.

📄 PDF Abstract BibTeX arXiv:2406.14429

Code (1)

simeonallmendinger/collafuse_imagen 공식 구현 pytorch

Tasks

Edge-computingFederated LearningImage Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

CollaFuse: Navigating Limited Resources and Privacy in Collaborative Generative AI

2024-02-29 · Domenique Zipperling, Simeon Allmendinger, Lukas Struppek, Niklas Kühl

In the landscape of generative artificial intelligence, diffusion-based models present challenges for socio-technical systems in data requirements and privacy. Traditional approaches like federated learning distribute th…

Autonomous DrivingDenoisingEdge-computingFederated Learning+1

Reasoning with Autoregressive-Diffusion Collaborative Thoughts

2026-02-02 · Mu Yuan, Liekang Zeng, Guoliang Xing, Lan Zhang 외 arxiv

Autoregressive and diffusion models represent two complementary generative paradigms. Autoregressive models excel at sequential planning and constraint composition, yet struggle with tasks that require explicit spatial o…

Question AnsweringSpatial Reasoning

Adaptive Item-based Collaborative Structures via Noise Rescheduling in Diffusion for Generative Recommendation

2026-08-24 · Jiaqi Wang, Tianying Liu, Heng Chang, Jihong Guan 외 arxiv

Discrete Diffusion Models (DDMs) have recently been introduced to recommendation systems, modeling user history as a token generation process via iterative denoising. However, while effective at capturing user-level sequ…

Collaborative FilteringRecommendation Systems

Variational Test-time Optimization for Diffusion Synchronization

2026-06-14 · Hyunsoo Lee, Farrin Marouf Sofian, Kushagra Pandey, Stephan Mandt arxiv

Collaborative generation, which coordinates multiple diffusion trajectories to extend the capabilities of pretrained priors, has emerged as a powerful paradigm for extending the applicability of diffusion models. Among e…

CoDiff: Conditional Diffusion Model for Collaborative 3D Object Detection

2025-02-17 · Zhe Huang, Shuo Wang, Yongcai Wang, Lei Wang

Collaborative 3D object detection holds significant importance in the field of autonomous driving, as it greatly enhances the perception capabilities of each individual agent by facilitating information exchange among mu…

3D Object DetectionAutonomous Drivingobject-detectionObject Detection+1