paper-with-me

Papers

Diffusion Models as Network Optimizers: Explorations and Analysis

2024-11-01 · Ruihuai Liang, Bo Yang, PengYu Chen, Xianjin Li, Yifan Xue, Zhiwen Yu, Xuelin Cao, Yan Zhang, Mérouane Debbah, H. Vincent Poor, Chau Yuen

Network optimization is a fundamental challenge in the Internet of Things (IoT) network, often characterized by complex features that make it difficult to solve these problems. Recently, generative diffusion models (GDMs) have emerged as a promising new approach to network optimization, with the potential to directly address these optimization problems. However, the application of GDMs in this field is still in its early stages, and there is a noticeable lack of theoretical research and empirical findings. In this study, we first explore the intrinsic characteristics of generative models. Next, we provide a concise theoretical proof and intuitive demonstration of the advantages of generative models over discriminative models in network optimization. Based on this exploration, we implement GDMs as optimizers aimed at learning high-quality solution distributions for given inputs, sampling from these distributions during inference to approximate or achieve optimal solutions. Specifically, we utilize denoising diffusion probabilistic models (DDPMs) and employ a classifier-free guidance mechanism to manage conditional guidance based on input parameters. We conduct extensive experiments across three challenging network optimization problems. By investigating various model configurations and the principles of GDMs as optimizers, we demonstrate the ability to overcome prediction errors and validate the convergence of generated solutions to optimal solutions. We provide code and data at https://github.com/qiyu3816/DiffSG.

📄 PDF Abstract BibTeX arXiv:2411.00453

Code (1)

qiyu3816/DiffSG 공식 구현 pytorch

Tasks

Denoising

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Unveiling the Backbone-Optimizer Coupling Bias in Visual Representation Learning

2024-10-08 · Siyuan Li, Juanxi Tian, Zedong Wang, Luyuan Zhang 외

This paper delves into the interplay between vision backbones and optimizers, unvealing an inter-dependent phenomenon termed \textit{\textbf{b}ackbone-\textbf{o}ptimizer \textbf{c}oupling \textbf{b}ias} (BOCB). We observ…

Representation Learning

Diffusion Model with Perceptual Loss

2023-12-30 · Shanchuan Lin, Xiao Yang

Diffusion models without guidance tend to generate unrealistic samples, yet the cause of this problem is not fully studied. Our analysis suggests that the loss objective plays an important role in shaping the learned dis…

DenoisingDiversitymodel

Correcting Diffusion-Based Perceptual Image Compression with Privileged End-to-End Decoder

2024-04-07 · Yiyang Ma, Wenhan Yang, Jiaying Liu

The images produced by diffusion models can attain excellent perceptual quality. However, it is challenging for diffusion models to guarantee distortion, hence the integration of diffusion models and image compression mo…

DecoderImage Compression

Large Language Models as Evolutionary Optimizers

2023-10-29 · Shengcai Liu, Caishun Chen, Xinghua Qu, Ke Tang 외

Evolutionary algorithms (EAs) have achieved remarkable success in tackling complex combinatorial optimization problems. However, EAs often demand carefully-designed operators with the aid of domain expertise to achieve s…

Combinatorial OptimizationEvolutionary Algorithms

Diffusion-based Graph Generative Methods

2024-01-28 · Hongyang Chen, Can Xu, Lingyu Zheng, Qiang Zhang 외

Being the most cutting-edge generative methods, diffusion methods have shown great advances in wide generation tasks. Among them, graph generation attracts significant research attention for its broad application in real…

DenoisingGraph GenerationSurvey