paper-with-me

홈 › Papers

Gumbel-softmax-based Optimization: A Simple General Framework for Optimization Problems on Graphs

2020-04-14 · Yaoxin Li, Jing Liu, Guozheng Lin, Yueyuan Hou, Muyun Mou, Jiang Zhang

In computer science, there exist a large number of optimization problems defined on graphs, that is to find a best node state configuration or a network structure such that the designed objective function is optimized under some constraints. However, these problems are notorious for their hardness to solve because most of them are NP-hard or NP-complete. Although traditional general methods such as simulated annealing (SA), genetic algorithms (GA) and so forth have been devised to these hard problems, their accuracy and time consumption are not satisfying in practice. In this work, we proposed a simple, fast, and general algorithm framework based on advanced automatic differentiation technique empowered by deep learning frameworks. By introducing Gumbel-softmax technique, we can optimize the objective function directly by gradient descent algorithm regardless of the discrete nature of variables. We also introduce evolution strategy to parallel version of our algorithm. We test our algorithm on three representative optimization problems on graph including modularity optimization from network science, Sherrington-Kirkpatrick (SK) model from statistical physics, maximum independent set (MIS) and minimum vertex cover (MVC) problem from combinatorial optimization on graph. High-quality solutions can be obtained with much less time consuming compared to traditional approaches.

📄 PDF Abstract BibTeX arXiv:2004.07300

Code (0)

등록된 구현이 없습니다.

Tasks

Combinatorial Optimization

Similar Papers 제목 키워드 기반

Gumbel-softmax Optimization: A Simple General Framework for Combinatorial Optimization Problems on Graphs

2019-09-16 · Jing Liu, Fei Gao, Jiang Zhang

Many problems in real life can be converted to combinatorial optimization problems (COPs) on graphs, that is to find a best node state configuration or a network structure such that the designed objective function is opt…

Combinatorial Optimization

Gumbel-Softmax Flow Matching with Straight-Through Guidance for Controllable Biological Sequence Generation

2025-03-21 · Sophia Tang, Yinuo Zhang, Alexander Tong, Pranam Chatterjee

Flow matching in the continuous simplex has emerged as a promising strategy for DNA sequence design, but struggles to scale to higher simplex dimensions required for peptide and protein generation. We introduce Gumbel-So…

Generalized Gumbel-Softmax Gradient Estimator for Generic Discrete Random Variables

2020-03-04 · Weonyoung Joo, Dongjun Kim, Seungjae Shin, Il-Chul Moon

Estimating the gradients of stochastic nodes in stochastic computational graphs is one of the crucial research questions in the deep generative modeling community, which enables the gradient descent optimization on neura…

Topic Models

Indirectly Parameterized Concrete Autoencoders

2024-03-01 · Alfred Nilsson, Klas Wijk, Sai Bharath Chandra Gutha, Erik Englesson 외

Feature selection is a crucial task in settings where data is high-dimensional or acquiring the full set of features is costly. Recent developments in neural network-based embedded feature selection show promising result…

Decoderfeature selection

Improving Discrete Optimisation Via Decoupled Straight-Through Gumbel-Softmax

2024-10-17 · Rushi Shah, Mingyuan Yan, Michael Curtis Mozer, Dianbo Liu

Discrete representations play a crucial role in many deep learning architectures, yet their non-differentiable nature poses significant challenges for gradient-based optimization. To address this issue, various gradient …