paper-with-me

홈 › Papers

Graph-Based Ascent Algorithms for Function Maximization

2018-02-13 · Muni Sreenivas Pydi, Varun Jog, Po-Ling Loh

We study the problem of finding the maximum of a function defined on the nodes of a connected graph. The goal is to identify a node where the function obtains its maximum. We focus on local iterative algorithms, which traverse the nodes of the graph along a path, and the next iterate is chosen from the neighbors of the current iterate with probability distribution determined by the function values at the current iterate and its neighbors. We study two algorithms corresponding to a Metropolis-Hastings random walk with different transition kernels: (i) The first algorithm is an exponentially weighted random walk governed by a parameter $\gamma$. (ii) The second algorithm is defined with respect to the graph Laplacian and a smoothness parameter $k$. We derive convergence rates for the two algorithms in terms of total variation distance and hitting times. We also provide simulations showing the relative convergence rates of our algorithms in comparison to an unbiased random walk, as a function of the smoothness of the graph function. Our algorithms may be categorized as a new class of "descent-based" methods for function maximization on the nodes of a graph.

📄 PDF Abstract BibTeX arXiv:1802.04475

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Continuous Submodular Maximization: Beyond DR-Submodularity

2020-06-21 · NeurIPS 2020 12 · Moran Feldman, Amin Karbasi

In this paper, we propose the first continuous optimization algorithms that achieve a constant factor approximation guarantee for the problem of monotone continuous submodular maximization subject to a linear constraint.…

Randomized Stochastic Gradient Descent Ascent

2021-11-25 · Othmane Sebbouh, Marco Cuturi, Gabriel Peyré

An increasing number of machine learning problems, such as robust or adversarial variants of existing algorithms, require minimizing a loss function that is itself defined as a maximum. Carrying a loop of stochastic grad…

Fast First-Order Methods for Monotone Strongly DR-Submodular Maximization

2021-11-15 · Omid Sadeghi, Maryam Fazel

Continuous DR-submodular functions are a class of functions that satisfy the Diminishing Returns (DR) property, which implies that they are concave along non-negative directions. Existing works have studied monotone cont…

Discerning and Enhancing the Weighted Sum-Rate Maximization Algorithms in Communications

2023-11-08 · Zepeng Zhang, Ziping Zhao, Kaiming Shen, Daniel P. Palomar 외

Weighted sum-rate (WSR) maximization plays a critical role in communication system design. This paper examines three optimization methods for WSR maximization, which ensure convergence to stationary points: two block coo…

Communication-Efficient Decentralized Online Continuous DR-Submodular Maximization

2022-08-18 · Qixin Zhang, Zengde Deng, Xiangru Jian, Zaiyi Chen 외

Maximizing a monotone submodular function is a fundamental task in machine learning, economics, and statistics. In this paper, we present two communication-efficient decentralized online algorithms for the monotone conti…