paper-with-me

Papers

Distributed Forgetting-factor Regret-based Online Optimization over Undirected Connected Networks

2025-03-27 · Lipo Mo, Jianjun Li, Min Zuo, Lei Wang

The evaluation of final-iteration tracking performance is a formidable obstacle in distributed online optimization algorithms. To address this issue, this paper proposes a novel evaluation metric named distributed forgetting-factor regret (DFFR). It incorporates a weight into the loss function at each iteration, which progressively reduces the weights of historical loss functions while enabling dynamic weights allocation across optimization horizon. Furthermore, we develop two distributed online optimization algorithms based on DFFR over undirected connected networks: the Distributed Online Gradient-free Algorithm for bandit-feedback problems and the Distributed Online Projection-free Algorithm for high-dimensional problems. Through theoretical analysis, we derive the upper bounds of DFFR for both algorithms and further prove that under mild conditions, DFFR either converges to zero or maintains a tight upper bound as iterations approach infinity. Experimental simulation demonstrates the effectiveness of the algorithms and the superior performance of DFFR.

📄 PDF Abstract BibTeX arXiv:2503.21498

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Trading-Off Static and Dynamic Regret in Online Least-Squares and Beyond

2019-09-06 · Jianjun Yuan, Andrew Lamperski

Recursive least-squares algorithms often use forgetting factors as a heuristic to adapt to non-stationary data streams. The first contribution of this paper rigorously characterizes the effect of forgetting factors for a…

Distributed Online Non-convex Optimization with Composite Regret

2022-09-21 · Zhanhong Jiang, Aditya Balu, Xian Yeow Lee, Young M. Lee 외

Regret has been widely adopted as the metric of choice for evaluating the performance of online optimization algorithms for distributed, multi-agent systems. However, data/model variations associated with agents can sign…

Dynamic Regret Analysis of Safe Distributed Online Optimization for Convex and Non-convex Problems

2023-02-23 · Ting-Jui Chang, Sapana Chaudhary, Dileep Kalathil, Shahin Shahrampour

This paper addresses safe distributed online optimization over an unknown set of linear safety constraints. A network of agents aims at jointly minimizing a global, time-varying function, which is only partially observab…

Online Learning over Dynamic Graphs via Distributed Proximal Gradient Algorithm

2019-05-16 · Rishabh Dixit, Amrit Singh Bedi, Ketan Rajawat

We consider the problem of tracking the minimum of a time-varying convex optimization problem over a dynamic graph. Motivated by target tracking and parameter estimation problems in intermittently connected robotic and s…

parameter estimation

Model-free Online Learning for the Kalman Filter: Forgetting Factor and Logarithmic Regret

2025-05-13 · Jiachen Qian, Yang Zheng

We consider the problem of online prediction for an unknown, non-explosive linear stochastic system. With a known system model, the optimal predictor is the celebrated Kalman filter. In the case of unknown systems, exist…

Inductive Biasregression