paper-with-me

Papers

Generalized Exponentiated Gradient Algorithms and Their Application to On-Line Portfolio Selection

2024-06-02 · Andrzej Cichocki, Sergio Cruces, Auxiliadora Sarmiento, Toshihisa Tanaka

This paper introduces a novel family of generalized exponentiated gradient (EG) updates derived from an Alpha-Beta divergence regularization function. Collectively referred to as EGAB, the proposed updates belong to the category of multiplicative gradient algorithms for positive data and demonstrate considerable flexibility by controlling iteration behavior and performance through three hyperparameters: $\alpha$, $\beta$, and the learning rate $\eta$. To enforce a unit $l_1$ norm constraint for nonnegative weight vectors within generalized EGAB algorithms, we develop two slightly distinct approaches. One method exploits scale-invariant loss functions, while the other relies on gradient projections onto the feasible domain. As an illustration of their applicability, we evaluate the proposed updates in addressing the online portfolio selection problem (OLPS) using gradient-based methods. Here, they not only offer a unified perspective on the search directions of various OLPS algorithms (including the standard exponentiated gradient and diverse mean-reversion strategies), but also facilitate smooth interpolation and extension of these updates due to the flexibility in hyperparameter selection. Simulation results confirm that the adaptability of these generalized gradient updates can effectively enhance the performance for some portfolios, particularly in scenarios involving transaction costs.

📄 PDF Abstract BibTeX arXiv:2406.00655

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Mirror Descent and Novel Exponentiated Gradient Algorithms Using Trace-Form Entropies and Deformed Logarithms

2025-03-11 · Andrzej Cichocki, Toshihisa Tanaka, Sergio Cruces

In this paper we propose and investigate a wide class of Mirror Descent updates (MD) and associated novel Generalized Exponentiated Gradient (GEG) algorithms by exploiting various trace-form entropies and associated defo…

Form

Generalized Exponentiated Gradient Algorithms Using the Euler Two-Parameter Logarithm

2025-02-21 · Andrzej Cichocki

In this paper we propose and investigate a new class of Generalized Exponentiated Gradient (GEG) algorithms using Mirror Descent (MD) approaches, and applying as a regularization function the Bregman divergence with two-…

Exponentiated Gradient LINUCB for Contextual Multi-Armed Bandits

2013-05-10 · Djallel Bouneffouf

We present Exponentiated Gradient LINUCB, an algorithm for con-textual multi-armed bandits. This algorithm uses Exponentiated Gradient to find the optimal exploration of the LINUCB. Within a deliberately designed offline…

Multi-Armed Bandits

Basic Inequalities for First-Order Optimization with Applications to Statistical Risk Analysis

2025-12-31 · Seunghoon Paik, Kangjie Zhou, Matus Telgarsky, Ryan J. Tibshirani arxiv

We introduce \textit{basic inequalities} for first-order iterative optimization algorithms, forming a simple and versatile framework that connects implicit and explicit regularization. While related inequalities appear i…

Optimistic Optimisation of Composite Objective with Exponentiated Update

2022-08-08 · Weijia Shao, Fikret Sivrikaya, Sahin Albayrak

This paper proposes a new family of algorithms for the online optimisation of composite objectives. The algorithms can be interpreted as the combination of the exponentiated gradient and $p$-norm algorithm. Combined with…