paper-with-me

Papers

Generalized Mixability via Entropic Duality

2014-06-24 · Mark D. Reid, Rafael M. Frongillo, Robert C. Williamson, Nishant Mehta

Mixability is a property of a loss which characterizes when fast convergence is possible in the game of prediction with expert advice. We show that a key property of mixability generalizes, and the exp and log operations present in the usual theory are not as special as one might have thought. In doing this we introduce a more general notion of $\Phi$-mixability where $\Phi$ is a general entropy (\ie, any convex function on probabilities). We show how a property shared by the convex dual of any such entropy yields a natural algorithm (the minimizer of a regret bound) which, analogous to the classical aggregating algorithm, is guaranteed a constant regret when used with $\Phi$-mixable losses. We characterize precisely which $\Phi$ have $\Phi$-mixable losses and put forward a number of conjectures about the optimality and relationships between different choices of entropy.

📄 PDF Abstract BibTeX arXiv:1406.6130

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Constant Regret, Generalized Mixability, and Mirror Descent

2018-02-20 · NeurIPS 2018 12 · Zakaria Mhammedi, Robert C. Williamson

We consider the setting of prediction with expert advice; a learner makes predictions by aggregating those of a group of experts. Under this setting, and for the right choice of loss function and "mixing" algorithm, it i…

Open-Ended Question Answering

Mixability in Statistical Learning

2012-12-01 · NeurIPS 2012 12 · Tim V. Erven, Peter Grünwald, Mark D. Reid, Robert C. Williamson

Statistical learning and sequential prediction are two different but related formalisms to study the quality of predictions. Mapping out their relations and transferring ideas is an active area of investigation. We provi…

Bayesian InferencePrediction

An ergodic BSDE approach to forward entropic risk measures: representation and large-maturity behavior

2017-04-17

Using elements from the theory of ergodic backward stochastic differential equations (BSDE), we study the behavior of forward entropic risk measures. We provide their general representation results (via both BSDE and con…

Generalised Mixability, Constant Regret, and Bayesian Updating

2014-03-10 · Mark D. Reid, Rafael M. Frongillo, Robert C. Williamson

Mixability of a loss is known to characterise when constant regret bounds are achievable in games of prediction with expert advice through the use of Vovk's aggregating algorithm. We provide a new interpretation of mixab…

From Stochastic Mixability to Fast Rates

2014-06-14 · NeurIPS 2014 12 · Nishant A. Mehta, Robert C. Williamson

Empirical risk minimization (ERM) is a fundamental learning rule for statistical learning problems where the data is generated according to some unknown distribution $\mathsf{P}$ and returns a hypothesis $f$ chosen from …