paper-with-me

홈 › Papers

Probability Link Models with Symmetric Information Divergence

2020-08-10 · Majid Asadi, Karthik Devarajan, Nader Ebrahimi, Ehsan Soofi, Lauren Spirko-Burns

This paper introduces link functions for transforming one probability distribution to another such that the Kullback-Leibler and R\'enyi divergences between the two distributions are symmetric. Two general classes of link models are proposed. The first model links two survival functions and is applicable to models such as the proportional odds and change point, which are used in survival analysis and reliability modeling. A prototype application involving the proportional odds model demonstrates advantages of symmetric divergence measures over asymmetric measures for assessing the efficacy of features and for model averaging purposes. The advantages include providing unique ranks for models and unique information weights for model averaging with one-half as much computation requirement of asymmetric divergences. The second model links two cumulative probability distribution functions. This model produces a generalized location model which are continuous counterparts of the binary probability models such as probit and logit models. Examples include the generalized probit and logit models which have appeared in the survival analysis literature, and a generalized Laplace model and a generalized Student-$t$ model, which are survival time models corresponding to the respective binary probability models. Lastly, extensions to symmetric divergence between survival functions and conditions for copula dependence information are presented.

📄 PDF Abstract BibTeX arXiv:2008.04387

Code (0)

등록된 구현이 없습니다.

Tasks

Survival Analysis

Similar Papers 제목 키워드 기반

The Alpha-Beta-Symetric Divergence and their Positive Definite Kernel

2018-03-01 · Mactar Ndaw, Macoumba Ndour, Papa Ngom

In this article we study the field of Hilbertian metrics and positive definit (pd) kernels on probability measures, they have a real interest in kernel methods. Firstly we will make a study based on the Alpha-Beta-diverg…

General Classificationimage-classificationImage Classification

Information Processing Equalities and the Information-Risk Bridge

2022-07-25 · Robert C. Williamson, Zac Cranko

We introduce two new classes of measures of information for statistical experiments which generalise and subsume $\phi$-divergences, integral probability metrics, $\mathfrak{N}$-distances (MMD), and $(f,\Gamma)$ divergen…

Ambiguity set and learning via Bregman and Wasserstein

2017-05-23 · Xin Guo, Johnny Hong, Nan Yang

Construction of ambiguity set in robust optimization relies on the choice of divergences between probability distributions. In distribution learning, choosing appropriate probability distributions based on observed data …

BIG-bench Machine Learning

Role-Aware Neural Convex Divergence Heads for Asymmetric Representation Learning

2026-07-02 · He Huang, Lu Shen, Yunfeng Huang, Li Qi arxiv

Many representation learning problems involve directed relations, such as lexical entailment, sentence entailment, ontology hierarchy, and citation links. Standard Euclidean, cosine, and Mahalanobis heads are symmetric, …

Representation Learning

On Information Links

2021-03-02 · Pierre Baudot

In a joint work with D. Bennequin, we suggested that the (negative) minima of the 3-way multivariate mutual information correspond to Borromean links, paving the way for providing probabilistic analogs of linking numbers…