paper-with-me

홈 › Papers

On The Radon--Nikodym Spectral Approach With Optimal Clustering

2019-06-02 · Vladislav Gennadievich Malyshkin

Problems of interpolation, classification, and clustering are considered. In the tenets of Radon--Nikodym approach $\langle f(\mathbf{x})\psi^2 \rangle / \langle\psi^2\rangle$, where the $\psi(\mathbf{x})$ is a linear function on input attributes, all the answers are obtained from a generalized eigenproblem $|f|\psi^{[i]}\rangle = \lambda^{[i]} |\psi^{[i]}\rangle$. The solution to the interpolation problem is a regular Radon-Nikodym derivative. The solution to the classification problem requires prior and posterior probabilities that are obtained using the Lebesgue quadrature[1] technique. Whereas in a Bayesian approach new observations change only outcome probabilities, in the Radon-Nikodym approach not only outcome probabilities but also the probability space $|\psi^{[i]}\rangle$ change with new observations. This is a remarkable feature of the approach: both the probabilities and the probability space are constructed from the data. The Lebesgue quadrature technique can be also applied to the optimal clustering problem. The problem is solved by constructing a Gaussian quadrature on the Lebesgue measure. A distinguishing feature of the Radon-Nikodym approach is the knowledge of the invariant group: all the answers are invariant relatively any non-degenerated linear transform of input vector $\mathbf{x}$ components. A software product implementing the algorithms of interpolation, classification, and optimal clustering is available from the authors.

📄 PDF Abstract BibTeX arXiv:1906.00460

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringGeneral Classification

Similar Papers 제목 키워드 기반

Radon-Nikodym approximation in application to image analysis

2015-11-05 · Vladislav Gennadievich Malyshkin

For an image pixel information can be converted to the moments of some basis $Q_k$, e.g. Fourier-Mellin, Zernike, monomials, etc. Given sufficient number of moments pixel information can be completely recovered, for insu…

Image Reconstruction

Proofs for Folklore Theorems on the Radon-Nikodym Derivative

2025-01-30 · Yaiza Bermudez, Gaetan Bisson, Iñaki Esnaola, Samir M. Perlaza

In this paper, rigorous statements and formal proofs are presented for both foundational and advanced folklore theorems on the Radon-Nikodym derivative. The cases of conditional and marginal probability measures are care…

On regularized Radon-Nikodym differentiation

2023-08-15 · Duc Hoan Nguyen, Werner Zellinger, Sergei V. Pereverzyev

We discuss the problem of estimating Radon-Nikodym derivatives. This problem appears in various applications, such as covariate shift adaptation, likelihood-ratio testing, mutual information estimation, and conditional p…

Mutual Information Estimation

The Sample Complexity of Approximate Rejection Sampling with Applications to Smoothed Online Learning

2023-02-09 · Adam Block, Yury Polyanskiy

Suppose we are given access to $n$ independent samples from distribution $\mu$ and we wish to output one of them with the goal of making the output distributed as close as possible to a target distribution $\nu$. In this…

Multiple-Instance Learning: Radon-Nikodym Approach to Distribution Regression Problem

2015-11-29 · Vladislav Gennadievich Malyshkin

For distribution regression problem, where a bag of $x$--observations is mapped to a single $y$ value, a one--step solution is proposed. The problem of random distribution to random value is transformed to random vector …

Multiple Instance Learningregression