paper-with-me

홈 › Papers

Σ-Optimality for Active Learning on Gaussian Random Fields

2013-12-01 · NeurIPS 2013 12 · Yifei Ma, Roman Garnett, Jeff Schneider

A common classifier for unlabeled nodes on undirected graphs uses label propagation from the labeled nodes, equivalent to the harmonic predictor on Gaussian random fields (GRFs). For active learning on GRFs, the commonly used V-optimality criterion queries nodes that reduce the L2 (regression) loss. V-optimality satisfies a submodularity property showing that greedy reduction produces a (1 − 1/e) globally optimal solution. However, L2 loss may not characterise the true nature of 0/1 loss in classification problems and thus may not be the best choice for active learning. We consider a new criterion we call Σ-optimality, which queries the node that minimizes the sum of the elements in the predictive covariance. Σ-optimality directly optimizes the risk of the surveying problem, which is to determine the proportion of nodes belonging to one class. In this paper we extend submodularity guarantees from V-optimality to Σ-optimality using properties specific to GRFs. We further show that GRFs satisfy the suppressor-free condition in addition to the conditional independence inherited from Markov random fields. We test Σ-optimality on real-world graphs with both synthetic and real data and show that it outperforms V-optimality and other related methods on classification.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Active LearningGeneral Classification

Similar Papers 제목 키워드 기반

On the consistency of inversion-free parameter estimation for Gaussian random fields

2016-01-15 · Hossein Keshavarz, Clayton Scott, XuanLong Nguyen

Gaussian random fields are a powerful tool for modeling environmental processes. For high dimensional samples, classical approaches for estimating the covariance parameters require highly challenging and massive computat…

parameter estimation

Estimation of positive definite M-matrices and structure learning for attractive Gaussian Markov Random fields

2014-04-26 · Martin Slawski, Matthias Hein

Consider a random vector with finite second moments. If its precision matrix is an M-matrix, then all partial correlations are non-negative. If that random vector is additionally Gaussian, the corresponding Markov random…

Partial Information Decomposition via Normalizing Flows in Latent Gaussian Distributions

2025-10-06 · Wenyuan Zhao, Adithya Balachandran, Chao Tian, Paul Pu Liang arxiv

The study of multimodality has garnered significant interest in fields where the analysis of interactions among multiple information sources can enhance predictive modeling, data fusion, and interpretability. Partial inf…

Computational Efficiency

Image Restoration Using Conditional Random Fields and Scale Mixtures of Gaussians

2018-07-09 · Milad Niknejad, Jose M. Bioucas-Dias, Mario A. T. Figueiredo

This paper proposes a general framework for internal patch-based image restoration based on Conditional Random Fields (CRF). Unlike related models based on Markov Random Fields (MRF), our approach explicitly formulates t…

DenoisingImage DenoisingImage Restoration

Scalable Parallel Factorizations of SDD Matrices and Efficient Sampling for Gaussian Graphical Models

2014-10-20 · Dehua Cheng, Yu Cheng, Yan Liu, Richard Peng 외

Motivated by a sampling problem basic to computational statistical inference, we develop a nearly optimal algorithm for a fundamental problem in spectral graph theory and numerical analysis. Given an $n\times n$ SDDM mat…