paper-with-me

Papers

A Stochastic Variance-Reduced Coordinate Descent Algorithm for Learning Sparse Bayesian Network from Discrete High-Dimensional Data

2021-08-21 · Nazanin Shajoonnezhad, Amin Nikanjam

This paper addresses the problem of learning a sparse structure Bayesian network from high-dimensional discrete data. Compared to continuous Bayesian networks, learning a discrete Bayesian network is a challenging problem due to the large parameter space. Although many approaches have been developed for learning continuous Bayesian networks, few approaches have been proposed for the discrete ones. In this paper, we address learning Bayesian networks as an optimization problem and propose a score function which guarantees the learnt structure to be a sparse directed acyclic graph. Besides, we implement a block-wised stochastic coordinate descent algorithm to optimize the score function. Specifically, we use a variance reducing method in our optimization algorithm to make the algorithm work efficiently for high-dimensional data. The proposed approach is applied to synthetic data from well-known benchmark networks. The quality, scalability, and robustness of the constructed network are measured. Compared to some competitive approaches, the results reveal that our algorithm outperforms some of the well-known proposed methods.

📄 PDF Abstract BibTeX arXiv:2108.09501

Code (1)

nshajoon/svrcd-algorithm 공식 구현

Similar Papers 제목 키워드 기반

Variance Reduced Coordinate Descent with Acceleration: New Method With a Surprising Application to Finite-Sum Problems

2020-02-11 · ICML 2020 1 · Filip Hanzely, Dmitry Kovalev, Peter Richtarik

We propose an accelerated version of stochastic variance reduced coordinate descent -- ASVRCD. As other variance reduced coordinate descent methods such as SEGA or SVRCD, our method can deal with problems that include a …

Accelerating Stochastic Gradient Descent using Predictive Variance Reduction

2013-12-01 · NeurIPS 2013 12 · Rie Johnson, Tong Zhang

Stochastic gradient descent is popular for large scale optimization but has slow convergence asymptotically due to the inherent variance. To remedy this problem, we introduce an explicit variance reduction method for sto…

Structured Prediction

Unified Analysis of Stochastic Gradient Methods for Composite Convex and Smooth Optimization

2020-06-20 · Ahmed Khaled, Othmane Sebbouh, Nicolas Loizou, Robert M. Gower 외

We present a unified theorem for the convergence analysis of stochastic gradient algorithms for minimizing a smooth and convex loss plus a convex regularizer. We do this by extending the unified analysis of Gorbunov, Han…

Quantization

A Unified Theory of SGD: Variance Reduction, Sampling, Quantization and Coordinate Descent

2019-05-27 · Eduard Gorbunov, Filip Hanzely, Peter Richtárik

In this paper we introduce a unified analysis of a large family of variants of proximal stochastic gradient descent ({\tt SGD}) which so far have required different intuitions, convergence analyses, have different applic…

Quantization

Variance Reduced Stochastic Proximal Algorithm for AUC Maximization

2019-11-08 · Soham Dan, Dushyant Sahoo

Stochastic Gradient Descent has been widely studied with classification accuracy as a performance measure. However, these stochastic algorithms cannot be directly used when non-decomposable pairwise performance measures …