paper-with-me

Papers

T-LoHo: A Bayesian Regularization Model for Structured Sparsity and Smoothness on Graphs

2021-07-06 · NeurIPS 2021 12 · Changwoo J. Lee, Zhao Tang Luo, Huiyan Sang

Graphs have been commonly used to represent complex data structures. In models dealing with graph-structured data, multivariate parameters may not only exhibit sparse patterns but have structured sparsity and smoothness in the sense that both zero and non-zero parameters tend to cluster together. We propose a new prior for high-dimensional parameters with graphical relations, referred to as the Tree-based Low-rank Horseshoe (T-LoHo) model, that generalizes the popular univariate Bayesian horseshoe shrinkage prior to the multivariate setting to detect structured sparsity and smoothness simultaneously. The T-LoHo prior can be embedded in many high-dimensional hierarchical models. To illustrate its utility, we apply it to regularize a Bayesian high-dimensional regression problem where the regression coefficients are linked by a graph, so that the resulting clusters have flexible shapes and satisfy the cluster contiguity constraint with respect to the graph. We design an efficient Markov chain Monte Carlo algorithm that delivers full Bayesian inference with uncertainty measures for model parameters such as the number of clusters. We offer theoretical investigations of the clustering effects and posterior concentration results. Finally, we illustrate the performance of the model with simulation studies and a real data application for anomaly detection on a road network. The results indicate substantial improvements over other competing methods such as the sparse fused lasso.

📄 PDF Abstract BibTeX arXiv:2107.02510

Code (1)

changwoo-lee/TLOHO 공식 구현

Tasks

Anomaly DetectionBayesian Inferenceregression

Similar Papers 제목 키워드 기반

Posterior Concentration for Sparse Deep Learning

2018-03-24 · NeurIPS 2018 12 · Nicholas Polson, Veronika Rockova

Spike-and-Slab Deep Learning (SS-DL) is a fully Bayesian alternative to Dropout for improving generalizability of deep ReLU networks. This new type of regularization enables provable recovery of smooth input-output maps …

Deep Learning

Likelihood-guided Regularization in Attention Based Models

2025-11-17 · Mohamed Salem, Inyoung Kim arxiv

The transformer architecture has demonstrated strong performance in classification tasks involving structured and high-dimensional data. However, its success often hinges on large- scale training data and careful regular…

Fast learning rate of multiple kernel learning: Trade-off between sparsity and smoothness

2012-03-02 · Taiji Suzuki, Masashi Sugiyama

We investigate the learning rate of multiple kernel learning (MKL) with $\ell_1$ and elastic-net regularizations. The elastic-net regularization is a composition of an $\ell_1$-regularizer for inducing the sparsity and a…

Structured Bayesian Pruning via Log-Normal Multiplicative Noise

2017-05-20 · NeurIPS 2017 12 · Kirill Neklyudov, Dmitry Molchanov, Arsenii Ashukha, Dmitry Vetrov

Dropout-based regularization methods can be regarded as injecting random noise with pre-defined magnitude to different parts of the neural network during training. It was recently shown that Bayesian dropout procedure no…

LOHO: Latent Optimization of Hairstyles via Orthogonalization

2021-03-05 · CVPR 2021 1 · Rohit Saha, Brendan Duke, Florian Shkurti, Graham W. Taylor 외

Hairstyle transfer is challenging due to hair structure differences in the source and target hair. Therefore, we propose Latent Optimization of Hairstyles via Orthogonalization (LOHO), an optimization-based approach usin…

SSIM