paper-with-me

홈 › Papers

Block based refitting in $\ell_{12}$ sparse regularisation

2019-10-22 · Charles-Alban Deledalle, Nicolas Papadakis, Joseph Salmon, Samuel Vaiter

In many linear regression problems, including ill-posed inverse problems in image restoration, the data exhibit some sparse structures that can be used to regularize the inversion. To this end, a classical path is to use $\ell_{12}$ block based regularization. While efficient at retrieving the inherent sparsity patterns of the data -- the support -- the estimated solutions are known to suffer from a systematical bias. We propose a general framework for removing this artifact by refitting the solution towards the data while preserving key features of its structure such as the support. This is done through the use of refitting block penalties that only act on the support of the estimated solution. Based on an analysis of related works in the literature, we introduce a new penalty that is well suited for refitting purposes. We also present a new algorithm to obtain the refitted solution along with the original (biased) solution for any convex refitting block penalty. Experiments illustrate the good behavior of the proposed block penalty for refitting solutions of Total Variation and Total GeneralizedVariation models.

📄 PDF Abstract BibTeX arXiv:1910.11186

Code (0)

등록된 구현이 없습니다.

Tasks

Image Restoration

Similar Papers 제목 키워드 기반

Wild refitting for black box prediction

2025-06-26 · Martin J. Wainwright

We describe and analyze a computionally efficient refitting procedure for computing high-probability upper bounds on the instance-wise mean-squared prediction error of penalized nonparametric estimates based on least-squ…

Image RestorationPrediction

Bayesian Inference in Sparse Gaussian Graphical Models

2013-09-27 · Peter Orchard, Felix Agakov, Amos Storkey

One of the fundamental tasks of science is to find explainable relationships between observed phenomena. One approach to this task that has received attention in recent years is based on probabilistic graphical modelling…

Bayesian Inference

Efficient Sparse Training with Structured Dropout

2024-11-02 · Andy Lo

Dropout is a common regularisation technique in deep learning that improves generalisation. Even though it introduces sparsity and thus potential for higher throughput, it usually cannot bring speed-ups on GPUs due to it…

Interleaved Resampling and Refitting: Data and Compute-Efficient Evaluation of Black-Box Predictors

2026-03-15 · Haichen Hu, David Simchi-Levi arxiv

We study the problem of evaluating the excess risk of large-scale empirical risk minimization under the square loss. Leveraging the idea of wild refitting and resampling, we assume only black-box access to the training a…

(S)GD over Diagonal Linear Networks: Implicit Regularisation, Large Stepsizes and Edge of Stability

2023-02-17 · Mathieu Even, Scott Pesme, Suriya Gunasekar, Nicolas Flammarion

In this paper, we investigate the impact of stochasticity and large stepsizes on the implicit regularisation of gradient descent (GD) and stochastic gradient descent (SGD) over diagonal linear networks. We prove the conv…

regression