paper-with-me

Papers

Bayesian sparse reconstruction: a brute-force approach to astronomical imaging and machine learning

2018-09-12 · Edward Higson, Will Handley, Michael Hobson, Anthony Lasenby

We present a principled Bayesian framework for signal reconstruction, in which the signal is modelled by basis functions whose number (and form, if required) is determined by the data themselves. This approach is based on a Bayesian interpretation of conventional sparse reconstruction and regularisation techniques, in which sparsity is imposed through priors via Bayesian model selection. We demonstrate our method for noisy 1- and 2-dimensional signals, including astronomical images. Furthermore, by using a product-space approach, the number and type of basis functions can be treated as integer parameters and their posterior distributions sampled directly. We show that order-of-magnitude increases in computational efficiency are possible from this technique compared to calculating the Bayesian evidences separately, and that further computational gains are possible using it in combination with dynamic nested sampling. Our approach can also be readily applied to neural networks, where it allows the network architecture to be determined by the data in a principled Bayesian manner by treating the number of nodes and hidden layers as parameters.

📄 PDF Abstract BibTeX arXiv:1809.04598

Code (1)

ejhigson/bsr 공식 구현

Tasks

BIG-bench Machine LearningComputational EfficiencyModel Selection

Similar Papers 제목 키워드 기반

Designing Biological Sequences via Meta-Reinforcement Learning and Bayesian Optimization

2022-09-13 · Leo Feng, Padideh Nouri, Aneri Muni, Yoshua Bengio 외

The ability to accelerate the design of biological sequences can have a substantial impact on the progress of the medical field. The problem can be framed as a global optimization problem where the objective is an expens…

Bayesian Optimizationglobal-optimizationMeta-LearningMeta Reinforcement Learning+3

Reconstruction of Sparse Circuits Using Multi-neuronal Excitation (RESCUME)

2009-12-01 · NeurIPS 2009 12 · Tao Hu, Anthony Leonardo, Dmitri B. Chklovskii

One of the central problems in neuroscience is reconstructing synaptic connectivity in neural circuits. Synapses onto a neuron can be probed by sequentially stimulating potentially pre-synaptic neurons while monitoring t…

Compressive Sensing

A self-adapting super-resolution structures framework for automatic design of GAN

2021-06-10 · Yibo Guo, Haidi Wang, Yiming Fan, Shunyao Li 외

With the development of deep learning, the single super-resolution image reconstruction network models are becoming more and more complex. Small changes in hyperparameters of the models have a greater impact on model per…

Bayesian OptimizationGenerative Adversarial NetworkImage ReconstructionSuper-Resolution

Bayesian Deconvolution of Astronomical Images with Diffusion Models: Quantifying Prior-Driven Features in Reconstructions

2024-11-28 · Alessio Spagnoletti, Alexandre Boucaud, Marc Huertas-Company, Wassim Kabalan 외

Deconvolution of astronomical images is a key aspect of recovering the intrinsic properties of celestial objects, especially when considering ground-based observations. This paper explores the use of diffusion models (DM…

The Fine-Grained Hardness of Sparse Linear Regression

2021-06-06 · Aparna Gupte, Vinod Vaikuntanathan

Sparse linear regression is the well-studied inference problem where one is given a design matrix $\mathbf{A} \in \mathbb{R}^{M\times N}$ and a response vector $\mathbf{b} \in \mathbb{R}^M$, and the goal is to find a sol…

regression