paper-with-me

Papers

Regularized Data Programming with Automated Bayesian Prior Selection

2022-10-17 · Jacqueline R. M. A. Maasch, Hao Zhang, Qian Yang, Fei Wang, Volodymyr Kuleshov

The cost of manual data labeling can be a significant obstacle in supervised learning. Data programming (DP) offers a weakly supervised solution for training dataset creation, wherein the outputs of user-defined programmatic labeling functions (LFs) are reconciled through unsupervised learning. However, DP can fail to outperform an unweighted majority vote in some scenarios, including low-data contexts. This work introduces a Bayesian extension of classical DP that mitigates failures of unsupervised learning by augmenting the DP objective with regularization terms. Regularized learning is achieved through maximum a posteriori estimation with informative priors. Majority vote is proposed as a proxy signal for automated prior parameter selection. Results suggest that regularized DP improves performance relative to maximum likelihood and majority voting, confers greater interpretability, and bolsters performance in low-data regimes.

📄 PDF Abstract BibTeX arXiv:2210.08677

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

LLM-BI: Towards Fully Automated Bayesian Inference with Large Language Models

2025-08-07 · Yongchao Huang arxiv

A significant barrier to the widespread adoption of Bayesian inference is the specification of prior distributions and likelihoods, which often requires specialized statistical expertise. This paper investigates the feas…

Bayesian Inference

Bayesian $l_0$-regularized Least Squares

2017-05-31 · Nicholas G. Polson, Lei Sun

Bayesian $l_0$-regularized least squares is a variable selection technique for high dimensional predictors. The challenge is optimizing a non-convex objective function via search over model space consisting of all possib…

Computational EfficiencyVariable Selection

Automating Model Comparison in Factor Graphs

2023-06-09 · Bart van Erp, Wouter W. L. Nuijten, Thijs van de Laar, Bert de Vries

Bayesian state and parameter estimation have been automated effectively in a variety of probabilistic programming languages. The process of model comparison on the other hand, which still requires error-prone and time-co…

modelparameter estimationProbabilistic Programming

Approximating a Laplacian Prior for Joint State and Model Estimation within an UKF

2022-11-21 · Ricarda-Samantha Götte, Julia Timmermann

A major challenge in state estimation with model-based observers are low-quality models that lack of relevant dynamics. We address this issue by simultaneously estimating the system's states and its model uncertainties b…

State Estimation

A Factor Graph Approach to Automated Design of Bayesian Signal Processing Algorithms

2018-11-08 · Marco Cox, Thijs van de Laar, Bert de Vries

The benefits of automating design cycles for Bayesian inference-based algorithms are becoming increasingly recognized by the machine learning community. As a result, interest in probabilistic programming frameworks has m…

Bayesian Inferenceparameter estimationProbabilistic ProgrammingState Space Models+1