paper-with-me

홈 › Papers

Generalized Linear Rule Models

2019-06-05 · Dennis Wei, Sanjeeb Dash, Tian Gao, Oktay Günlük

This paper considers generalized linear models using rule-based features, also referred to as rule ensembles, for regression and probabilistic classification. Rules facilitate model interpretation while also capturing nonlinear dependences and interactions. Our problem formulation accordingly trades off rule set complexity and prediction accuracy. Column generation is used to optimize over an exponentially large space of rules without pre-generating a large subset of candidates or greedily boosting rules one by one. The column generation subproblem is solved using either integer programming or a heuristic optimizing the same objective. In experiments involving logistic and linear regression, the proposed methods obtain better accuracy-complexity trade-offs than existing rule ensemble algorithms. At one end of the trade-off, the methods are competitive with less interpretable benchmark models.

📄 PDF Abstract BibTeX arXiv:1906.01761

Code (0)

등록된 구현이 없습니다.

Tasks

General Classificationregression

Similar Papers 제목 키워드 기반

Tensor decomposition of higher-order correlations by nonlinear Hebbian plasticity

2021-06-29 · Gabriel Koch Ocker, Michael A. Buice

Biological synaptic plasticity exhibits nonlinearities that are not accounted for by classic Hebbian learning rules. Here, we introduce a simple family of generalized nonlinear Hebbian learning rules. We study the comput…

Tensor Decomposition

Tensor decompositions of higher-order correlations by nonlinear Hebbian plasticity

2021-12-01 · NeurIPS 2021 12 · Gabriel Ocker, Michael Buice

Biological synaptic plasticity exhibits nonlinearities that are not accounted for by classic Hebbian learning rules. Here, we introduce a simple family of generalized nonlinear Hebbian learning rules. We study the comput…

Tensor decompositions of higher-order correlations by nonlinear Hebbian plasticity

2021-05-21 · NeurIPS 2021 12 · Gabriel Koch Ocker, Michael A Buice

Biological synaptic plasticity exhibits nonlinearities that are not accounted for by classic Hebbian learning rules. Here, we introduce a simple family of generalized nonlinear Hebbian learning rules. We study the comput…

When Is Generalized Bayes Bayesian? A Decision-Theoretic Characterization of Loss-Based Updating

2026-02-02 · Kenichiro McAlinn, Kōsaku Takanashi arxiv

Loss-based updating, including generalized Bayes, Gibbs, and quasi-posteriors, replaces likelihoods by a user-chosen loss and produces a posterior-like distribution via exponential tilt. We give a decision-theoretic char…

Exact gradients for linear optics with single photons

2024-09-24 · Giorgio Facelli, David D. Roberts, Hugo Wallner, Alexander Makarovskiy 외

Though parameter shift rules have drastically improved gradient estimation methods for several types of quantum circuits, leading to improved performance in downstream tasks, so far they have not been transferable to lin…