paper-with-me

홈 › Papers

Convex-constrained Sparse Additive Modeling and Its Extensions

2017-05-01 · Junming Yin, Yao-Liang Yu

Sparse additive modeling is a class of effective methods for performing high-dimensional nonparametric regression. In this work we show how shape constraints such as convexity/concavity and their extensions, can be integrated into additive models. The proposed sparse difference of convex additive models (SDCAM) can estimate most continuous functions without any a priori smoothness assumption. Motivated by a characterization of difference of convex functions, our method incorporates a natural regularization functional to avoid overfitting and to reduce model complexity. Computationally, we develop an efficient backfitting algorithm with linear per-iteration complexity. Experiments on both synthetic and real data verify that our method is competitive against state-of-the-art sparse additive models, with improved performance in most scenarios.

📄 PDF Abstract BibTeX arXiv:1705.00687

Code (0)

등록된 구현이 없습니다.

Tasks

Additive modelsregression

Similar Papers 제목 키워드 기반

Convexification of Learning from Constraints

2016-02-22 · Iaroslav Shcherbatyi, Bjoern Andres

Regularized empirical risk minimization with constrained labels (in contrast to fixed labels) is a remarkably general abstraction of learning. For common loss and regularization functions, this optimization problem assum…

Form

MahNMF: Manhattan Non-negative Matrix Factorization

2012-07-14 · Naiyang Guan, DaCheng Tao, Zhigang Luo, John Shawe-Taylor

Non-negative matrix factorization (NMF) approximates a non-negative matrix $X$ by a product of two non-negative low-rank factor matrices $W$ and $H$. NMF and its extensions minimize either the Kullback-Leibler divergence…

Group selection and shrinkage: Structured sparsity for semiparametric additive models

2021-05-25 · Ryan Thompson, Farshid Vahid

Sparse regression and classification estimators that respect group structures have application to an assortment of statistical and machine learning problems, from multitask learning to sparse additive modeling to hierarc…

Additive modelsregression

Slack and Margin Rescaling as Convex Extensions of Supermodular Functions

2016-06-19 · Matthew B. Blaschko

Slack and margin rescaling are variants of the structured output SVM, which is frequently applied to problems in computer vision such as image segmentation, object localization, and learning parts based object models. Th…

Image SegmentationObject LocalizationSemantic SegmentationStructured Prediction

Sparsity Is Necessary: Polynomial-Time Stability for Agentic LLMs in Large Action Spaces

2026-01-13 · Angshul Majumdar arxiv

Tool-augmented LLM systems expose a control regime that learning theory has largely ignored: sequential decision-making with a massive discrete action universe (tools, APIs, documents) in which only a small, unknown subs…