paper-with-me

홈 › Papers

Partitioned Least Squares

2020-06-29 · Roberto Esposito, Mattia Cerrato, Marco Locatelli

In this paper we propose a variant of the linear least squares model allowing practitioners to partition the input features into groups of variables that they require to contribute similarly to the final result. The output allows practitioners to assess the importance of each group and of each variable in the group. We formally show that the new formulation is not convex and provide two alternative methods to deal with the problem: one non-exact method based on an alternating least squares approach; and one exact method based on a reformulation of the problem using an exponential number of sub-problems whose minimum is guaranteed to be the optimal solution. We formally show the correctness of the exact method and also compare the two solutions showing that the exact solution provides better results in a fraction of the time required by the alternating least squares solution (assuming that the number of partitions is small). For the sake of completeness, we also provide an alternative branch and bound algorithm that can be used in place of the exact method when the number of partitions is too large, and a proof of NP-completeness of the optimization problem introduced in this paper.

📄 PDF Abstract BibTeX arXiv:2006.16202

Code (2)

ml-unito/PartitionedLS 공식 구현
ml-unito/PartitionedLS-experiments-2 공식 구현

Similar Papers 제목 키워드 기반

PairNets: Novel Fast Shallow Artificial Neural Networks on Partitioned Subspaces

2020-01-24 · Luna M. Zhang

Traditionally, an artificial neural network (ANN) is trained slowly by a gradient descent algorithm such as the backpropagation algorithm since a large number of hyperparameters of the ANN need to be fine-tuned with many…

Hyperparameter Optimization

Partitioned Hankel-based Diffusion Models for Few-shot Low-dose CT Reconstruction

2024-05-27 · WenHao Zhang, Bin Huang, Shuyue Chen, Xiaoling Xu 외

Low-dose computed tomography (LDCT) plays a vital role in clinical applications by mitigating radiation risks. Nevertheless, reducing radiation doses significantly degrades image quality. Concurrently, common deep learni…

CT Reconstruction

Distributed Sketching on Data Partitions for OLS Regression

2026-07-08 · Luyuan Yang, Brayden Garner, Shayan Shafaei, Chao Lan arxiv

This paper studies distributed sketching for ordinary least squares (OLS) regression, an approach that distributes small sketches of a large data set over multiple machines to separately construct OLS estimators and aver…

On Soft Power Diagrams

2013-07-15 · Steffen Borgwardt

Many applications in data analysis begin with a set of points in a Euclidean space that is partitioned into clusters. Common tasks then are to devise a classifier deciding which of the clusters a new point is associated …

ClusteringOutlier Detection

Least Squares Auto-Tuning

2019-04-10 · Shane Barratt, Stephen Boyd

Least squares is by far the simplest and most commonly applied computational method in many fields. In almost all applications, the least squares objective is rarely the true objective. We account for this discrepancy by…