paper-with-me

Papers

Robust Partially-Compressed Least-Squares

2015-10-16 · Stephen Becker, Ban Kawas, Marek Petrik, Karthikeyan N. Ramamurthy

Randomized matrix compression techniques, such as the Johnson-Lindenstrauss transform, have emerged as an effective and practical way for solving large-scale problems efficiently. With a focus on computational efficiency, however, forsaking solutions quality and accuracy becomes the trade-off. In this paper, we investigate compressed least-squares problems and propose new models and algorithms that address the issue of error and noise introduced by compression. While maintaining computational efficiency, our models provide robust solutions that are more accurate--relative to solutions of uncompressed least-squares--than those of classical compressed variants. We introduce tools from robust optimization together with a form of partial compression to improve the error-time trade-offs of compressed least-squares solvers. We develop an efficient solution algorithm for our Robust Partially-Compressed (RPC) model based on a reduction to a one-dimensional search. We also derive the first approximation error bounds for Partially-Compressed least-squares solutions. Empirical results comparing numerous alternatives suggest that robust and partially compressed solutions are effectively insulated against aggressive randomized transforms.

📄 PDF Abstract BibTeX arXiv:1510.04905

Code (0)

등록된 구현이 없습니다.

Tasks

Computational Efficiency

Similar Papers 제목 키워드 기반

Compressed Least-Squares Regression

2009-12-01 · NeurIPS 2009 12 · Odalric Maillard, Rémi Munos

We consider the problem of learning, from K input data, a regression function in a function space of high dimension N using projections onto a random subspace of lower dimension M. From any linear approximation algorithm…

regression

A Compressed Sensing Based Least Squares Approach to Semi-supervised Local Cluster Extraction

2022-02-07 · Ming-Jun Lai, Zhaiming Shen

A least squares semi-supervised local clustering algorithm based on the idea of compressed sensing is proposed to extract clusters from a graph with known adjacency matrix. The algorithm is based on a two-stage approach …

Clusteringcompressed sensingStochastic Block Model

Fast Sparse Least-Squares Regression with Non-Asymptotic Guarantees

2015-07-18 · Tianbao Yang, Lijun Zhang, Qihang Lin, Rong Jin

In this paper, we study a fast approximation method for {\it large-scale high-dimensional} sparse least-squares regression problem by exploiting the Johnson-Lindenstrauss (JL) transforms, which embed a set of high-dimens…

regression

Learning Linear Dynamical Systems with Semi-Parametric Least Squares

2019-02-02 · Max Simchowitz, Ross Boczar, Benjamin Recht

We analyze a simple prefiltered variation of the least squares estimator for the problem of estimation with biased, semi-parametric noise, an error model studied more broadly in causal statistics and active learning. We …

Active Learning

On Asymptotic Linear Convergence of Projected Gradient Descent for Constrained Least Squares

2021-12-22 · Trung Vu, Raviv Raich

Many recent problems in signal processing and machine learning such as compressed sensing, image restoration, matrix/tensor recovery, and non-negative matrix factorization can be cast as constrained optimization. Project…

compressed sensingImage RestorationMatrix Completion