paper-with-me

홈 › Papers

Near-Optimal Algorithms for Linear Algebra in the Current Matrix Multiplication Time

2021-07-16 · Nadiia Chepurko, Kenneth L. Clarkson, Praneeth Kacham, David P. Woodruff

In the numerical linear algebra community, it was suggested that to obtain nearly optimal bounds for various problems such as rank computation, finding a maximal linearly independent subset of columns (a basis), regression, or low-rank approximation, a natural way would be to resolve the main open question of Nelson and Nguyen (FOCS, 2013). This question is regarding the logarithmic factors in the sketching dimension of existing oblivious subspace embeddings that achieve constant-factor approximation. We show how to bypass this question using a refined sketching technique, and obtain optimal or nearly optimal bounds for these problems. A key technique we use is an explicit mapping of Indyk based on uncertainty principles and extractors, which after first applying known oblivious subspace embeddings, allows us to quickly spread out the mass of the vector so that sampling is now effective. We thereby avoid a logarithmic factor in the sketching dimension that is standard in bounds proven using the matrix Chernoff inequality. For the fundamental problems of rank computation and finding a basis, our algorithms improve Cheung, Kwok, and Lau (JACM, 2013), and are optimal to within a constant factor and a poly(log log(n))-factor, respectively. Further, for constant-factor regression and low-rank approximation we give the first optimal algorithms, for the current matrix multiplication exponent.

📄 PDF Abstract BibTeX arXiv:2107.08090

Code (0)

등록된 구현이 없습니다.

Tasks

Open-Ended Question Answeringregression

Similar Papers 제목 키워드 기반

Scheduling optimization of parallel linear algebra algorithms using Supervised Learning

2019-09-09 · G. Laberge, S. Shirzad, P. Diehl, H. Kaiser 외

Linear algebra algorithms are used widely in a variety of domains, e.g machine learning, numerical physics and video games graphics. For all these applications, loop-level parallelism is required to achieve high performa…

Scheduling

Variational quantum and neural quantum states algorithms for the linear complementarity problem

2025-04-10 · Saibal De, Oliver Knitter, Rohan Kodati, Paramsothy Jayakumar 외

Variational quantum algorithms (VQAs) are promising hybrid quantum-classical methods designed to leverage the computational advantages of quantum computing while mitigating the limitations of current noisy intermediate-s…

CoLA: Exploiting Compositional Structure for Automatic and Efficient Numerical Linear Algebra

2023-09-06 · NeurIPS 2023 11 · Andres Potapczynski, Marc Finzi, Geoff Pleiss, Andrew Gordon Wilson

Many areas of machine learning and science involve large linear algebra problems, such as eigendecompositions, solving linear systems, computing matrix exponentials, and trace estimation. The matrices involved often have…

CoLAGaussian ProcessesGPU

Determinantal Point Processes in Randomized Numerical Linear Algebra

2020-05-07 · Michał Dereziński, Michael W. Mahoney

Randomized Numerical Linear Algebra (RandNLA) uses randomness to develop improved algorithms for matrix problems that arise in scientific computing, data science, machine learning, etc. Determinantal Point Processes (DPP…

Point Processes

Benchmarking the Linear Algebra Awareness of TensorFlow and PyTorch

2022-02-20 · Aravind Sankaran, Navid Akbari Alashti, Christos Psarras, Paolo Bientinesi

Linear algebra operations, which are ubiquitous in machine learning, form major performance bottlenecks. The High-Performance Computing community invests significant effort in the development of architecture-specific opt…

Benchmarking