paper-with-me

Papers

The Incremental Multiresolution Matrix Factorization Algorithm

2017-05-16 · CVPR 2017 7 · Vamsi K. Ithapu, Risi Kondor, Sterling C. Johnson, Vikas Singh

Multiresolution analysis and matrix factorization are foundational tools in computer vision. In this work, we study the interface between these two distinct topics and obtain techniques to uncover hierarchical block structure in symmetric matrices -- an important aspect in the success of many vision problems. Our new algorithm, the incremental multiresolution matrix factorization, uncovers such structure one feature at a time, and hence scales well to large matrices. We describe how this multiscale analysis goes much farther than what a direct global factorization of the data can identify. We evaluate the efficacy of the resulting factorizations for relative leveraging within regression tasks using medical imaging data. We also use the factorization on representations learned by popular deep networks, providing evidence of their ability to infer semantic relationships even when they are not explicitly trained to do so. We show that this algorithm can be used as an exploratory tool to improve the network architecture, and within numerous other settings in vision.

📄 PDF Abstract BibTeX arXiv:1705.05804

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Learning Multiresolution Matrix Factorization and its Wavelet Networks on Graphs

2021-11-02 · Truong Son Hy, Risi Kondor

Multiresolution Matrix Factorization (MMF) is unusual amongst fast matrix factorization algorithms in that it does not make a low rank assumption. This makes MMF especially well suited to modeling certain types of graphs…

Reinforcement Learning (RL)

Parallel MMF: a Multiresolution Approach to Matrix Computation

2015-07-15 · Risi Kondor, Nedelina Teneva, Pramod K. Mudrakarta

Multiresolution Matrix Factorization (MMF) was recently introduced as a method for finding multiscale structure and defining wavelets on graphs/matrices. In this paper we derive pMMF, a parallel algorithm for computing t…

Learning to Solve Multiresolution Matrix Factorization by Manifold Optimization and Evolutionary Metaheuristics

2024-06-01 · Truong Son Hy, Thieu Khang, Risi Kondor

Multiresolution Matrix Factorization (MMF) is unusual amongst fast matrix factorization algorithms in that it does not make a low rank assumption. This makes MMF especially well suited to modeling certain types of graphs…

Evolutionary AlgorithmsNode Classification

Asymmetric Multiresolution Matrix Factorization

2019-10-10 · Pramod Kaushik Mudrakarta, Shubhendu Trivedi, Risi Kondor

Multiresolution Matrix Factorization (MMF) was recently introduced as an alternative to the dominant low-rank paradigm in order to capture structure in matrices at multiple different scales. Using ideas from multiresolut…

Understanding Incremental Learning with Closed-form Solution to Gradient Flow on Overparamerterized Matrix Factorization

2025-08-28 · Hancheng Min, René Vidal arxiv

Many theoretical studies on neural networks attribute their excellent empirical performance to the implicit bias or regularization induced by first-order optimization algorithms when training networks under certain initi…

Incremental Learning