paper-with-me

Papers

Learning Multiresolution Matrix Factorization and its Wavelet Networks on Graphs

2021-11-02 · Truong Son Hy, Risi Kondor

Multiresolution Matrix Factorization (MMF) is unusual amongst fast matrix factorization algorithms in that it does not make a low rank assumption. This makes MMF especially well suited to modeling certain types of graphs with complex multiscale or hierarchical strucutre. While MMF promises to yields a useful wavelet basis, finding the factorization itself is hard, and existing greedy methods tend to be brittle. In this paper we propose a learnable version of MMF that carfully optimizes the factorization with a combination of reinforcement learning and Stiefel manifold optimization through backpropagating errors. We show that the resulting wavelet basis far outperforms prior MMF algorithms and provides the first version of this type of factorization that can be robustly deployed on standard learning tasks.

📄 PDF Abstract BibTeX arXiv:2111.01940

Code (2)

risilab/Learnable_MMF 공식 구현 pytorch
hysonlab/learnmmf pytorch

Tasks

Reinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Learning to Solve Multiresolution Matrix Factorization by Manifold Optimization and Evolutionary Metaheuristics

2024-06-01 · Truong Son Hy, Thieu Khang, Risi Kondor

Multiresolution Matrix Factorization (MMF) is unusual amongst fast matrix factorization algorithms in that it does not make a low rank assumption. This makes MMF especially well suited to modeling certain types of graphs…

Evolutionary AlgorithmsNode Classification

Parallel MMF: a Multiresolution Approach to Matrix Computation

2015-07-15 · Risi Kondor, Nedelina Teneva, Pramod K. Mudrakarta

Multiresolution Matrix Factorization (MMF) was recently introduced as a method for finding multiscale structure and defining wavelets on graphs/matrices. In this paper we derive pMMF, a parallel algorithm for computing t…

Asymmetric Multiresolution Matrix Factorization

2019-10-10 · Pramod Kaushik Mudrakarta, Shubhendu Trivedi, Risi Kondor

Multiresolution Matrix Factorization (MMF) was recently introduced as an alternative to the dominant low-rank paradigm in order to capture structure in matrices at multiple different scales. Using ideas from multiresolut…

Fast Temporal Wavelet Graph Neural Networks

2023-02-17 · Duc Thien Nguyen, Manh Duc Tuan Nguyen, Truong Son Hy, Risi Kondor

Spatio-temporal signals forecasting plays an important role in numerous domains, especially in neuroscience and transportation. The task is challenging due to the highly intricate spatial structure, as well as the non-li…

The Incremental Multiresolution Matrix Factorization Algorithm

2017-05-16 · CVPR 2017 7 · Vamsi K. Ithapu, Risi Kondor, Sterling C. Johnson, Vikas Singh

Multiresolution analysis and matrix factorization are foundational tools in computer vision. In this work, we study the interface between these two distinct topics and obtain techniques to uncover hierarchical block stru…