paper-with-me

Papers

CoreFlow: Low-Rank Matrix Generative Models

2026-04-27 · Dongze Wu, Linglingzhi Zhu, Yao Xie arxiv

Learning matrix-valued distributions from high-dimensional and possibly incomplete training data is challenging: ambient-space generative modeling is computationally expensive and statistically fragile when the matrix dimension is large but the sample size is limited. We propose CoreFlow, a geometry-preserving low-rank flow model that learns shared row/column subspaces across the matrix distribution, and then trains a continuous normalizing flow only on the induced low-dimensional core. CoreFlow is designed for settings where shared low-rank matrix geometry is present, especially in high-dimensional limited-sample regimes. This separates shared matrix geometry from sample-specific variation, preserves matrix structure, and substantially improves training efficiency. The same framework also handles incomplete training matrices through masked Riemannian updates and iterative completion. Across real and synthetic benchmarks, CoreFlow substantially improves spectral and moment-level generation quality in few-sample regimes while remaining competitive in data-rich settings, even under compression to 9% of the ambient dimension and with up to 40% missing training entries.

📄 PDF Abstract BibTeX arXiv:2604.24959

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

ScoreFlow: Mastering LLM Agent Workflows via Score-based Preference Optimization

2025-02-06 · Yinjie Wang, Ling Yang, Guohao Li, Mengdi Wang 외

Recent research has leveraged large language model multi-agent systems for complex problem-solving while trying to reduce the manual effort required to build them, driving the development of automated agent workflow opti…

Language ModelingLanguage ModellingLarge Language ModelMathematical Reasoning+1

Nonasymptotic Guarantees for Spiked Matrix Recovery with Generative Priors

2020-06-14 · NeurIPS 2020 12 · Jorio Cocola, Paul Hand, Vladislav Voroninski

Many problems in statistics and machine learning require the reconstruction of a rank-one signal matrix from noisy data. Enforcing additional prior information on the rank-one component is often key to guaranteeing good …

global-optimization

Low-rank Tensor Assisted K-space Generative Model for Parallel Imaging Reconstruction

2022-12-11 · Wei zhang, Zengwei Xiao, Hui Tao, Minghui Zhang 외

Although recent deep learning methods, especially generative models, have shown good performance in fast magnetic resonance imaging, there is still much room for improvement in high-dimensional generation. Considering th…

Why are Big Data Matrices Approximately Low Rank?

2017-05-21 · Madeleine Udell, Alex Townsend

Matrices of (approximate) low rank are pervasive in data science, appearing in recommender systems, movie preferences, topic models, medical records, and genomics. While there is a vast literature on how to exploit low r…

Recommendation SystemsTopic Models

Nonlinearity as Rank: Generative Low-Rank Adapter with Radial Basis Functions

2026-02-05 · Yihao Ouyang, Shiwei Li, Haozhao Wang, Xiandi Luo 외 arxiv

Low-rank adaptation (LoRA) approximates the update of a pretrained weight matrix using the product of two low-rank matrices. However, standard LoRA follows an explicit-rank paradigm, where increasing model capacity requi…