paper-with-me

Papers

Orthogonal NMF through Subspace Exploration

2015-12-01 · NeurIPS 2015 12 · Megasthenis Asteris, Dimitris Papailiopoulos, Alexandros G. Dimakis

Orthogonal Nonnegative Matrix Factorization {(ONMF)} aims to approximate a nonnegative matrix as the product of two $k$-dimensional nonnegative factors, one of which has orthonormal columns. It yields potentially useful data representations as superposition of disjoint parts, while it has been shown to work well for clustering tasks where traditional methods underperform. Existing algorithms rely mostly on heuristics, which despite their good empirical performance, lack provable performance guarantees.We present a new ONMF algorithm with provable approximation guarantees.For any constant dimension~$k$, we obtain an additive EPTAS without any assumptions on the input. Our algorithm relies on a novel approximation to the related Nonnegative Principal Component Analysis (NNPCA) problem; given an arbitrary data matrix, NNPCA seeks $k$ nonnegative components that jointly capture most of the variance. Our NNPCA algorithm is of independent interest and generalizes previous work that could only obtain guarantees for a single component. We evaluate our algorithms on several real and synthetic datasets and show that their performance matches or outperforms the state of the art.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Clustering

Similar Papers 제목 키워드 기반

Student Guides Teacher: Weak-to-Strong Inference via Spectral Orthogonal Exploration

2026-01-06 · Dayu Wang, Jiaye Yang, Weikang Li, Jiahui Liang 외 arxiv

Large Language Models (LLMs) often suffer from ''Reasoning Collapse'' on challenging mathematical reasoning tasks, where stochastic sampling produces lexical variations of the same erroneous logic rather than genuine sem…

Mathematical ReasoningCode Generation

Subspace orthogonalization as a mechanism for binding values to space

2022-05-13 · W. Jeffrey Johnston, Justin M. Fine, Seng Bum Michael Yoo, R. Becket Ebitz 외

When choosing between options, we must solve an important binding problem. The values of the options must be associated with information about the action needed to select them. We hypothesize that the brain solves this b…

LOFT: Low-Rank Orthogonal Fine-Tuning via Task-Aware Support Selection

2026-05-12 · Lanxin Zhao, Bamdev Mishra, Pratik Jawanpuria, Lequan Lin 외 arxiv

Orthogonal parameter-efficient fine-tuning (PEFT) adapts pretrained weights through structure-preserving multiplicative transformations, but existing methods often conflate two distinct design choices: the subspace in wh…

parameter-efficient fine-tuningMathematical Reasoning

Orthogonal Subspace Clustering: Enhancing High-Dimensional Data Analysis through Adaptive Dimensionality Reduction and Efficient Clustering

2026-03-16 · Qing-Yuan Wen, Da-Qing Zhang arxiv

This paper presents Orthogonal Subspace Clustering (OSC), an innovative method for high-dimensional data clustering. We first establish a theoretical theorem proving that high-dimensional data can be decomposed into orth…

Dimensionality Reduction

Non-local Meets Global: An Iterative Paradigm for Hyperspectral Image Restoration

2020-10-24 · wei he, Quanming Yao, Chao Li, Naoto Yokoya 외

Non-local low-rank tensor approximation has been developed as a state-of-the-art method for hyperspectral image (HSI) restoration, which includes the tasks of denoising, compressed HSI reconstruction and inpainting. Unfo…

DenoisingImage Restoration