paper-with-me

Papers

Feature selection and multi-kernel learning for adaptive graph regularized nonnegative matrix factorization

2014-09-20 · Elsevier Ltd 2014 9 · Jim Jing-Yan Wang, Jianhua Z. Huang, Yijun Sun, Xin Gao

Nonnegative matrix factorization (NMF), a popular part-based representation technique, does not capture the intrinsic local geometric structure of the data space. Graph regularized NMF (GNMF) was recently proposed to avoid this limitation by regularizing NMF with a nearest neighbor graph constructed from the input data set. However, GNMF has two main bottlenecks. First, using the original feature space directly to construct the graph is not necessarily optimal because of the noisy and irrelevant features and nonlinear distributions of data samples. Second, one possible way to handle the nonlinear distribution of data samples is by kernel embedding. However, it is often difficult to choose the most suitable kernel. To solve these bottlenecks, we propose two novel graph-regularized NMF methods, AGNMFFS and AGNMFMK, by introducing feature selection and multiple-kernel learning to the graph regularized NMF, respectively. Instead of using a fixed graph as in GNMF, the two proposed methods learn the nearest neighbor graph that is adaptive to the selected features and learned multiple kernels, respectively. For each method, we propose a unified objective function to conduct feature selection/multi-kernel learning, NMF and adaptive graph regularization simultaneously. We further develop two iterative algorithms to solve the two optimization problems. Experimental results on two challenging pattern classification tasks demonstrate that the proposed methods significantly outperform state-of-the-art data representation methods.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

feature selection

Similar Papers 제목 키워드 기반

Kernel Alignment-based Multi-view Unsupervised Feature Selection with Sample-level Adaptive Graph Learning

2026-01-12 · Yalan Tan, Yanyong Huang, Zongxin Shen, Dongjie Wang 외 arxiv

Although multi-view unsupervised feature selection (MUFS) has demonstrated success in dimensionality reduction for unlabeled multi-view data, most existing methods reduce feature redundancy by focusing on linear correlat…

Dimensionality ReductionGraph Learning

Multi-Relation Graph-Kernel Strengthen Network for Graph-Level Clustering

2025-04-02 · Renda Han, Guangzhen Yao, Wenxin Zhang, Yu Li 외

Graph-level clustering is a fundamental task of data mining, aiming at dividing unlabeled graphs into distinct groups. However, existing deep methods that are limited by pooling have difficulty extracting diverse and com…

ClusteringGraph SimilarityRelation

Beta Process Multiple Kernel Learning

2014-06-01 · CVPR 2014 6 · Bingbing Ni, Teng Li, Pierre Moulin

In kernel based learning, the kernel trick transforms the original representation of a feature instance into a vector of similarities with the training feature instances, known as kernel representation. However, feature …

Variational Inference

Learning manifold to regularize nonnegative matrix factorization

2014-10-03 · Jim Jing-Yan Wang, Xin Gao

Inthischapterwediscusshowtolearnanoptimalmanifoldpresentationto regularize nonegative matrix factorization (NMF) for data representation problems. NMF,whichtriestorepresentanonnegativedatamatrixasaproductoftwolowrank non…

feature selectiongraph constructionGraph LearningModel Selection

Adaptive Multi-Neighborhood Attention based Transformer for Graph Representation Learning

2022-11-15 · Gaichao Li, Jinsong Chen, Kun He

By incorporating the graph structural information into Transformers, graph Transformers have exhibited promising performance for graph representation learning in recent years. Existing graph Transformers leverage specifi…

Graph Representation LearningRepresentation Learning