paper-with-me

Papers

Kernel Alignment for Unsupervised Feature Selection via Matrix Factorization

2024-03-13 · Ziyuan Lin, Deanna Needell

By removing irrelevant and redundant features, feature selection aims to find a good representation of the original features. With the prevalence of unlabeled data, unsupervised feature selection has been proven effective in alleviating the so-called curse of dimensionality. Most existing matrix factorization-based unsupervised feature selection methods are built upon subspace learning, but they have limitations in capturing nonlinear structural information among features. It is well-known that kernel techniques can capture nonlinear structural information. In this paper, we construct a model by integrating kernel functions and kernel alignment, which can be equivalently characterized as a matrix factorization problem. However, such an extension raises another issue: the algorithm performance heavily depends on the choice of kernel, which is often unknown a priori. Therefore, we further propose a multiple kernel-based learning method. By doing so, our model can learn both linear and nonlinear similarity information and automatically generate the most appropriate kernel. Experimental analysis on real-world data demonstrates that the two proposed methods outperform other classic and state-of-the-art unsupervised feature selection methods in terms of clustering results and redundancy reduction in almost all datasets tested.

📄 PDF Abstract BibTeX arXiv:2403.14688

Code (0)

등록된 구현이 없습니다.

Tasks

feature selection

Methods 이 논문이 사용한 방법론

Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…

Similar Papers 제목 키워드 기반

Kernel Alignment-based Multi-view Unsupervised Feature Selection with Sample-level Adaptive Graph Learning

2026-01-12 · Yalan Tan, Yanyong Huang, Zongxin Shen, Dongjie Wang 외 arxiv

Although multi-view unsupervised feature selection (MUFS) has demonstrated success in dimensionality reduction for unlabeled multi-view data, most existing methods reduce feature redundancy by focusing on linear correlat…

Dimensionality ReductionGraph Learning

Multi-view Unsupervised Feature Selection by Cross-diffused Matrix Alignment

2017-05-02 · Xiaokai Wei, Bokai Cao, Philip S. Yu

Multi-view high-dimensional data become increasingly popular in the big data era. Feature selection is a useful technique for alleviating the curse of dimensionality in multi-view learning. In this paper, we study unsupe…

feature selectionMULTI-VIEW LEARNING

Robust Matrix Elastic Net based Canonical Correlation Analysis: An Effective Algorithm for Multi-View Unsupervised Learning

2017-11-14 · Peng-Bo Zhang, Zhi-Xin Yang

This paper presents a robust matrix elastic net based canonical correlation analysis (RMEN-CCA) for multiple view unsupervised learning problems, which emphasizes the combination of CCA and the robust matrix elastic net …

feature selection

Fairness-Aware Unsupervised Feature Selection

2021-06-04 · Xiaoying Xing, Hongfu Liu, Chen Chen, Jundong Li

Feature selection is a prevalent data preprocessing paradigm for various learning tasks. Due to the expensive cost of acquiring supervision information, unsupervised feature selection sparks great interests recently. How…

Fairnessfeature selection

Second-Order Unsupervised Feature Selection via Knowledge Contrastive Distillation

2021-09-29 · Han Yue, Jundong Li, Hongfu Liu

Unsupervised feature selection aims to select a subset from the original features that are most useful for the downstream tasks without external guidance information. While most unsupervised feature selection methods foc…

feature selection