paper-with-me

홈 › Papers

Embedded Multi-label Feature Selection via Orthogonal Regression

2024-03-01 · Xueyuan Xu, Fulin Wei, Tianyuan Jia, Li Zhuo, Feiping Nie, Xia Wu

In the last decade, embedded multi-label feature selection methods, incorporating the search for feature subsets into model optimization, have attracted considerable attention in accurately evaluating the importance of features in multi-label classification tasks. Nevertheless, the state-of-the-art embedded multi-label feature selection algorithms based on least square regression usually cannot preserve sufficient discriminative information in multi-label data. To tackle the aforementioned challenge, a novel embedded multi-label feature selection method, termed global redundancy and relevance optimization in orthogonal regression (GRROOR), is proposed to facilitate the multi-label feature selection. The method employs orthogonal regression with feature weighting to retain sufficient statistical and structural information related to local label correlations of the multi-label data in the feature learning process. Additionally, both global feature redundancy and global label relevancy information have been considered in the orthogonal regression model, which could contribute to the search for discriminative and non-redundant feature subsets in the multi-label data. The cost function of GRROOR is an unbalanced orthogonal Procrustes problem on the Stiefel manifold. A simple yet effective scheme is utilized to obtain an optimal solution. Extensive experimental results on ten multi-label data sets demonstrate the effectiveness of GRROOR.

📄 PDF Abstract BibTeX arXiv:2403.00307

Code (0)

등록된 구현이 없습니다.

Tasks

feature selectionModel OptimizationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONregression

Methods 이 논문이 사용한 방법론

Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…
Procrustes Procrustes

Similar Papers 제목 키워드 기반

Orthogonal Least Squares Based Fast Feature Selection for Linear Classification

2021-01-21 · Sikai Zhang, Zi-Qiang Lang

An Orthogonal Least Squares (OLS) based feature selection method is proposed for both binomial and multinomial classification. The novel Squared Orthogonal Correlation Coefficient (SOCC) is defined based on Error Reducti…

Classificationfeature selectionGeneral Classification

Feature Selection Based on Orthogonal Constraints and Polygon Area

2024-02-25 · Zhenxing Zhang, Jun Ge, Zheng Wei, Chunjie Zhou 외

The goal of feature selection is to choose the optimal subset of features for a recognition task by evaluating the importance of each feature, thereby achieving effective dimensionality reduction. Currently, proposed fea…

Dimensionality Reductionfeature selection

Unsupervised Simultaneous Orthogonal Basis Clustering Feature Selection

2015-06-01 · CVPR 2015 6 · Dongyoon Han, Junmo Kim

In this paper, we propose a novel unsupervised feature selection method: Simultaneous Orthogonal basis Clustering Feature Selection (SOCFS). To perform feature selection on unlabeled data effectively, a regularized regre…

Clusteringfeature selection

Variance-Preserving Orthogonal Selection (VPOS): Greedy Feature Selection via Orthogonal Deflation in PCA Loading Space

2026-07-25 · Baran Koseoglu, Berrin Yanikoglu arxiv

We present Variance-Preserving Orthogonal Selection (VPOS), an unsupervised feature-selection method that performs sequential orthogonal deflation in the variance-weighted principal component analysis (PCA) loading space…

FoLDTree: A ULDA-Based Decision Tree Framework for Efficient Oblique Splits and Feature Selection

2024-10-30 · Siyu Wang, Kehui Yao

Traditional decision trees are limited by axis-orthogonal splits, which can perform poorly when true decision boundaries are oblique. While oblique decision tree methods address this limitation, they often face high comp…

feature selectionMissing ValuesMulti-class Classification