paper-with-me

Papers

Optimizing Sparse Generalized Singular Vectors for Feature Selection in Proximal Support Vector Machines with Application to Breast and Ovarian Cancer Detection

2024-10-04 · Ugochukwu O. Ugwu, Michael Kirby

This paper presents approaches to compute sparse solutions of Generalized Singular Value Problem (GSVP). The GSVP is regularized by $\ell_1$-norm and $\ell_q$-penalty for $0<q<1$, resulting in the $\ell_1$-GSVP and $\ell_q$-GSVP formulations. The solutions of these problems are determined by applying the proximal gradient descent algorithm with a fixed step size. The inherent sparsity levels within the computed solutions are exploited for feature selection, and subsequently, binary classification with non-parallel Support Vector Machines (SVM). For our feature selection task, SVM is integrated into the $\ell_1$-GSVP and $\ell_q$-GSVP frameworks to derive the $\ell_1$-GSVPSVM and $\ell_q$-GSVPSVM variants. Machine learning applications to cancer detection are considered. We remarkably report near-to-perfect balanced accuracy across breast and ovarian cancer datasets using a few selected features.

📄 PDF Abstract BibTeX arXiv:2410.03978

Code (0)

등록된 구현이 없습니다.

Tasks

Binary Classificationfeature selection

Methods 이 논문이 사용한 방법론

SVM A Support Vector Machine, or SVM, is a non-parametric supervised learning model. For non-linear classification and regression, they utilise the kernel trick to map inputs…
Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…

Similar Papers 제목 키워드 기반

Singular Vectors of Attention Heads Align with Features

2026-02-13 · Gabriel Franco, Carson Loughridge, Mark Crovella arxiv

Identifying feature representations in language models is a central task in mechanistic interpretability. Several recent studies have made the observation that feature representations can be inferred in some cases from s…

Generalized Leverage Scores: Geometric Interpretation and Applications

2022-06-16 · Bruno Ordozgoiti, Antonis Matakos, Aristides Gionis

In problems involving matrix computations, the concept of leverage has found a large number of applications. In particular, leverage scores, which relate the columns of a matrix to the subspaces spanned by its leading si…

Ranky : An Approach to Solve Distributed SVD on Large Sparse Matrices

2020-09-21 · Resul Tugay, sule gunduz oguducu

Singular Value Decomposition (SVD) is a well studied research topic in many fields and applications from data mining to image processing. Data arising from these applications can be represented as a matrix where it is la…

Analysis of singular subspaces under random perturbations

2024-03-14 · Ke Wang

We present a comprehensive analysis of singular vector and singular subspace perturbations in the context of the signal plus random Gaussian noise matrix model. Assuming a low-rank signal matrix, we extend the Davis-Kaha…

Sparse Spectral Training and Inference on Euclidean and Hyperbolic Neural Networks

2024-05-24 · Jialin Zhao, Yingtao Zhang, Xinghang Li, Huaping Liu 외

The growing computational demands posed by increasingly number of neural network's parameters necessitate low-memory-consumption training approaches. Previous memory reduction techniques, such as Low-Rank Adaptation (LoR…

Link PredictionMachine TranslationNode ClassificationText Generation