paper-with-me

Papers

A generalised OMP algorithm for feature selection with application to gene expression data

2020-04-01 · Michail Tsagris, Zacharias Papadovasilakis, Kleanthi Lakiotaki, Ioannis Tsamardinos

Feature selection for predictive analytics is the problem of identifying a minimal-size subset of features that is maximally predictive of an outcome of interest. To apply to molecular data, feature selection algorithms need to be scalable to tens of thousands of available features. In this paper, we propose gOMP, a highly-scalable generalisation of the Orthogonal Matching Pursuit feature selection algorithm to several directions: (a) different types of outcomes, such as continuous, binary, nominal, and time-to-event, (b) different types of predictive models (e.g., linear least squares, logistic regression), (c) different types of predictive features (continuous, categorical), and (d) different, statistical-based stopping criteria. We compare the proposed algorithm against LASSO, a prototypical, widely used algorithm for high-dimensional data. On dozens of simulated datasets, as well as, real gene expression datasets, gOMP is on par, or outperforms LASSO for case-control binary classification, quantified outcomes (regression), and (censored) survival times (time-to-event) analysis. gOMP has also several theoretical advantages that are discussed. While gOMP is based on quite simple and basic statistical ideas, easy to implement and to generalize, we also show in an extensive evaluation that it is also quite effective in bioinformatics analysis settings.

📄 PDF Abstract BibTeX arXiv:2004.00281

Code (0)

등록된 구현이 없습니다.

Tasks

Binary Classificationfeature selectionregression

Methods 이 논문이 사용한 방법론

Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…

Similar Papers 제목 키워드 기반

When can you trust feature selection? -- I: A condition-based analysis of LASSO and generalised hardness of approximation

2023-12-18 · Alexander Bastounis, Felipe Cucker, Anders C. Hansen

The arrival of AI techniques in computations, with the potential for hallucinations and non-robustness, has made trustworthiness of algorithms a focal point. However, trustworthiness of the many classical approaches are …

feature selection

Properties of Fixed Points of Generalised Extra Gradient Methods Applied to Min-Max Problems

2025-04-03 · Amir Ali Farzin, Yuen-Man Pun, Philipp Braun, Iman Shames

This paper studies properties of fixed points of generalised Extra-gradient (GEG) algorithms applied to min-max problems. We discuss connections between saddle points of the objective function of the min-max problem and …

On the use of feature-maps and parameter control for improved quality-diversity meta-evolution

2021-05-21 · David M. Bossens, Danesh Tarapore

In Quality-Diversity (QD) algorithms, which evolve a behaviourally diverse archive of high-performing solutions, the behaviour space is a difficult design choice that should be tailored to the target application. In QD m…

Diversityfeature selectionreinforcement-learningReinforcement Learning (RL)

Adaptive operator selection utilising generalised experience

2023-12-04 · Mehmet Emin Aydin, Rafet Durgut, Abdur Rakib

Optimisation problems, particularly combinatorial optimisation problems, are difficult to solve due to their complexity and hardness. Such problems have been successfully solved by evolutionary and swarm intelligence alg…

Reinforcement Learning (RL)

A generalised log-determinant regularizer for online semi-definite programming and its applications

2020-12-10 · Yaxiong Liu, Ken-ichiro Moridomi, Kohei Hatano, Eiji Takimoto

We consider a variant of online semi-definite programming problem (OSDP): The decision space consists of semi-definite matrices with bounded $\Gamma$-trace norm, which is a generalization of trace norm defined by a posit…

Matrix Completion