paper-with-me

Papers

Error Controlled Feature Selection for Ultrahigh Dimensional and Highly Correlated Feature Space Using Deep Learning

2022-09-15 · Arkaprabha Ganguli, David Todem, Tapabrata Maiti

In recent years, deep learning has been at the center of analytics due to its impressive empirical success in analyzing complex data objects. Despite this success, most of the existing tools behave like black-box machines, thus the increasing interest in interpretable, reliable, and robust deep learning models applicable to a broad class of applications. Feature-selected deep learning has emerged as a promising tool in this realm. However, the recent developments do not accommodate ultra-high dimensional and highly correlated features, in addition to the high noise level. In this article, we propose a novel screening and cleaning method with the aid of deep learning for a data-adaptive multi-resolutional discovery of highly correlated predictors with a controlled error rate. Extensive empirical evaluations over a wide range of simulated scenarios and several real datasets demonstrate the effectiveness of the proposed method in achieving high power while keeping the false discovery rate at a minimum.

📄 PDF Abstract BibTeX arXiv:2209.07011

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Learningfeature selection

Methods 이 논문이 사용한 방법론

Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…

Similar Papers 제목 키워드 기반

Towards Ultrahigh Dimensional Feature Selection for Big Data

2012-09-24 · Mingkui Tan, Ivor W. Tsang, Li Wang

In this paper, we present a new adaptive feature scaling scheme for ultrahigh-dimensional feature selection on Big Data. To solve this problem effectively, we first reformulate it as a convex semi-infinite programming (S…

feature selectionSelection bias

Feature space reduction method for ultrahigh-dimensional, multiclass data: Random forest-based multiround screening (RFMS)

2023-05-25 · Gergely Hanczár, Marcell Stippinger, Dávid Hanák, Marcell T. Kurbucz 외

In recent years, numerous screening methods have been published for ultrahigh-dimensional data that contain hundreds of thousands of features; however, most of these features cannot handle data with thousands of classes.…

Classification with Ultrahigh-Dimensional Features

2016-11-04 · Yanming Li, Hyokyoung Hong, Jian Kang, Kevin He 외

Although much progress has been made in classification with high-dimensional features \citep{Fan_Fan:2008, JGuo:2010, CaiSun:2014, PRXu:2014}, classification with ultrahigh-dimensional features, wherein the features much…

ClassificationGeneral Classification

Ridge partial correlation screening for ultrahigh-dimensional data

2025-04-27 · Run Wang, An Nguyen, Somak Dutta, Vivekananda Roy

Variable selection in ultrahigh-dimensional linear regression is challenging due to its high computational cost. Therefore, a screening step is usually conducted before variable selection to significantly reduce the dime…

regressionVariable Selection

Factor Normalization for Deep Neural Network Models

2021-01-01 · Haobo Qi, Jing Zhou, Hansheng Wang

Deep neural network (DNN) models often involve features of ultrahigh dimensions. In most cases, the ultrahigh dimensional features can be decomposed into two parts. The first part is a low-dimensional factor model. The s…