paper-with-me

Papers

Deep-gKnock: nonlinear group-feature selection with deep neural network

2019-05-24 · Guangyu Zhu, Tingting Zhao

Feature selection is central to contemporary high-dimensional data analysis. Grouping structure among features arises naturally in various scientific problems. Many methods have been proposed to incorporate the grouping structure information into feature selection. However, these methods are normally restricted to a linear regression setting. To relax the linear constraint, we combine the deep neural networks (DNNs) with the recent Knockoffs technique, which has been successful in an individual feature selection context. We propose Deep-gKnock (Deep group-feature selection using Knockoffs) as a methodology for model interpretation and dimension reduction. Deep-gKnock performs model-free group-feature selection by controlling group-wise False Discovery Rate (gFDR). Our method improves the interpretability and reproducibility of DNNs. Experimental results on both synthetic and real data demonstrate that our method achieves superior power and accurate gFDR control compared with state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:1905.10013

Code (0)

등록된 구현이 없습니다.

Tasks

Dimensionality Reductionfeature selection

Methods 이 논문이 사용한 방법론

Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…
Interpretability 설명 없음
Linear Regression Linear Regression is a method for modelling a relationship between a dependent variable and independent variables. These models can be fit with numerous approaches. The most…

Similar Papers 제목 키워드 기반

Consistent Feature Selection for Analytic Deep Neural Networks

2020-10-16 · NeurIPS 2020 12 · Vu Dinh, Lam Si Tung Ho

One of the most important steps toward interpretability and explainability of neural network models is feature selection, which aims to identify the subset of relevant features. Theoretical results in the field have most…

feature selection

AutoEncoder Inspired Unsupervised Feature Selection

2017-10-23 · Kai Han, Yunhe Wang, Chao Zhang, Chao Li 외

High-dimensional data in many areas such as computer vision and machine learning tasks brings in computational and analytical difficulty. Feature selection which selects a subset from observed features is a widely used a…

BIG-bench Machine Learningfeature selection

ControlBurn: Nonlinear Feature Selection with Sparse Tree Ensembles

2022-07-08 · Brian Liu, Miaolan Xie, Haoyue Yang, Madeleine Udell

ControlBurn is a Python package to construct feature-sparse tree ensembles that support nonlinear feature selection and interpretable machine learning. The algorithms in this package first build large tree ensembles that…

Additive modelsfeature selectionInterpretable Machine Learning

Towards Ultrahigh Dimensional Feature Selection for Big Data

2012-09-24 · Mingkui Tan, Ivor W. Tsang, Li Wang

In this paper, we present a new adaptive feature scaling scheme for ultrahigh-dimensional feature selection on Big Data. To solve this problem effectively, we first reformulate it as a convex semi-infinite programming (S…

feature selectionSelection bias

Sparse Centroid-Encoder: A Nonlinear Model for Feature Selection

2022-01-30 · Tomojit Ghosh, Michael Kirby

Autoencoders have been widely used as a nonlinear tool for data dimensionality reduction. While autoencoders don't utilize the label information, Centroid-Encoders (CE)\cite{ghosh2022supervised} use the class label in th…

AttributeDimensionality Reductionfeature selection