paper-with-me

Papers

Normalizing Flows for Knockoff-free Controlled Feature Selection

2021-06-03 · Derek Hansen, Brian Manzo, Jeffrey Regier

Controlled feature selection aims to discover the features a response depends on while limiting the false discovery rate (FDR) to a predefined level. Recently, multiple deep-learning-based methods have been proposed to perform controlled feature selection through the Model-X knockoff framework. We demonstrate, however, that these methods often fail to control the FDR for two reasons. First, these methods often learn inaccurate models of features. Second, the "swap" property, which is required for knockoffs to be valid, is often not well enforced. We propose a new procedure called FlowSelect to perform controlled feature selection that does not suffer from either of these two problems. To more accurately model the features, FlowSelect uses normalizing flows, the state-of-the-art method for density estimation. Instead of enforcing the "swap" property, FlowSelect uses a novel MCMC-based procedure to calculate p-values for each feature directly. Asymptotically, FlowSelect computes valid p-values. Empirically, FlowSelect consistently controls the FDR on both synthetic and semi-synthetic benchmarks, whereas competing knockoff-based approaches do not. FlowSelect also demonstrates greater power on these benchmarks. Additionally, FlowSelect correctly infers the genetic variants associated with specific soybean traits from GWAS data.

📄 PDF Abstract BibTeX arXiv:2106.01528

Code (1)

dereklhansen/flowselect 공식 구현 pytorch

Tasks

Density Estimationfeature selectionvalid

Methods 이 논문이 사용한 방법론

Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…

Similar Papers 제목 키워드 기반

Deep Knockoffs

2018-11-16 · Yaniv Romano, Matteo Sesia, Emmanuel J. Candès

This paper introduces a machine for sampling approximate model-X knockoffs for arbitrary and unspecified data distributions using deep generative models. The main idea is to iteratively refine a knockoff sampling mechani…

Variable Selection

Error-based Knockoffs Inference for Controlled Feature Selection

2022-03-09 · Xuebin Zhao, Hong Chen, Yingjie Wang, Weifu Li 외

Recently, the scheme of model-X knockoffs was proposed as a promising solution to address controlled feature selection under high-dimensional finite-sample settings. However, the procedure of model-X knockoffs depends he…

Feature Importancefeature selection

RANK: Large-Scale Inference with Graphical Nonlinear Knockoffs

2017-08-31 · Yingying Fan, Emre Demirkaya, Gaorong Li, Jinchi Lv

Power and reproducibility are key to enabling refined scientific discoveries in contemporary big data applications with general high-dimensional nonlinear models. In this paper, we provide theoretical foundations on the …

Differentially Private Variable Selection via the Knockoff Filter

2021-09-12 · Mehrdad Pournaderi, Yu Xiang

The knockoff filter, recently developed by Barber and Candes, is an effective procedure to perform variable selection with a controlled false discovery rate (FDR). We propose a private version of the knockoff filter by i…

Variable Selection

Boosting Summarization with Normalizing Flows and Aggressive Training

2023-11-01 · Yu Yang, Xiaotong Shen

This paper presents FlowSUM, a normalizing flows-based variational encoder-decoder framework for Transformer-based summarization. Our approach tackles two primary challenges in variational summarization: insufficient sem…

DecoderKnowledge DistillationText Summarization