paper-with-me

홈 › Papers

Consistent Nonparametric Different-Feature Selection via the Sparsest $k$-Subgraph Problem

2017-07-31 · Satoshi Hara, Takayuki Katsuki, Hiroki Yanagisawa, Masaaki Imaizumi, Takafumi Ono, Ryo Okamoto, Shigeki Takeuchi

Two-sample feature selection is the problem of finding features that describe a difference between two probability distributions, which is a ubiquitous problem in both scientific and engineering studies. However, existing methods have limited applicability because of their restrictive assumptions on data distributoins or computational difficulty. In this paper, we resolve these difficulties by formulating the problem as a sparsest $k$-subgraph problem. The proposed method is nonparametric and does not assume any specific parametric models on the data distributions. We show that the proposed method is computationally efficient and does not require any extra computation for model selection. Moreover, we prove that the proposed method provides a consistent estimator of features under mild conditions. Our experimental results show that the proposed method outperforms the current method with regard to both accuracy and computation time.

📄 PDF Abstract BibTeX arXiv:1707.09688

Code (0)

등록된 구현이 없습니다.

Tasks

feature selectionModel Selection

Similar Papers 제목 키워드 기반

A model-free feature selection technique of feature screening and random forest based recursive feature elimination

2023-02-15 · Siwei Xia, Yuehan Yang

In this paper, we propose a model-free feature selection method for ultra-high dimensional data with mass features. This is a two phases procedure that we propose to use the fused Kolmogorov filter with the random forest…

Computational Efficiencyfeature selectionregression

Learning Sparsest Linear Causal DAGs with Latent Confounders via Higher-Order Cumulants

2026-07-07 · Ming Cai, Hisayuki Hara arxiv

Recovering the exact directed acyclic graph (DAG) in linear non-Gaussian acyclic models with latent confounders (LvLiNGAM) remains a challenging problem. Although LvLiNGAM is identifiable only up to an observational equi…

On the instrumental variable estimation with many weak and invalid instruments

2022-07-07 · Yiqi Lin, Frank Windmeijer, Xinyuan Song, Qingliang Fan

We discuss the fundamental issue of identification in linear instrumental variable (IV) models with unknown IV validity. With the assumption of the "sparsest rule", which is equivalent to the plurality rule but becomes o…

Variable Selection for Nonparametric Learning with Power Series Kernels

2018-06-02 · Kota Matsui, Wataru Kumagai, Kenta Kanamori, Mitsuaki Nishikimi 외

In this paper, we propose a variable selection method for general nonparametric kernel-based estimation. The proposed method consists of two-stage estimation: (1) construct a consistent estimator of the target function, …

Density Ratio EstimationregressionVariable Selection

On the Limitation of Kernel Dependence Maximization for Feature Selection

2024-06-11 · Keli Liu, Feng Ruan

A simple and intuitive method for feature selection consists of choosing the feature subset that maximizes a nonparametric measure of dependence between the response and the features. A popular proposal from the literatu…

feature selection