paper-with-me

홈 › Papers

Feature Selection Using Batch-Wise Attenuation and Feature Mask Normalization

2020-10-26 · Yiwen Liao, Raphaël Latty, Bin Yang

Feature selection is generally used as one of the most important preprocessing techniques in machine learning, as it helps to reduce the dimensionality of data and assists researchers and practitioners in understanding data. Thereby, by utilizing feature selection, better performance and reduced computational consumption, memory complexity and even data amount can be expected. Although there exist approaches leveraging the power of deep neural networks to carry out feature selection, many of them often suffer from sensitive hyperparameters. This paper proposes a feature mask module (FM-module) for feature selection based on a novel batch-wise attenuation and feature mask normalization. The proposed method is almost free from hyperparameters and can be easily integrated into common neural networks as an embedded feature selection method. Experiments on popular image, text and speech datasets have shown that our approach is easy to use and has superior performance in comparison with other state-of-the-art deep-learning-based feature selection methods.

📄 PDF Abstract BibTeX arXiv:2010.13631

Code (0)

등록된 구현이 없습니다.

Tasks

feature selection

Methods 이 논문이 사용한 방법론

Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…

Similar Papers 제목 키워드 기반

Causal Covariate Shift Correction using Fisher information penalty

2025-02-11 · Behraj Khan, Behroz Mirza, Tahir Syed

Evolving feature densities across batches of training data bias cross-validation, making model selection and assessment unreliable (\cite{sugiyama2012machine}). This work takes a distributed density estimation angle to t…

Density EstimationModel Selection

C3-SL: Circular Convolution-Based Batch-Wise Compression for Communication-Efficient Split Learning

2022-07-25 · Cheng-Yen Hsieh, Yu-Chuan Chuang, An-Yeu, Wu

Most existing studies improve the efficiency of Split learning (SL) by compressing the transmitted features. However, most works focus on dimension-wise compression that transforms high-dimensional features into a low-di…

A-SFS: Semi-supervised Feature Selection based on Multi-task Self-supervision

2022-07-19 · Zhifeng Qiu, Wanxin Zeng, Dahua Liao, Ning Gui

Feature selection is an important process in machine learning. It builds an interpretable and robust model by selecting the features that contribute the most to the prediction target. However, most mature feature selecti…

feature selectionSelf-Supervised Learning

Large-scale Online Feature Selection for Ultra-high Dimensional Sparse Data

2014-09-27 · Yue Wu, Steven C. H. Hoi, Tao Mei, Nenghai Yu

Feature selection with large-scale high-dimensional data is important yet very challenging in machine learning and data mining. Online feature selection is a promising new paradigm that is more efficient and scalable tha…

feature selectionVocal Bursts Intensity Prediction

Distribution-Aware Feature Selection for SAEs

2025-08-29 · Narmeen Oozeer, Nirmalendu Prakash, Michael Lan, Alice Rigg 외 arxiv

Sparse autoencoders (SAEs) decompose neural activations into interpretable features. A widely adopted variant, the TopK SAE, reconstructs each token from its K most active latents. However, this approach is inefficient, …