paper-with-me

Papers

DPDR: A novel machine learning method for the Decision Process for Dimensionality Reduction

2022-06-17 · Jean-Sébastien Dessureault, Daniel Massicotte

This paper discusses the critical decision process of extracting or selecting the features in a supervised learning context. It is often confusing to find a suitable method to reduce dimensionality. There are pros and cons to deciding between a feature selection and feature extraction according to the data's nature and the user's preferences. Indeed, the user may want to emphasize the results toward integrity or interpretability and a specific data resolution. This paper proposes a new method to choose the best dimensionality reduction method in a supervised learning context. It also helps to drop or reconstruct the features until a target resolution is reached. This target resolution can be user-defined, or it can be automatically defined by the method. The method applies a regression or a classification, evaluates the results, and gives a diagnosis about the best dimensionality reduction process in this specific supervised learning context. The main algorithms used are the Random Forest algorithms (RF), the Principal Component Analysis (PCA) algorithm, and the multilayer perceptron (MLP) neural network algorithm. Six use cases are presented, and every one is based on some well-known technique to generate synthetic data. This research discusses each choice that can be made in the process, aiming to clarify the issues about the entire decision process of selecting or extracting the features.

📄 PDF Abstract BibTeX arXiv:2206.08974

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningDimensionality Reductionfeature selection

Methods 이 논문이 사용한 방법론

Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…

Similar Papers 제목 키워드 기반

DPDR: Gradient Decomposition and Reconstruction for Differentially Private Deep Learning

2024-06-04 · Yixuan Liu, Li Xiong, YuHan Liu, Yujie Gu 외

Differentially Private Stochastic Gradients Descent (DP-SGD) is a prominent paradigm for preserving privacy in deep learning. It ensures privacy by perturbing gradients with random noise calibrated to their entire norm a…

Deep Learning

Cost-informed dimensionality reduction for structural digital twin technologies

2024-09-17 · Aidan J. Hughes, Keith Worden, Nikolaos Dervilis, Timothy J. Rogers

Classification models are a key component of structural digital twin technologies used for supporting asset management decision-making. An important consideration when developing classification models is the dimensionali…

Asset ManagementDecision MakingDimensionality ReductionManagement

Difficulty in estimating visual information from randomly sampled images

2020-12-16 · Masaki Kitayama, Hitoshi Kiya

In this paper, we evaluate dimensionality reduction methods in terms of difficulty in estimating visual information on original images from dimensionally reduced ones. Recently, dimensionality reduction has been receivin…

BIG-bench Machine LearningDimensionality Reductionimage-classificationImage Classification+1

Transformer-based dimensionality reduction

2022-10-15 · Ruisheng Ran, Tianyu Gao, Bin Fang

Recently, Transformer is much popular and plays an important role in the fields of Machine Learning (ML), Natural Language Processing (NLP), and Computer Vision (CV), etc. In this paper, based on the Vision Transformer (…

Data VisualizationDimensionality ReductionFace RecognitionImage Reconstruction

"Why Here and Not There?" -- Diverse Contrasting Explanations of Dimensionality Reduction

2022-06-15 · André Artelt, Alexander Schulz, Barbara Hammer

Dimensionality reduction is a popular preprocessing and a widely used tool in data mining. Transparency, which is usually achieved by means of explanations, is nowadays a widely accepted and crucial requirement of machin…

Data VisualizationDimensionality ReductionRecommendation Systems