SparCA: Sparse Compressed Agglomeration for Feature Extraction and Dimensionality Reduction

2023-01-26 · Leland Barnard, Farwa Ali, Hugo Botha, David T. Jones

The most effective dimensionality reduction procedures produce interpretable features from the raw input space while also providing good performance for downstream supervised learning tasks. For many methods, this requires optimizing one or more hyperparameters for a specific task, which can limit generalizability. In this study we propose sparse compressed agglomeration (SparCA), a novel dimensionality reduction procedure that involves a multistep hierarchical feature grouping, compression, and feature selection process. We demonstrate the characteristics and performance of the SparCA method across heterogenous synthetic and real-world datasets, including images, natural language, and single cell gene expression data. Our results show that SparCA is applicable to a wide range of data types, produces highly interpretable features, and shows compelling performance on downstream supervised learning tasks without the need for hyperparameter tuning.

📄 PDF Abstract BibTeX arXiv:2302.10776

Code (1)

Neurology-AI-Program/sparca 공식 구현

Tasks

Dimensionality Reductionfeature selection

Methods 이 논문이 사용한 방법론

PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…

SparCAssist: A Model Risk Assessment Assistant Based on Sparse Generated Counterfactuals

2022-05-03 · Zijian Zhang, Vinay Setty, Avishek Anand

We introduce SparcAssist, a general-purpose risk assessment tool for the machine learning models trained for language tasks. It evaluates models' risk by inspecting their behavior on counterfactuals, namely out-of-distri…

counterfactual Language Modeling Language Modelling

Accelerating Extreme Classification via Adaptive Feature Agglomeration

2019-05-28 · Ankit Jalan, Purushottam Kar

Extreme classification seeks to assign each data point, the most relevant labels from a universe of a million or more labels. This task is faced with the dual challenge of high precision and scalability, with millisecond…

Classification Clustering General Classification

Learned versus Hand-Designed Feature Representations for 3d Agglomeration

2013-12-20 · John A. Bogovic, Gary B. Huang, Viren Jain

For image recognition and labeling tasks, recent results suggest that machine learning methods that rely on manually specified feature representations may be outperformed by methods that automatically derive feature repr…

Data Augmentation Retrieval

Extraction of Projection Profile, Run-Histogram and Entropy Features Straight from Run-Length Compressed Text-Documents

2014-04-02 · Mohammed Javed, P. Nagabhushan, B. B. Chaudhuri

Document Image Analysis, like any Digital Image Analysis requires identification and extraction of proper features, which are generally extracted from uncompressed images, though in reality images are made available in c…

Feature Agglomeration Networks for Single Stage Face Detection

2017-12-03 · Jialiang Zhang, Xiongwei Wu, Jianke Zhu, Steven C. H. Hoi

Recent years have witnessed promising results of face detection using deep learning. Despite making remarkable progresses, face detection in the wild remains an open research challenge especially when detecting faces at …

Face Detection GPU