Compressive Feature Selection for Remote Visual Multi-Task Inference
Deep models produce a number of features in each internal layer. A key problem in applications such as feature compression for remote inference is determining how important each feature is for the task(s) performed by the model. The problem is especially challenging in the case of multi-task inference, where the same feature may carry different importance for different tasks. In this paper, we examine how effective is mutual information (MI) between a feature and a model's task output as a measure of the feature's importance for that task. Experiments involving hard selection and soft selection (unequal compression) based on MI are carried out to compare the MI-based method with alternative approaches. Multi-objective analysis is provided to offer further insight.
Code (0)
등록된 구현이 없습니다.
Tasks
Feature Compressionfeature selectionSimilar Papers 제목 키워드 기반
Remote Multilinear Compressive Learning with Adaptive Compression
Multilinear Compressive Learning (MCL) is an efficient signal acquisition and learning paradigm for multidimensional signals. The level of signal compression affects the detection or classification performance of a MCL m…
Compressive SensingFeature Fusion via Multiresolution Compressive Measurement Matrix Analysis For Spectral Image Classification
In the compressive spectral imaging (CSI) framework, different architectures have been proposed to recover high-resolution spectral images from compressive measurements. Since CSI architectures compactly capture the rele…
Classificationimage-classificationImage ClassificationCompressive Sampling Using a Pushframe Camera
The recently described pushframe imager, a parallelized single pixel camera capturing with a pushbroom-like motion, is intrinsically suited to both remote-sensing and compressive sampling. It optically applies a 2D mask …
Compressive Regularized Discriminant Analysis of High-Dimensional Data with Applications to Microarray Studies
We propose a modification of linear discriminant analysis, referred to as compressive regularized discriminant analysis (CRDA), for analysis of high-dimensional datasets. CRDA is specially designed for feature eliminatio…
feature selectionCompressive Pattern Matching on Multispectral Data
We introduce a new constrained minimization problem that performs template and pattern detection on a multispectral image in a compressive sensing context. We use an original minimization problem from Guo and Osher that …
Compressive Sensing