Divergence Regulated Encoder Network for Joint Dimensionality Reduction and Classification
Feature representation is an important aspect of remote-sensing based image classification. While deep convolutional neural networks are able to effectively amalgamate information, large numbers of parameters often make learned features inscrutable and difficult to transfer to alternative models. In order to better represent statistical texture information for remote-sensing image classification, in this paper, we investigate performing joint dimensionality reduction and classification using a novel histogram neural network. Motivated by a popular dimensionality reduction approach, t-Distributed Stochastic Neighbor Embedding (t-SNE), our proposed method incorporates a classification loss computed on samples in a low-dimensional embedding space. We compare the learned sample embeddings against coordinates found by t-SNE in terms of classification accuracy and qualitative assessment. We also explore use of various divergence measures in the t-SNE objective. The proposed method has several advantages such as readily embedding out-of-sample points and reducing feature dimensionality while retaining class discriminability. Our results show that the proposed approach maintains and/or improves classification performance and reveals characteristics of features produced by neural networks that may be helpful for other applications.
Code (1)
Tasks
ClassificationDimensionality ReductionGeneral Classificationimage-classificationImage ClassificationRemote Sensing Image ClassificationSimilar Papers 제목 키워드 기반
Representative period selection for power system planning using autoencoder-based dimensionality reduction
Power sector capacity expansion models (CEMs) that are used for studying future low-carbon grid scenarios must incorporate detailed representation of grid operations. Often CEMs are formulated to model grid operations ov…
ClusteringDimensionality ReductionDeep Continuous Clustering
Clustering high-dimensional datasets is hard because interpoint distances become less informative in high-dimensional spaces. We present a clustering algorithm that performs nonlinear dimensionality reduction and cluster…
ClusteringDimensionality ReductionLow-rank Characteristic Tensor Density Estimation Part II: Compression and Latent Density Estimation
Learning generative probabilistic models is a core problem in machine learning, which presents significant challenges due to the curse of dimensionality. This paper proposes a joint dimensionality reduction and non-param…
Anomaly DetectionDensity EstimationDimensionality ReductionA Dimensionality Reduction Method for Finding Least Favorable Priors with a Focus on Bregman Divergence
A common way of characterizing minimax estimators in point estimation is by moving the problem into the Bayesian estimation domain and finding a least favorable prior distribution. The Bayesian estimator induced by a lea…
Dimensionality ReductionDeep Variational Sufficient Dimensionality Reduction
We consider the problem of sufficient dimensionality reduction (SDR), where the high-dimensional observation is transformed to a low-dimensional sub-space in which the information of the observations regarding the label …
Dimensionality ReductionGeneral Classification