paper-with-me

Papers

Parametric t-Distributed Stochastic Exemplar-centered Embedding

2017-10-14 · Martin Renqiang Min, Hongyu Guo, Dinghan Shen

Parametric embedding methods such as parametric t-SNE (pt-SNE) have been widely adopted for data visualization and out-of-sample data embedding without further computationally expensive optimization or approximation. However, the performance of pt-SNE is highly sensitive to the hyper-parameter batch size due to conflicting optimization goals, and often produces dramatically different embeddings with different choices of user-defined perplexities. To effectively solve these issues, we present parametric t-distributed stochastic exemplar-centered embedding methods. Our strategy learns embedding parameters by comparing given data only with precomputed exemplars, resulting in a cost function with linear computational and memory complexity, which is further reduced by noise contrastive samples. Moreover, we propose a shallow embedding network with high-order feature interactions for data visualization, which is much easier to tune but produces comparable performance in contrast to a deep neural network employed by pt-SNE. We empirically demonstrate, using several benchmark datasets, that our proposed methods significantly outperform pt-SNE in terms of robustness, visual effects, and quantitative evaluations.

📄 PDF Abstract BibTeX arXiv:1710.05128

Code (0)

등록된 구현이 없습니다.

Tasks

Data Visualization

Similar Papers 제목 키워드 기반

Exemplar-Centered Supervised Shallow Parametric Data Embedding

2017-02-21 · Martin Renqiang Min, Hongyu Guo, Dongjin Song

Metric learning methods for dimensionality reduction in combination with k-Nearest Neighbors (kNN) have been extensively deployed in many classification, data embedding, and information retrieval applications. However, m…

Dimensionality ReductionGeneral ClassificationInformation RetrievalMetric Learning+1

Exemplar VAE: Linking Generative Models, Nearest Neighbor Retrieval, and Data Augmentation

2020-04-09 · NeurIPS 2020 12 · Sajad Norouzi, David J. Fleet, Mohammad Norouzi

We introduce Exemplar VAEs, a family of generative models that bridge the gap between parametric and non-parametric, exemplar based generative models. Exemplar VAE is a variant of VAE with a non-parametric prior in the l…

Data AugmentationDensity EstimationRepresentation LearningRetrieval+1

Perplexity-free Parametric t-SNE

2020-10-03 · Francesco Crecchi, Cyril de Bodt, Michel Verleysen, John A. Lee 외

The t-distributed Stochastic Neighbor Embedding (t-SNE) algorithm is a ubiquitously employed dimensionality reduction (DR) method. Its non-parametric nature and impressive efficacy motivated its parametric extension. It …

Dimensionality Reduction

A Shallow High-Order Parametric Approach to Data Visualization and Compression

2016-08-16 · Martin Renqiang Min, Hongyu Guo, Dongjin Song

Explicit high-order feature interactions efficiently capture essential structural knowledge about the data of interest and have been used for constructing generative models. We present a supervised discriminative High-Or…

Computational EfficiencyData VisualizationGeneral ClassificationInformation Retrieval+2

Facilitate the Parametric Dimension Reduction by Gradient Clipping

2020-09-30 · Chien-Hsun Lai, Yu-Shuen Wang

We extend a well-known dimension reduction method, t-distributed stochastic neighbor embedding (t-SNE), from non-parametric to parametric by training neural networks. The main advantage of a parametric technique is the g…

Dimensionality Reduction