Visualizing and Exploring Dynamic High-Dimensional Datasets with LION-tSNE
T-distributed stochastic neighbor embedding (tSNE) is a popular and prize-winning approach for dimensionality reduction and visualizing high-dimensional data. However, tSNE is non-parametric: once visualization is built, tSNE is not designed to incorporate additional data into existing representation. It highly limits the applicability of tSNE to the scenarios where data are added or updated over time (like dashboards or series of data snapshots). In this paper we propose, analyze and evaluate LION-tSNE (Local Interpolation with Outlier coNtrol) - a novel approach for incorporating new data into tSNE representation. LION-tSNE is based on local interpolation in the vicinity of training data, outlier detection and a special outlier mapping algorithm. We show that LION-tSNE method is robust both to outliers and to new samples from existing clusters. We also discuss multiple possible improvements for special cases. We compare LION-tSNE to a comprehensive list of possible benchmark approaches that include multiple interpolation techniques, gradient descent for new data, and neural network approximation.
Code (0)
등록된 구현이 없습니다.
Tasks
Dimensionality ReductionOutlier DetectionVocal Bursts Intensity PredictionSimilar Papers 제목 키워드 기반
Audio Atlas: Visualizing and Exploring Audio Datasets
We introduce Audio Atlas, an interactive web application for visualizing audio data using text-audio embeddings. Audio Atlas is designed to facilitate the exploration and analysis of audio datasets using a contrastive em…
ManagementAn Incremental Dimensionality Reduction Method for Visualizing Streaming Multidimensional Data
Dimensionality reduction (DR) methods are commonly used for analyzing and visualizing multidimensional data. However, when data is a live streaming feed, conventional DR methods cannot be directly used because of their c…
Dimensionality ReductionMapper-type algorithms for complex data and relations
Mapper and Ball Mapper are Topological Data Analysis tools used for exploring high dimensional point clouds and visualizing scalar-valued functions on those point clouds. Inspired by open questions in knot theory, new fe…
Topological Data AnalysisVocal Bursts Type PredictionVisualizing High Dimensional Dynamical Processes
Manifold learning techniques for dynamical systems and time series have shown their utility for a broad spectrum of applications in recent years. While these methods are effective at learning a low-dimensional representa…
EEGElectroencephalogram (EEG)Time SeriesTime Series Analysis+1Outliagnostics: Visualizing Temporal Discrepancy in Outlying Signatures of Data Entries
This paper presents an approach to analyzing two-dimensional temporal datasets focusing on identifying observations that are significant in calculating the outliers of a scatterplot. We also propose a prototype, called O…
Time SeriesTime Series Analysis