S+t-SNE -- Bringing Dimensionality Reduction to Data Streams

2024-03-26 · Pedro C. Vieira, João P. Montrezol, João T. Vieira, João Gama

We present S+t-SNE, an adaptation of the t-SNE algorithm designed to handle infinite data streams. The core idea behind S+t-SNE is to update the t-SNE embedding incrementally as new data arrives, ensuring scalability and adaptability to handle streaming scenarios. By selecting the most important points at each step, the algorithm ensures scalability while keeping informative visualisations. By employing a blind method for drift management, the algorithm adjusts the embedding space, which facilitates the visualisation of evolving data dynamics. Our experimental evaluations demonstrate the effectiveness and efficiency of S+t-SNE, whilst highlighting its ability to capture patterns in a streaming scenario. We hope our approach offers researchers and practitioners a real-time tool for understanding and interpreting high-dimensional data.

📄 PDF Abstract BibTeX arXiv:2403.17643

Code (1)

pedrv/s--t-sne 공식 구현

Tasks

Dimensionality Reduction Management

SOM-CPC: Unsupervised Contrastive Learning with Self-Organizing Maps for Structured Representations of High-Rate Time Series

2022-05-31 · Iris A. M. Huijben, Arthur A. Nijdam, Sebastiaan Overeem, Merel M. van Gilst 외

Continuous monitoring with an ever-increasing number of sensors has become ubiquitous across many application domains. However, acquired time series are typically high-dimensional and difficult to interpret. Expressive d…

Contrastive Learning Dimensionality Reduction Time Series Time Series Analysis

Learning From High-Dimensional Cyber-Physical Data Streams for Diagnosing Faults in Smart Grids

2023-03-15 · Hossein Hassani, Ehsan Hallaji, Roozbeh Razavi-Far, Mehrdad Saif

The performance of fault diagnosis systems is highly affected by data quality in cyber-physical power systems. These systems generate massive amounts of data that overburden the system with excessive computational costs.…

Diagnostic Dimensionality Reduction Fault Diagnosis Feature Engineering+1

Performance prediction of data streams on high-performance architecture

2019-01-07 · Human-centric Computing and Information Sciences 2019 1 · Bhaskar Gautam, Annappa Basava

Worldwide sensor streams are expanding continuously with unbounded velocity in volume, and for this acceleration, there is an adaptation of large stream data processing system from the homogeneous to rack-scale architect…

Benchmarking Dimensionality Reduction Gaussian Processes Management+4

Efficient Subspace Search in Data Streams

2020-11-13 · Edouard Fouché, Florian Kalinke, Klemens Böhm

In the real world, data streams are ubiquitous -- think of network traffic or sensor data. Mining patterns, e.g., outliers or clusters, from such data must take place in real time. This is challenging because (1) streams…

Outlier Detection

Robust Dual View Deep Agent

2018-04-13 · Ibrahim M. Sobh, Nevin M. Darwish

Motivated by recent advance of machine learning using Deep Reinforcement Learning this paper proposes a modified architecture that produces more robust agents and speeds up the training process. Our architecture is based…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)