Graph-based Predictable Feature Analysis
We propose graph-based predictable feature analysis (GPFA), a new method for unsupervised learning of predictable features from high-dimensional time series, where high predictability is understood very generically as low variance in the distribution of the next data point given the previous ones. We show how this measure of predictability can be understood in terms of graph embedding as well as how it relates to the information-theoretic measure of predictive information in special cases. We confirm the effectiveness of GPFA on different datasets, comparing it to three existing algorithms with similar objectives---namely slow feature analysis, forecastable component analysis, and predictable feature analysis---to which GPFA shows very competitive results.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph EmbeddingTime SeriesTime Series AnalysisSimilar Papers 제목 키워드 기반
PFAx: Predictable Feature Analysis to Perform Control
Predictable Feature Analysis (PFA) (Richthofer, Wiskott, ICMLA 2015) is an algorithm that performs dimensionality reduction on high dimensional input signal. It extracts those subsignals that are most predictable accordi…
Dimensionality Reductionfeature selectionglobal-optimizationReinforcement LearningPredictable Feature Analysis
Every organism in an environment, whether biological, robotic or virtual, must be able to predict certain aspects of its environment in order to survive or perform whatever task is intended. It needs a model that is capa…
Decision MakingSAGMAN: Stability Analysis of Graph Neural Networks on the Manifolds
Modern graph neural networks (GNNs) can be sensitive to changes in the input graph structure and node features, potentially resulting in unpredictable behavior and degraded performance. In this work, we introduce a spect…
Dimensionality ReductionGraph EmbeddingRecommendation SystemsModelling Quasi-Orthographic Captures for Surface Imaging
Surveillance and surveying are two important applications of empirical research. A major part of terrain modelling is supported by photographic surveys which are used for capturing expansive natural surfaces using a wide…
Computational EfficiencyTranscoders for Investigating Deception in Language Models
Transcoders have recently emerged as a promising approach for mechanistic interpretability (MI), enabling circuit-level analysis of model behaviour. In this paper, we investigate the use of transcoders to analyse decepti…