paper-with-me

Papers

Latent Space Topology Evolution in Multilayer Perceptrons

2025-06-02 · Eduardo Paluzo-Hidalgo

This paper introduces a topological framework for interpreting the internal representations of Multilayer Perceptrons (MLPs). We construct a simplicial tower, a sequence of simplicial complexes connected by simplicial maps, that captures how data topology evolves across network layers. Our approach enables bi-persistence analysis: layer persistence tracks topological features within each layer across scales, while MLP persistence reveals how these features transform through the network. We prove stability theorems for our topological descriptors and establish that linear separability in latent spaces is related to disconnected components in the nerve complexes. To make our framework practical, we develop a combinatorial algorithm for computing MLP persistence and introduce trajectory-based visualisations that track data flow through the network. Experiments on synthetic and real-world medical data demonstrate our method's ability to identify redundant layers, reveal critical topological transitions, and provide interpretable insights into how MLPs progressively organise data for classification.

📄 PDF Abstract BibTeX arXiv:2506.01569

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Predictive Coding Graphs are a Superset of Feedforward Neural Networks

2026-03-06 · Björn van Zwol arxiv

Predictive coding graphs (PCGs) are a recently introduced generalization to predictive coding networks, a neuroscience-inspired probabilistic latent variable model. Here, we prove how PCGs define a mathematical superset …

NTopo: Mesh-free Topology Optimization using Implicit Neural Representations

2021-02-22 · NeurIPS 2021 12 · Jonas Zehnder, Yue Li, Stelian Coros, Bernhard Thomaszewski

Recent advances in implicit neural representations show great promise when it comes to generating numerical solutions to partial differential equations. Compared to conventional alternatives, such representations employ …

Self-Supervised Learning

GD-VAEs: Geometric Dynamic Variational Autoencoders for Learning Nonlinear Dynamics and Dimension Reductions

2022-06-10 · Ryan Lopez, Paul J. Atzberger

We develop data-driven methods incorporating geometric and topological information to learn parsimonious representations of nonlinear dynamics from observations. The approaches learn nonlinear state-space models of the d…

State Space Models

Autoencoders, Kernels, and Multilayer Perceptrons for Electron Micrograph Restoration and Compression

2018-08-29 · Jeffrey M. Ede

We present 14 autoencoders, 15 kernels and 14 multilayer perceptrons for electron micrograph restoration and compression. These have been trained for transmission electron microscopy (TEM), scanning transmission electron…

Denoising

Improving Generalization by Permutation Routing Across Model Copies

2026-05-10 · Shuhei Kashiwamura, Timothee Leleu arxiv

We introduce a use of the \(M\)-cover (or \(M\)-layer) transform for machine learning. The method replicates a model \(M\) times, but instead of coupling the copies through parameter averaging or an explicit attractive f…