paper-with-me

홈 › Papers

ManifoldFormer: Geometric Deep Learning for Neural Dynamics on Riemannian Manifolds

2025-11-20 · Yihang Fu, Lifang He, Qingyu Chen arxiv

Existing EEG foundation models mainly treat neural signals as generic time series in Euclidean space, ignoring the intrinsic geometric structure of neural dynamics that constrains brain activity to low-dimensional manifolds. This fundamental mismatch between model assumptions and neural geometry limits representation quality and cross-subject generalization. ManifoldFormer addresses this limitation through a novel geometric deep learning framework that explicitly learns neural manifold representations. The architecture integrates three key innovations: a Riemannian VAE for manifold embedding that preserves geometric structure, a geometric Transformer with geodesic-aware attention mechanisms operating directly on neural manifolds, and a dynamics predictor leveraging neural ODEs for manifold-constrained temporal evolution. Extensive evaluation across four public datasets demonstrates substantial improvements over state-of-the-art methods, with 4.6-4.8% higher accuracy and 6.2-10.2% higher Cohen's Kappa, while maintaining robust cross-subject generalization. The geometric approach reveals meaningful neural patterns consistent with neurophysiological principles, establishing geometric constraints as essential for effective EEG foundation models.

📄 PDF Abstract BibTeX arXiv:2511.16828

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Riemannian Langevin Dynamics: Strong Convergence of Geometric Euler-Maruyama Scheme

2026-03-04 · Zhiyuan Zhan, Masashi Sugiyama arxiv

Low-dimensional structure in real-world data plays an important role in the success of generative models, which motivates diffusion models defined on intrinsic data manifolds. Such models are driven by stochastic differe…

Bayesian Quadrature on Riemannian Data Manifolds

2021-02-12 · Christian Fröhlich, Alexandra Gessner, Philipp Hennig, Bernhard Schölkopf 외

Riemannian manifolds provide a principled way to model nonlinear geometric structure inherent in data. A Riemannian metric on said manifolds determines geometry-aware shortest paths and provides the means to define stati…

Riemannian Residual Neural Networks

2023-10-16 · NeurIPS 2023 11

Recent methods in geometric deep learning have introduced various neural networks to operate over data that lie on Riemannian manifolds. Such networks are often necessary to learn well over graphs with a hierarchical str…

Riemannian SAM: Sharpness-Aware Minimization on Riemannian Manifolds

2023-09-21 · NeurIPS 2023 11

Contemporary advances in the field of deep learning have embarked upon an exploration of the underlying geometric properties of data, thus encouraging the investigation of techniques that consider general manifolds, for …

Learning Complex Geometric Structures from Data with Deep Riemannian Manifolds

2021-09-29 · Aaron Lou, Maximilian Nickel, Mustafa Mukadam, Brandon Amos

We present Deep Riemannian Manifolds, a new class of neural network parameterized Riemannian manifolds that can represent and learn complex geometric structures. To do this, we first construct a neural network which outp…