paper-with-me

Papers

Topological Deep Learning with State-Space Models: A Mamba Approach for Simplicial Complexes

2024-09-18 · Marco Montagna, Simone Scardapane, Lev Telyatnikov

Graph Neural Networks based on the message-passing (MP) mechanism are a dominant approach for handling graph-structured data. However, they are inherently limited to modeling only pairwise interactions, making it difficult to explicitly capture the complexity of systems with $n$-body relations. To address this, topological deep learning has emerged as a promising field for studying and modeling higher-order interactions using various topological domains, such as simplicial and cellular complexes. While these new domains provide powerful representations, they introduce new challenges, such as effectively modeling the interactions among higher-order structures through higher-order MP. Meanwhile, structured state-space sequence models have proven to be effective for sequence modeling and have recently been adapted for graph data by encoding the neighborhood of a node as a sequence, thereby avoiding the MP mechanism. In this work, we propose a novel architecture designed to operate with simplicial complexes, utilizing the Mamba state-space model as its backbone. Our approach generates sequences for the nodes based on the neighboring cells, enabling direct communication between all higher-order structures, regardless of their rank. We extensively validate our model, demonstrating that it achieves competitive performance compared to state-of-the-art models developed for simplicial complexes.

📄 PDF Abstract BibTeX arXiv:2409.12033

Code (0)

등록된 구현이 없습니다.

Tasks

MambaState Space Models

Methods 이 논문이 사용한 방법론

Mamba Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the Transformer architecture and its core attention module.…

Similar Papers 제목 키워드 기반

CCMamba: Topologically-Informed Selective State-Space Networks on Combinatorial Complexes for Higher-Order Graph Learning

2026-01-28 · Jiawen Chen, Qi Shao, Mingtong Zhou, Duxin Chen 외 arxiv

Topological deep learning has emerged as a powerful paradigm for modeling higher-order relational structures beyond pairwise interactions that standard graph neural networks fail to capture. While combinatorial complexes…

Graph Learning

Topological Signal Processing over Cell Complexes

2021-12-13 · Stefania Sardellitti, Sergio Barbarossa, Lucia Testa

The Topological Signal Processing (TSP) framework has been recently developed to analyze signals defined over simplicial complexes, i.e. topological spaces represented by finite sets of elements that are closed under inc…

Quantum Simplicial Neural Networks

2025-01-09 · Simone Piperno, Claudio Battiloro, Andrea Ceschini, Francesca Dominici 외

Graph Neural Networks (GNNs) excel at learning from graph-structured data but are limited to modeling pairwise interactions, insufficient for capturing higher-order relationships present in many real-world systems. Topol…

Deep Learning

Stationarity and Spectral Characterization of Random Signals on Simplicial Complexes

2026-02-03 · Madeline Navarro, Andrei Buciulea, Santiago Segarra, Antonio Marques arxiv

It is increasingly common for data to possess intricate structure, necessitating new models and analytical tools. Graphs, a prominent type of structure, can encode the relationships between any two entities (nodes). Howe…

Topological Signal Processing over Simplicial Complexes

2019-07-26 · Sergio Barbarossa, Stefania Sardellitti

The goal of this paper is to establish the fundamental tools to analyze signals defined over a topological space, i.e. a set of points along with a set of neighborhood relations. This setup does not require the definitio…