paper-with-me

홈 › Papers

Logical Characterizations of Recurrent Graph Neural Networks with Reals and Floats

2024-05-23 · Veeti Ahvonen, Damian Heiman, Antti Kuusisto, Carsten Lutz

In pioneering work from 2019, Barcel\'o and coauthors identified logics that precisely match the expressive power of constant iteration-depth graph neural networks (GNNs) relative to properties definable in first-order logic. In this article, we give exact logical characterizations of recurrent GNNs in two scenarios: (1) in the setting with floating-point numbers and (2) with reals. For floats, the formalism matching recurrent GNNs is a rule-based modal logic with counting, while for reals we use a suitable infinitary modal logic, also with counting. These results give exact matches between logics and GNNs in the recurrent setting without relativising to a background logic in either case, but using some natural assumptions about floating-point arithmetic. Applying our characterizations, we also prove that, relative to graph properties definable in monadic second-order logic (MSO), our infinitary and rule-based logics are equally expressive. This implies that recurrent GNNs with reals and floats have the same expressive power over MSO-definable properties and shows that, for such properties, also recurrent GNNs with reals are characterized by a (finitary!) rule-based modal logic. In the general case, in contrast, the expressive power with floats is weaker than with reals. In addition to logic-oriented results, we also characterize recurrent GNNs, with both reals and floats, via distributed automata, drawing links to distributed computing models.

📄 PDF Abstract BibTeX arXiv:2405.14606

Code (0)

등록된 구현이 없습니다.

Tasks

Distributed Computing

Similar Papers 제목 키워드 기반

Expressive Power of Graph Transformers via Logic

2025-08-01 · Veeti Ahvonen, Maurice Funk, Damian Heiman, Antti Kuusisto 외 arxiv

Transformers are the basis of modern large language models, but relatively little is known about their precise expressive power on graphs. We study the expressive power of graph transformers (GTs) by Dwivedi and Bresson …

Low-Complexity LSTM Training and Inference with FloatSD8 Weight Representation

2020-01-23 · Yu-Tung Liu, Tzi-Dar Chiueh

The FloatSD technology has been shown to have excellent performance on low-complexity convolutional neural networks (CNNs) training and inference. In this paper, we applied FloatSD to recurrent neural networks (RNNs), sp…

Graph neural networks and MSO

2025-05-12 · Veeti Ahvonen, Damian Heiman, Antti Kuusisto

We give an alternative proof for the existing result that recurrent graph neural networks working with reals have the same expressive power in restriction to monadic second-order logic MSO as the graded modal substitutio…

Translation

FloatSOM: GPU-Accelerated, Distributed, Topology-Flexible Self-Organizing Maps

2026-04-29 · Tony Xu, Sarah Klamt, Katherine Turner, Anne Brustle 외 arxiv

GPU-accelerated Self-Organizing Map (SOM) implementations are among the most competitive options for large-scale SOM analysis, but growing dataset sizes increasingly challenge their practical use because workloads no lon…

Shedding the Bits: Pushing the Boundaries of Quantization with Minifloats on FPGAs

2023-11-21 · Shivam Aggarwal, Hans Jakob Damsgaard, Alessandro Pappalardo, Giuseppe Franco 외

Post-training quantization (PTQ) is a powerful technique for model compression, reducing the numerical precision in neural networks without additional training overhead. Recent works have investigated adopting 8-bit floa…

Model CompressionQuantization