paper-with-me

홈 › Papers

Learning Concepts Definable in First-Order Logic with Counting

2019-09-09 · Steffen van Bergerem

We study Boolean classification problems over relational background structures in the logical framework introduced by Grohe and Tur\'an (TOCS 2004). It is known (Grohe and Ritzert, LICS 2017) that classifiers definable in first-order logic over structures of polylogarithmic degree can be learned in sublinear time, where the degree of the structure and the running time are measured in terms of the size of the structure. We generalise the results to the first-order logic with counting FOCN, which was introduced by Kuske and Schweikardt (LICS 2017) as an expressive logic generalising various other counting logics. Specifically, we prove that classifiers definable in FOCN over classes of structures of polylogarithmic degree can be consistently learned in sublinear time. This can be seen as a first step towards extending the learning framework to include numerical aspects of machine learning. We extend the result to agnostic probably approximately correct (PAC) learning for classes of structures of degree at most $(\log \log n)^c$ for some constant $c$. Moreover, we show that bounding the degree is crucial to obtain sublinear-time learning algorithms. That is, we prove that, for structures of unbounded degree, learning is not possible in sublinear time, even for classifiers definable in plain first-order logic.

📄 PDF Abstract BibTeX arXiv:1909.03820

Code (0)

등록된 구현이 없습니다.

Tasks

General ClassificationPAC learning

Similar Papers 제목 키워드 기반

Learning first-order definable concepts over structures of small degree

2017-01-19 · Martin Grohe, Martin Ritzert

We consider a declarative framework for machine learning where concepts and hypotheses are defined by formulas of a logic over some background structure. We show that within this framework, concepts defined by first-orde…

BIG-bench Machine Learning

Logical Characterizations of Recurrent Graph Neural Networks with Reals and Floats

2024-05-23 · Veeti Ahvonen, Damian Heiman, Antti Kuusisto, Carsten Lutz

In pioneering work from 2019, Barcel\'o and coauthors identified logics that precisely match the expressive power of constant iteration-depth graph neural networks (GNNs) relative to properties definable in first-order l…

Distributed Computing

Expressive Power of Graph Transformers via Logic

2025-08-01 · Veeti Ahvonen, Maurice Funk, Damian Heiman, Antti Kuusisto 외 arxiv

Transformers are the basis of modern large language models, but relatively little is known about their precise expressive power on graphs. We study the expressive power of graph transformers (GTs) by Dwivedi and Bresson …

Granule Description based on Compound Concepts

2021-10-29 · Jianqin Zhou, Sichun Yang, Xifeng Wang, Wanquan Liu

Concise granule descriptions for definable granules and approaching descriptions for indefinable granules are challenging and important issues in granular computing. The concept with only common attributes has been inten…

Object

Halting Recurrent GNNs and the Graded $μ$-Calculus

2025-05-16 · Jeroen Bollen, Jan Van den Bussche, Stijn Vansummeren, Jonni Virtema

Graph Neural Networks (GNNs) are a class of machine-learning models that operate on graph-structured data. Their expressive power is intimately related to logics that are invariant under graded bisimilarity. Current prop…