paper-with-me

Papers

Learning higher-order logic programs

2019-07-25 · Andrew Cropper, Rolf Morel, Stephen H. Muggleton

A key feature of inductive logic programming (ILP) is its ability to learn first-order programs, which are intrinsically more expressive than propositional programs. In this paper, we introduce techniques to learn higher-order programs. Specifically, we extend meta-interpretive learning (MIL) to support learning higher-order programs by allowing for \emph{higher-order definitions} to be used as background knowledge. Our theoretical results show that learning higher-order programs, rather than first-order programs, can reduce the textual complexity required to express programs which in turn reduces the size of the hypothesis space and sample complexity. We implement our idea in two new MIL systems: the Prolog system \namea{} and the ASP system \nameb{}. Both systems support learning higher-order programs and higher-order predicate invention, such as inventing functions for \tw{map/3} and conditions for \tw{filter/3}. We conduct experiments on four domains (robot strategies, chess playing, list transformations, and string decryption) that compare learning first-order and higher-order programs. Our experimental results support our theoretical claims and show that, compared to learning first-order programs, learning higher-order programs can significantly improve predictive accuracies and reduce learning times.

📄 PDF Abstract BibTeX arXiv:1907.10953

Code (2)

andrewcropper/mlj19-metaho 공식 구현
metagol/metagol 공식 구현

Tasks

Inductive logic programming

Similar Papers 제목 키워드 기반

The Stable Model Semantics for Higher-Order Logic Programming

2024-08-20 · Bart Bogaerts, Angelos Charalambidis, Giannos Chatziagapis, Babis Kostopoulos 외

We propose a stable model semantics for higher-order logic programs. Our semantics is developed using Approximation Fixpoint Theory (AFT), a powerful formalism that has successfully been used to give meaning to diverse n…

Learning Higher-Order Programs without Meta-Interpretive Learning

2021-12-29 · Stanisław J. Purgał, David M. Cerna, Cezary Kaliszyk

Learning complex programs through inductive logic programming (ILP) remains a formidable challenge. Existing higher-order enabled ILP systems show improved accuracy and learning performance, though remain hampered by the…

Inductive logic programming

Learning logic programs by discovering higher-order abstractions

2023-08-16 · Céline Hocquette, Sebastijan Dumančić, Andrew Cropper

We introduce the higher-order refactoring problem, where the goal is to compress a logic program by discovering higher-order abstractions, such as map, filter, and fold. We implement our approach in Stevie, which formula…

Inductive logic programmingProgram SynthesisVisual Reasoning

Higher-Order Generalization Bounds: Learning Deep Probabilistic Programs via PAC-Bayes Objectives

2022-03-30 · Jonathan Warrell, Mark Gerstein

Deep Probabilistic Programming (DPP) allows powerful models based on recursive computation to be learned using efficient deep-learning optimization techniques. Additionally, DPP offers a unified perspective, where infere…

Generalization BoundsMeta-LearningProbabilistic Programming

$ω$PAP Spaces: Reasoning Denotationally About Higher-Order, Recursive Probabilistic and Differentiable Programs

2023-02-21 · Mathieu Huot, Alexander K. Lew, Vikash K. Mansinghka, Sam Staton

We introduce a new setting, the category of $\omega$PAP spaces, for reasoning denotationally about expressive differentiable and probabilistic programming languages. Our semantics is general enough to assign meanings to …

Probabilistic Programming