Stacked Structure Learning for Lifted Relational Neural Networks

2017-10-05 · Gustav Sourek, Martin Svatos, Filip Zelezny, Steven Schockaert, Ondrej Kuzelka

Lifted Relational Neural Networks (LRNNs) describe relational domains using weighted first-order rules which act as templates for constructing feed-forward neural networks. While previous work has shown that using LRNNs can lead to state-of-the-art results in various ILP tasks, these results depended on hand-crafted rules. In this paper, we extend the framework of LRNNs with structure learning, thus enabling a fully automated learning process. Similarly to many ILP methods, our structure learning algorithm proceeds in an iterative fashion by top-down searching through the hypothesis space of all possible Horn clauses, considering the predicates that occur in the training examples as well as invented soft concepts entailed by the best weighted rules found so far. In the experiments, we demonstrate the ability to automatically induce useful hierarchical soft concepts leading to deep LRNNs with a competitive predictive power.

📄 PDF Abstract BibTeX arXiv:1710.02221

Code (0)

등록된 구현이 없습니다.

Lifted Relational Neural Networks

2015-08-20 · Gustav Sourek, Vojtech Aschenbrenner, Filip Zelezny, Ondrej Kuzelka

We propose a method combining relational-logic representations with neural network learning. A general lifted architecture, possibly reflecting some background domain knowledge, is described through relational rules whic…

Relational Reasoning

Non-Parametric Learning of Lifted Restricted Boltzmann Machines

2020-01-09 · Navdeep Kaur, Gautam Kunapuli, Sriraam Natarajan

We consider the problem of discriminatively learning restricted Boltzmann machines in the presence of relational data. Unlike previous approaches that employ a rule learner (for structure learning) and a weight learner (…

regression

Lifted Model Checking for Relational MDPs

2021-06-22 · Wen-Chi Yang, Jean-François Raskin, Luc De Raedt

Probabilistic model checking has been developed for verifying systems that have stochastic and nondeterministic behavior. Given a probabilistic system, a probabilistic model checker takes a property and checks whether or…

model Model-based Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Lifted Region-Based Belief Propagation

2016-06-30 · David Smith, Parag Singla, Vibhav Gogate

Due to the intractable nature of exact lifted inference, research has recently focused on the discovery of accurate and efficient approximate inference algorithms in Statistical Relational Models (SRMs), such as Lifted F…

Why is Compiling Lifted Inference into a Low-Level Language so Effective?

2016-06-14 · Seyed Mehran Kazemi, David Poole

First-order knowledge compilation techniques have proven efficient for lifted inference. They compile a relational probability model into a target circuit on which many inference queries can be answered efficiently. Earl…