NeuralLog: a Neural Logic Language
Application domains that require considering relationships among objects which have real-valued attributes are becoming even more important. In this paper we propose NeuralLog, a first-order logic language that is compiled to a neural network. The main goal of NeuralLog is to bridge logic programming and deep learning, allowing advances in both fields to be combined in order to obtain better machine learning models. The main advantages of NeuralLog are: to allow neural networks to be defined as logic programs; and to be able to handle numeric attributes and functions. We compared NeuralLog with two distinct systems that use first-order logic to build neural networks. We have also shown that NeuralLog can learn link prediction and classification tasks, using the same theory as the compared systems, achieving better results for the area under the ROC curve in four datasets: Cora and UWCSE for link prediction; and Yelp and PAKDD15 for classification; and comparable results for link prediction in the WordNet dataset.
Code (1)
Tasks
Link PredictionPredictionSimilar Papers 제목 키워드 기반
NeuralLog: Natural Language Inference with Joint Neural and Logical Reasoning
Deep learning (DL) based language models achieve high performance on various benchmarks for Natural Language Inference (NLI). And at this time, symbolic approaches to NLI are receiving less attention. Both approaches (sy…
Deep LearningLanguage ModelingLanguage ModellingLogical Reasoning+1Log-based Anomaly Detection Without Log Parsing
Software systems often record important runtime information in system logs for troubleshooting purposes. There have been many studies that use log data to construct machine learning models for detecting system anomalies.…
Anomaly DetectionLog ParsingNeural Logistic Bandits
We study the problem of neural logistic bandits, where the main task is to learn an unknown reward function within a logistic link function using a neural network. Existing approaches either exhibit unfavorable dependenc…
Planning with Logical Graph-based Language Model for Instruction Generation
Despite the superior performance of large language models to generate natural language texts, it is hard to generate texts with correct logic according to a given task, due to the difficulties for neural models to captur…
Language ModelingLanguage ModellingText GenerationvalidLogic Pre-Training of Language Models
Pre-trained language models (PrLMs) have been shown useful for enhancing a broad range of natural language understanding (NLU) tasks. However, the capacity for capturing logic relations in challenging NLU still remains a…
Logical ReasoningMachine Reading ComprehensionNatural Language InferenceNatural Language Understanding+3