Continual Reasoning: Non-Monotonic Reasoning in Neurosymbolic AI using Continual Learning
Despite the extensive investment and impressive recent progress at reasoning by similarity, deep learning continues to struggle with more complex forms of reasoning such as non-monotonic and commonsense reasoning. Non-monotonicity is a property of non-classical reasoning typically seen in commonsense reasoning, whereby a reasoning system is allowed (differently from classical logic) to jump to conclusions which may be retracted later, when new information becomes available. Neural-symbolic systems such as Logic Tensor Networks (LTN) have been shown to be effective at enabling deep neural networks to achieve reasoning capabilities. In this paper, we show that by combining a neural-symbolic system with methods from continual learning, LTN can obtain a higher level of accuracy when addressing non-monotonic reasoning tasks. Continual learning is added to LTNs by adopting a curriculum of learning from knowledge and data with recall. We call this process Continual Reasoning, a new methodology for the application of neural-symbolic systems to reasoning tasks. Continual Reasoning is applied to a prototypical non-monotonic reasoning problem as well as other reasoning examples. Experimentation is conducted to compare and analyze the effects that different curriculum choices may have on overall learning and reasoning results. Results indicate significant improvement on the prototypical non-monotonic reasoning problem and a promising outlook for the proposed approach on statistical relational learning examples.
Code (0)
등록된 구현이 없습니다.
Tasks
Continual LearningRelational ReasoningTensor NetworksSimilar Papers 제목 키워드 기반
World Models in Artificial Intelligence: Sensing, Learning, and Reasoning Like a Child
World Models help Artificial Intelligence (AI) predict outcomes, reason about its environment, and guide decision-making. While widely used in reinforcement learning, they lack the structured, adaptive representations th…
Causal InferenceContinual LearningDecision MakingContinual Reasoning Gym: Diagnosing and Harnessing Shared Reasoning in Continual RLVR
Reinforcement learning with verifiable rewards (RLVR) commonly post-trains reasoning models on multiple tasks, while rerunning multitask RLVR (MTRL) as new tasks are added makes capability expansion costly. We therefore …
Reinforcement LearningVisual ReasoningSelective Replay Enhances Learning in Online Continual Analogical Reasoning
In continual learning, a system learns from non-stationary data streams or batches without catastrophic forgetting. While this problem has been heavily studied in supervised image classification and reinforcement learnin…
Continual Learningimage-classificationImage ClassificationReasoning Portability: Guiding Continual Learning for MLLMs in the RLVR Era
Vision-Language Models in Continual Learning (VLM-CL) aim to continuously adapt to new multimodal tasks while retaining prior knowledge. The emerging paradigm that couples Multimodal Large Language Models (MLLMs) with Re…
Reinforcement LearningContinual LearningNeuro-Symbolic Continual Learning: Knowledge, Reasoning Shortcuts and Concept Rehearsal
We introduce Neuro-Symbolic Continual Learning, where a model has to solve a sequence of neuro-symbolic tasks, that is, it has to map sub-symbolic inputs to high-level concepts and compute predictions by reasoning consis…
Continual Learning