Visual Learning of Arithmetic Operations
A simple Neural Network model is presented for end-to-end visual learning of arithmetic operations from pictures of numbers. The input consists of two pictures, each showing a 7-digit number. The output, also a picture, displays the number showing the result of an arithmetic operation (e.g., addition or subtraction) on the two input numbers. The concepts of a number, or of an operator, are not explicitly introduced. This indicates that addition is a simple cognitive task, which can be learned visually using a very small number of neurons. Other operations, e.g., multiplication, were not learnable using this architecture. Some tasks were not learnable end-to-end (e.g., addition with Roman numerals), but were easily learnable once broken into two separate sub-tasks: a perceptual \textit{Character Recognition} and cognitive \textit{Arithmetic} sub-tasks. This indicates that while some tasks may be easily learnable end-to-end, other may need to be broken into sub-tasks.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
BRo-JEPA: Learning Modular Transformations in Latent Space
Can neural networks learn algebraic rules from visual inputs, or do they merely fit observed patterns? We study this question using MNIST (or EMNIST letters) as states and modular arithmetic operations as actions in a JE…
Zero-shot GeneralizationAcceleration of Grokking in Learning Arithmetic Operations via Kolmogorov-Arnold Representation
We propose novel methodologies aimed at accelerating the grokking phenomenon, which refers to the rapid increment of test accuracy after a long period of overfitting as reported in~\cite{power2022grokking}. Focusing on t…
Data AugmentationDecoderTransfer LearningNeural Arithmetic Expression Calculator
This paper presents a pure neural solver for arithmetic expression calculation (AEC) problem. Previous work utilizes the powerful capabilities of deep neural networks and attempts to build an end-to-end model to solve th…
Hierarchical Reinforcement LearningReinforcement LearningMachine Number Sense: A Dataset of Visual Arithmetic Problems for Abstract and Relational Reasoning
As a comprehensive indicator of mathematical thinking and intelligence, the number sense (Dehaene 2011) bridges the induction of symbolic concepts and the competence of problem-solving. To endow such a crucial cognitive …
Relational ReasoningVisual ReasoningAttribute Token Arithmetic: Disentangled and Continuous Semantic Control for Visual Autoregressive Models
Autoregressive text-to-image generation has recently achieved remarkable progress, offering high-fidelity synthesis via a unified generative framework. However, fine-grained semantic control remains challenging due to th…
Computational EfficiencyText-to-Image Generation