A Categorical Framework of General Intelligence
Can machines think? Since Alan Turing asked this question in 1950, nobody is able to give a direct answer, due to the lack of solid mathematical foundations for general intelligence. In this paper, we introduce a categorical framework towards this goal, with two main results. First, we investigate object representation through presheaves, introducing the notion of self-state awareness as a categorical analogue to self-consciousness, along with corresponding algorithms for its enforcement and evaluation. Secondly, we extend object representation to scenario representation using diagrams and limits, which then become building blocks for mathematical modeling, interpretability and AI safety. As an ancillary result, our framework introduces various categorical invariance properties that can serve as the alignment signals for model training.
Code (0)
등록된 구현이 없습니다.
Tasks
ObjectSimilar Papers 제목 키워드 기반
Computing with Categories in Machine Learning
Category theory has been successfully applied in various domains of science, shedding light on universal principles unifying diverse phenomena and thereby enabling knowledge transfer between them. Applications to machine…
Transfer LearningVariational InferencePolysemy of Synthetic Neurons Towards a New Type of Explanatory Categorical Vector Spaces
The polysemantic nature of synthetic neurons in artificial intelligence language models is currently understood as the result of a necessary superposition of distributed features within the latent space. We propose an al…
Language ModelingLanguage ModellingThe Process of Categorical Clipping at the Core of the Genesis of Concepts in Synthetic Neural Cognition
This article investigates, within the field of neuropsychology of artificial intelligence, the process of categorical segmentation performed by language models. This process involves, across different neural layers, the …
Towards Generalized Artificial Intelligence by Assessment Aggregation with Applications to Standard and Extreme Classifications
The paper studies the impacts of an aggregative Convolutional Neural Network (CNN) for the derivation of generalized artificial intelligence when starting from a specialized set of CNNs. The aggregation proposed relies o…
How Do Artificial Intelligences Think? The Three Mathematico-Cognitive Factors of Categorical Segmentation Operated by Synthetic Neurons
How do the synthetic neurons in language models create "thought categories" to segment and analyze their informational environment? What are the cognitive characteristics, at the very level of formal neurons, of this art…