Less is More: some Computational Principles based on Parcimony, and Limitations of Natural Intelligence
Natural intelligence (NI) consistently achieves more with less. Infants learn language, develop abstract concepts, and acquire sensorimotor skills from sparse data, all within tight neural and energy limits. In contrast, today's AI relies on virtually unlimited computational power, energy, and data to reach high performance. This paper argues that constraints in NI are paradoxically catalysts for efficiency, adaptability, and creativity. We first show how limited neural bandwidth promotes concise codes that still capture complex patterns. Spiking neurons, hierarchical structures, and symbolic-like representations emerge naturally from bandwidth constraints, enabling robust generalization. Next, we discuss chaotic itinerancy, illustrating how the brain transits among transient attractors to flexibly retrieve memories and manage uncertainty. We then highlight reservoir computing, where random projections facilitate rapid generalization from small datasets. Drawing on developmental perspectives, we emphasize how intrinsic motivation, along with responsive social environments, drives infant language learning and discovery of meaning. Such active, embodied processes are largely absent in current AI. Finally, we suggest that adopting 'less is more' principles -- energy constraints, parsimonious architectures, and real-world interaction -- can foster the emergence of more efficient, interpretable, and biologically grounded artificial systems.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
User-Centric Cell-Free (UCCF) Wireless Systems: Principles and Optimization
User-centric cell-free (UCCF) wireless networks have a range of distinguished characteristics, which can be exploited for meeting some challenges that the conventional cellular systems are hard to. This chapter is devote…
Should Terminology Principles be re-examined?
Operationalization of terminology for IT applications has revived the Wusterian approach. The conceptual dimension once more prevails after taking back seat to specialised lexicography. This is demonstrated by the emerge…
Scan transcription of two-dimensional shapes as an alternative neuromorphic concept
Selfridge, along with Sutherland and Marr provided some of the earliest proposals for how to program computers to recognize shapes. Their emphasis on filtering for contour features, especially the orientation of boundary…
Vocal Bursts Valence PredictionUpdatable Closed-Form Evaluation of Arbitrarily Complex Multi-Port Network Connections
The design of large complex wave systems (filters, networks, vacuum-electronic devices, metamaterials, smart radio environments, etc.) requires repeated evaluations of the scattering parameters resulting from complex con…
FormAutoMat: Accelerated Computational Electrochemical systems Discovery
Large-scale electrification is vital to addressing the climate crisis, but several scientific and technological challenges remain to fully electrify both the chemical industry and transportation. In both of these areas, …
ManagementPhysics-informed machine learning