Accelerating Machine Learning via the Weber-Fechner Law
The Weber-Fechner Law observes that human perception scales as the logarithm of the stimulus. We argue that learning algorithms for human concepts could benefit from the Weber-Fechner Law. Specifically, we impose Weber-Fechner on simple neural networks, with or without convolution, via the logarithmic power series of their sorted output. Our experiments show surprising performance and accuracy on the MNIST data set within a few training iterations and limited computational resources, suggesting that Weber-Fechner can accelerate machine learning of human concepts.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningSimilar Papers 제목 키워드 기반
Psychophysical Machine Learning
The Weber Fechner Law of psychophysics observes that human perception is logarithmic in the stimulus. We present an algorithm for incorporating the Weber Fechner law into loss functions for machine learning, and use the …
Deep LearningPsychophysical laws as reflection of mental space properties
The paper is devoted to the relationship between psychophysics and physics of mind. The basic trends in psychophysics development are briefly discussed with special attention focused on Teghtsoonian's hypotheses. These h…
Spatial Stimuli Gradient Sketch Model
The inability of automated edge detection methods inspired from primal sketch models to accurately calculate object edges under the influence of pixel noise is an open problem. Extending the principles of image perceptio…
Edge DetectionFace RecognitionmodelObjectWeber-Fechner Law in Temporal Difference learning derived from Control as Inference
This paper investigates a novel nonlinear update rule based on temporal difference (TD) errors in reinforcement learning (RL). The update rule in the standard RL states that the TD error is linearly proportional to the d…
Reinforcement Learning (RL)Number detectors spontaneously emerge in a deep neural network designed for visual object recognition
Humans and animals have a “number sense,” an innate capability to intuitively assess the number of visual items in a set, its numerosity. This capability implies that mechanisms to extract numerosity indwell the brain’…
ObjectObject Recognition