Decomposed Inductive Procedure Learning: Learning Academic Tasks with Human-Like Data Efficiency
Human learning relies on specialization -- distinct cognitive mechanisms working together to enable rapid learning. In contrast, most modern neural networks rely on a single mechanism: gradient descent over an objective function. This raises the question: might human learners' relatively rapid learning from just tens of examples instead of tens of thousands in data-driven deep learning arise from our ability to use multiple specialized mechanisms of learning in combination? We investigate this question through an ablation analysis of inductive human learning simulations in online tutoring environments. Comparing reinforcement learning to a more data-efficient 3-mechanism symbolic rule induction approach, we find that decomposing learning into multiple distinct mechanisms significantly improves data efficiency, bringing it in line with human learning. Furthermore, we show that this decomposition has a greater impact on efficiency than the distinction between symbolic and subsymbolic learning alone. Efforts to align data-driven machine learning with human learning often overlook the stark difference in learning efficiency. Our findings suggest that integrating multiple specialized learning mechanisms may be key to bridging this gap.
Code (0)
등록된 구현이 없습니다.
Tasks
Procedure LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Decomposed Inductive Procedure Learning
Recent advances in machine learning have made it possible to train artificially intelligent agents that perform with super-human accuracy on a great diversity of complex tasks. However, the process of training these capa…
Procedure LearningBiOpt: Bi-Level Optimization for Few-Shot Segmentation
Few-shot segmentation is a challenging task that aims to segment objects of new classes given scarce support images. In the inductive setting, existing prototype-based methods focus on extracting prototypes from the supp…
Representation Learning in a Decomposed Encoder Design for Bio-inspired Hebbian Learning
Modern data-driven machine learning system designs exploit inductive biases in architectural structure, invariance and equivariance requirements, task-specific loss functions, and computational optimization tools. Previo…
Inductive BiasRepresentation LearningLearning Compositional Symbolic Task Rules from Demonstrations with Inductive Logic Programming
Learning from Demonstration~(LfD) should capture not only how a task is executed, but also its high-level task structure that explains the demonstrated behavior. As robots become more autonomous, such task representation…
Inductive logic programmingSyntactic Inductive Biases for Deep Learning Methods
In this thesis, we try to build a connection between the two schools by introducing syntactic inductive biases for deep learning models. We propose two families of inductive biases, one for constituency structure and ano…
Deep LearningInductive Bias