Visual Knowledge Tracing
Each year, thousands of people learn new visual categorization tasks -- radiologists learn to recognize tumors, birdwatchers learn to distinguish similar species, and crowd workers learn how to annotate valuable data for applications like autonomous driving. As humans learn, their brain updates the visual features it extracts and attend to, which ultimately informs their final classification decisions. In this work, we propose a novel task of tracing the evolving classification behavior of human learners as they engage in challenging visual classification tasks. We propose models that jointly extract the visual features used by learners as well as predicting the classification functions they utilize. We collect three challenging new datasets from real human learners in order to evaluate the performance of different visual knowledge tracing methods. Our results show that our recurrent models are able to predict the classification behavior of human learners on three challenging medical image and species identification tasks.
Code (1)
Tasks
Autonomous DrivingGeneral ClassificationKnowledge TracingSimilar Papers 제목 키워드 기반
CleverBirds: A Multiple-Choice Benchmark for Fine-grained Human Knowledge Tracing
Mastering fine-grained visual recognition, essential in many expert domains, can require that specialists undergo years of dedicated training. Modeling the progression of such expertize in humans remains challenging, and…
Fine-Grained Visual RecognitionKnowledge TracingOn the Interpretability of Deep Learning Based Models for Knowledge Tracing
Knowledge tracing allows Intelligent Tutoring Systems to infer which topics or skills a student has mastered, thus adjusting curriculum accordingly. Deep Learning based models like Deep Knowledge Tracing (DKT) and Dynami…
Decision MakingKnowledge TracingIntegrating LSTM and BERT for Long-Sequence Data Analysis in Intelligent Tutoring Systems
The field of Knowledge Tracing aims to understand how students learn and master knowledge over time by analyzing their historical behaviour data. To achieve this goal, many researchers have proposed Knowledge Tracing mod…
Knowledge TracingRKT : Relation-Aware Self-Attention for Knowledge Tracing
The world has transitioned into a new phase of online learning in response to the recent Covid19 pandemic. Now more than ever, it has become paramount to push the limits of online learning in every manner to keep flouris…
Knowledge TracingRelationExercise Hierarchical Feature Enhanced Knowledge Tracing
Knowledge tracing is a fundamental task in the computer-aid educational system. In this paper, we propose a hierarchical exercise feature enhanced knowledge tracing framework, which could enhance the ability of knowledge…
Knowledge Tracing