paper-with-me

홈 › Papers

Multi-Scale Structural Features for Continual, Comprehensible Visual Recognition in a Developmental Learning Framework

2026-07-28 · Zeki Doruk Erden arxiv

Contemporary machine learning struggles to learn continually, reuse prior knowledge, and expose a comprehensible internal structure. A recently proposed developmental, gradient-free learning framework addresses these limitations by learning a discrete, topological model of its inputs through local variation and selection, yielding an inherent continual-learning guarantee: new observations refine existing structure without overwriting past knowledge, and without replay buffers or predefined task boundaries. Its extension to visual inputs demonstrated this principle on shape recognition, but relied on a feature representation of limited expressivity that capped recognition accuracy. We introduce a new visual feature representation that encodes shape structure across multiple scales, capturing edge and contour features together with their spatial relations, and integrate it with the network-refinement learning process; we further improve the learning dynamics and the read-out used to predict from the learned model. The study targets two-dimensional shape, with class-incremental MNIST as a controlled, interpretable benchmark in which continual-learning behavior can be measured directly. Our approach substantially increases accuracy over the prior representation, matching or exceeding replay- and regularisation-based baselines at comparable storage while storing no past data, and preserves the framework's defining behavior: earlier-learned classes are retained as new ones are introduced, with no destructive adaptation, and the learned representations remain human-interpretable. What separates the methods is retention: the baselines surrender most of a just-trained class within its own cycle and relearn it afterwards, which ours does not. The significance lies in the manner of learning. The system integrates information one sample at a time while provably preserving its responses to...

📄 PDF Abstract BibTeX arXiv:2607.25531

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Agential AI for Integrated Continual Learning, Deliberative Behavior, and Comprehensible Models

2025-01-28 · Zeki Doruk Erden, Boi Faltings

Contemporary machine learning paradigm excels in statistical data analysis, solving problems that classical AI couldn't. However, it faces key limitations, such as a lack of integration with planning, incomprehensible in…

Continual Learning

Semiparametric Language Models Are Scalable Continual Learners

2023-03-02 · Guangyue Peng, Tao Ge, Si-Qing Chen, Furu Wei 외

Semiparametric language models (LMs) have shown promise in continuously learning from new text data by combining a parameterized neural LM with a growable non-parametric memory for memorizing new content. However, conven…

Continual LearningLanguage ModelingLanguage ModellingMemorization

Continually Learning Structured Visual Representations via Network Refinement with Rerelation

2025-02-19 · Zeki Doruk Erden, Boi Faltings

Current machine learning paradigm relies on continuous representations like neural networks, which iteratively adjust parameters to approximate outcomes rather than directly learning the structure of problem. This spread…

Incremental Learning

Interactive Semantic Featuring for Text Classification

2016-06-24 · Camille Jandot, Patrice Simard, Max Chickering, David Grangier 외

In text classification, dictionaries can be used to define human-comprehensible features. We propose an improvement to dictionary features called smoothed dictionary features. These features recognize document contexts i…

ClassificationGeneral Classificationtext-classificationText Classification

On the Limitation and Experience Replay for GNNs in Continual Learning

2023-02-07 · Junwei Su, Difan Zou, Chuan Wu

Continual learning seeks to empower models to progressively acquire information from a sequence of tasks. This approach is crucial for many real-world systems, which are dynamic and evolve over time. Recent research has …

Continual LearningIncremental LearningModel Selection