Unsupervised Progressive Learning and the STAM Architecture
We first pose the Unsupervised Progressive Learning (UPL) problem: an online representation learning problem in which the learner observes a non-stationary and unlabeled data stream, learning a growing number of features that persist over time even though the data is not stored or replayed. To solve the UPL problem we propose the Self-Taught Associative Memory (STAM) architecture. Layered hierarchies of STAM modules learn based on a combination of online clustering, novelty detection, forgetting outliers, and storing only prototypical features rather than specific examples. We evaluate STAM representations using clustering and classification tasks. While there are no existing learning scenarios that are directly comparable to UPL, we compare the STAM architecture with two recent continual learning models, Memory Aware Synapses (MAS) and Gradient Episodic Memories (GEM), after adapting them in the UPL setting.
Code (1)
Tasks
ClusteringContinual LearningNovelty DetectionOnline ClusteringRepresentation LearningSimilar Papers 제목 키워드 기반
A neuro-inspired architecture for unsupervised continual learning based on online clustering and hierarchical predictive coding
We propose that the Continual Learning desiderata can be achieved through a neuro-inspired architecture, grounded on Mountcastle's cortical column hypothesis. The proposed architecture involves a single module, called Se…
ClusteringContinual LearningOnline ClusteringUnsupervised Continual Learning and Self-Taught Associative Memory Hierarchies
We first pose the Unsupervised Continual Learning (UCL) problem: learning salient representations from a non-stationary stream of unlabeled data in which the number of object classes varies with time. Given limited label…
Continual LearningOnline ClusteringStampNet: unsupervised multi-class object discovery
Unsupervised object discovery in images involves uncovering recurring patterns that define objects and discriminates them against the background. This is more challenging than image clustering as the size and the locatio…
ClusteringImage ClusteringObjectObject DiscoveryStamp processing with examplar features
Document digitization is becoming increasingly crucial. In this work, we propose a shape based approach for automatic stamp verification/detection in document images using an unsupervised feature learning. Given a small …
ClusteringReducing the Label Bias for Timestamp Supervised Temporal Action Segmentation
Timestamp supervised temporal action segmentation (TSTAS) is more cost-effective than fully supervised counterparts. However, previous approaches suffer from severe label bias due to over-reliance on sparse timestamp…
Action SegmentationTemporal Action Segmentation