Creating Something from Nothing: Unsupervised Knowledge Distillation for Cross-Modal Hashing
In recent years, cross-modal hashing (CMH) has attracted increasing attentions, mainly because its potential ability of mapping contents from different modalities, especially in vision and language, into the same space, so that it becomes efficient in cross-modal data retrieval. There are two main frameworks for CMH, differing from each other in whether semantic supervision is required. Compared to the unsupervised methods, the supervised methods often enjoy more accurate results, but require much heavier labors in data annotation. In this paper, we propose a novel approach that enables guiding a supervised method using outputs produced by an unsupervised method. Specifically, we make use of teacher-student optimization for propagating knowledge. Experiments are performed on two popular CMH benchmarks, i.e., the MIRFlickr and NUS-WIDE datasets. Our approach outperforms all existing unsupervised methods by a large margin.
Code (1)
Tasks
Knowledge DistillationRetrievalSimilar Papers 제목 키워드 기반
Multimodal Distillation for Egocentric Action Recognition
The focal point of egocentric video understanding is modelling hand-object interactions. Standard models, e.g. CNNs or Vision Transformers, which receive RGB frames as input perform well. However, their performance impro…
Action RecognitionKnowledge DistillationOptical Flow EstimationVideo UnderstandingChannel-wise Dynamic Knowledge Distillation via Adaptive Sample Generation for Action Recognition
Knowledge Distillation (KD) offers a promising yet underexplored path for compressing large action recognition models. However, existing KD methods suffer from two key limitations: 1) reliance on fixed input samples lead…
Knowledge DistillationAction RecognitionKnowledge Distillation for Multimodal Egocentric Action Recognition Robust to Missing Modalities
Action recognition is an essential task in egocentric vision due to its wide range of applications across many fields. While deep learning methods have been proposed to address this task, most rely on a single modality, …
Action RecognitionKnowledge DistillationCollaborative Distillation in the Parameter and Spectrum Domains for Video Action Recognition
Recent years have witnessed the significant progress of action recognition task with deep networks. However, most of current video networks require large memory and computational resources, which hinders their applicatio…
Action RecognitionKnowledge DistillationTemporal Action LocalizationUnsupervised Video Class-Incremental Learning via Deep Embedded Clustering Management
Unsupervised video class incremental learning (uVCIL) represents an important learning paradigm for learning video information without forgetting, and without considering any data labels. Prior approaches have focused on…
class-incremental learningClass Incremental LearningAction Recognition