paper-with-me

홈 › Papers

Creating Something from Nothing: Unsupervised Knowledge Distillation for Cross-Modal Hashing

2020-04-01 · CVPR 2020 6 · Hengtong Hu, Lingxi Xie, Richang Hong, Qi Tian

In recent years, cross-modal hashing (CMH) has attracted increasing attentions, mainly because its potential ability of mapping contents from different modalities, especially in vision and language, into the same space, so that it becomes efficient in cross-modal data retrieval. There are two main frameworks for CMH, differing from each other in whether semantic supervision is required. Compared to the unsupervised methods, the supervised methods often enjoy more accurate results, but require much heavier labors in data annotation. In this paper, we propose a novel approach that enables guiding a supervised method using outputs produced by an unsupervised method. Specifically, we make use of teacher-student optimization for propagating knowledge. Experiments are performed on two popular CMH benchmarks, i.e., the MIRFlickr and NUS-WIDE datasets. Our approach outperforms all existing unsupervised methods by a large margin.

📄 PDF Abstract BibTeX arXiv:2004.00280

Code (1)

huhengtong/UKD_CVPR2020 tf

Tasks

Knowledge DistillationRetrieval

Similar Papers 제목 키워드 기반

Multimodal Distillation for Egocentric Action Recognition

2023-07-14 · ICCV 2023 1 · Gorjan Radevski, Dusan Grujicic, Marie-Francine Moens, Matthew Blaschko 외

The focal point of egocentric video understanding is modelling hand-object interactions. Standard models, e.g. CNNs or Vision Transformers, which receive RGB frames as input perform well. However, their performance impro…

Action RecognitionKnowledge DistillationOptical Flow EstimationVideo Understanding

Channel-wise Dynamic Knowledge Distillation via Adaptive Sample Generation for Action Recognition

2026-08-04 · Ping Li, Chenhao Ping, Jie Song, Mingli Song arxiv

Knowledge Distillation (KD) offers a promising yet underexplored path for compressing large action recognition models. However, existing KD methods suffer from two key limitations: 1) reliance on fixed input samples lead…

Knowledge DistillationAction Recognition

Knowledge Distillation for Multimodal Egocentric Action Recognition Robust to Missing Modalities

2025-04-11 · Maria Santos-Villafranca, Dustin Carrión-Ojeda, Alejandro Perez-Yus, Jesus Bermudez-Cameo 외

Action recognition is an essential task in egocentric vision due to its wide range of applications across many fields. While deep learning methods have been proposed to address this task, most rely on a single modality, …

Action RecognitionKnowledge Distillation

Collaborative Distillation in the Parameter and Spectrum Domains for Video Action Recognition

2020-09-15 · Haisheng Su, Jing Su, Dongliang Wang, Weihao Gan 외

Recent years have witnessed the significant progress of action recognition task with deep networks. However, most of current video networks require large memory and computational resources, which hinders their applicatio…

Action RecognitionKnowledge DistillationTemporal Action Localization

Unsupervised Video Class-Incremental Learning via Deep Embedded Clustering Management

2026-01-20 · Nattapong Kurpukdee, Adrian G. Bors arxiv

Unsupervised video class incremental learning (uVCIL) represents an important learning paradigm for learning video information without forgetting, and without considering any data labels. Prior approaches have focused on…

class-incremental learningClass Incremental LearningAction Recognition