paper-with-me

Papers

Multi-Teacher Multi-Objective Meta-Learning for Zero-Shot Hyperspectral Band Selection

2024-06-12 · Jie Feng, Xiaojian Zhong, Di Li, Weisheng Dong, Ronghua Shang, Licheng Jiao

Band selection plays a crucial role in hyperspectral image classification by removing redundant and noisy bands and retaining discriminative ones. However, most existing deep learning-based methods are aimed at dealing with a specific band selection dataset, and need to retrain parameters for new datasets, which significantly limits their generalizability.To address this issue, a novel multi-teacher multi-objective meta-learning network (M$^3$BS) is proposed for zero-shot hyperspectral band selection. In M$^3$BS, a generalizable graph convolution network (GCN) is constructed to generate dataset-agnostic base, and extract compatible meta-knowledge from multiple band selection tasks. To enhance the ability of meta-knowledge extraction, multiple band selection teachers are introduced to provide diverse high-quality experiences.strategy Finally, subsequent classification tasks are attached and jointly optimized with multi-teacher band selection tasks through multi-objective meta-learning in an end-to-end trainable way. Multi-objective meta-learning guarantees to coordinate diverse optimization objectives automatically and adapt to various datasets simultaneously. Once the optimization is accomplished, the acquired meta-knowledge can be directly transferred to unseen datasets without any retraining or fine-tuning. Experimental results demonstrate the effectiveness and efficiency of our proposed method on par with state-of-the-art baselines for zero-shot hyperspectral band selection.

📄 PDF Abstract BibTeX arXiv:2406.07949

Code (0)

등록된 구현이 없습니다.

Tasks

Hyperspectral Image Classificationimage-classificationImage ClassificationMeta-Learning

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Zero-Shot Knowledge Distillation in Deep Networks

2019-05-20 · Gaurav Kumar Nayak, Konda Reddy Mopuri, Vaisakh Shaj, R. Venkatesh Babu 외

Knowledge distillation deals with the problem of training a smaller model (Student) from a high capacity source model (Teacher) so as to retain most of its performance. Existing approaches use either the training data or…

Knowledge Distillation

Zero-shot Knowledge Transfer via Adversarial Belief Matching

2019-05-23 · NeurIPS 2019 12 · Paul Micaelli, Amos Storkey

Performing knowledge transfer from a large teacher network to a smaller student is a popular task in modern deep learning applications. However, due to growing dataset sizes and stricter privacy regulations, it is increa…

Transfer Learning

Adaptive Multi-Teacher Knowledge Distillation with Meta-Learning

2023-06-11 · Hailin Zhang, Defang Chen, Can Wang

Multi-Teacher knowledge distillation provides students with additional supervision from multiple pre-trained teachers with diverse information sources. Most existing methods explore different weighting strategies to obta…

Knowledge DistillationMeta-Learning

OmniRetriever: Any-to-Any Audio-Video-Text Retrieval via Fusion-as-Teacher Distillation

2026-05-26 · Yunze Liu, Chi-Hao Wu, Enmin Zhou, Junxiao Shen arxiv

Unified multimodal embedding spaces have become the standard interface for cross-modal retrieval and multimodal RAG, and recent audio-video-text (AVT) encoders extend this setting to three modalities. Such encoders can p…

Cross-Modal RetrievalVideo-Text Retrieval

MetaTS: Meta Teacher-Student Network for Multilingual Sequence Labeling with Minimal Supervision

2021-11-01 · EMNLP 2021 11 · Zheng Li, Danqing Zhang, Tianyu Cao, Ying WEI 외

Sequence labeling aims to predict a fine-grained sequence of labels for the text. However, such formulation hinders the effectiveness of supervised methods due to the lack of token-level annotated data. This is exacerbat…

Meta-Learning