Multistage Relation Network With Dual-Metric for Few-Shot Hyperspectral Image Classification
Recently, few-shot learning (FSL) has exhibited great potential in the hyperspectral image (HSI) classification due to its promising performance under a few training samples. Although existing FSL methods have achieved great success, some limitations can still be witnessed. On the one hand, current methods mainly rely on a single metric to identify, which cannot effectively represent the class distribution with few labeled samples. On the other hand, existing methods usually only use the last deep feature of the feature extractor, which may lead to the under-utilization of scarce labeled samples. To overcome the above issues, a novel multistage relation network with dual-metric (DM-MRN) is proposed for few-shot HSI classification. First, a sample recombination strategy is designed to increase the variety of classification tasks in the training period. Second, an embedding module is employed to extract deep features of the input image patches. Third, we propose two relation modules: image-to-class (I2C) block and image-to-image (I2I) block. The I2C block is designed to compute the I2C-level relation score between second-order features, and the I2I block is conceived to generate the I2I-level relation score between first-order features. Finally, DM-MRN is constructed by integrating one embedding module, two I2C blocks, and one I2I block. In addition, an adaptive weighting strategy is designed to fuse the obtained relation scores, and classification can be achieved by assigning each query sample to the class with the highest value of the fused relation score. Extensive experiments carried out on five popular HSI datasets demonstrate that the proposed method outperforms other traditional and advanced models under few training samples in terms of classification accuracy and generalization performance, i.e., the performance improvement in terms of OA is around 0.30%–27.98% under ten labeled samples per class.
Code (1)
Tasks
ClassificationFew-Shot Image ClassificationFew-Shot LearningHyperspectral Image Classificationimage-classificationImage ClassificationRelationRelation NetworkSimilar Papers 제목 키워드 기반
Multi-level Relation Learning for Cross-domain Few-shot Hyperspectral Image Classification
Cross-domain few-shot hyperspectral image classification focuses on learning prior knowledge from a large number of labeled samples from source domains and then transferring the knowledge to the tasks which contain few l…
ClassificationContrastive LearningCross-Domain Few-Shotcross-domain few-shot learning+5MultistageOT: Multistage optimal transport infers trajectories from a snapshot of single-cell data
Single-cell RNA-sequencing captures a temporal slice, or a snapshot, of a cell differentiation process. A major bioinformatical challenge is the inference of differentiation trajectories from a single snapshot, and metho…
Dual camera snapshot hyperspectral imaging system via physics informed learning
We consider using the system's optical imaging process with convolutional neural networks (CNNs) to solve the snapshot hyperspectral imaging reconstruction problem, which uses a dual-camera system to capture the three-di…
Dual Modality Prompted Diffusion Priors for Zero Shot Hyperspectral Pansharpening
Hyperspectral pansharpening aims to reconstruct a high resolution hyperspectral (HRHS) image from a panchromatic (PAN) image and a low resolution hyperspectral (LRHS) image while preserving both spatial details and spect…
PCMamba: Physics-Informed Cross-Modal State Space Model for Dual-Camera Compressive Hyperspectral Imaging
Panchromatic (PAN) -assisted Dual-Camera Compressive Hyperspectral Imaging (DCCHI) is a key technology in snapshot hyperspectral imaging. Existing research primarily focuses on exploring spectral information from 2D comp…
Inductive BiasMamba