paper-with-me

홈 › Papers

Weakly Supervised Change Detection via Knowledge Distillation and Multiscale Sigmoid Inference

2024-03-09 · Binghao Lu, Caiwen Ding, Jinbo Bi, Dongjin Song

Change detection, which aims to detect spatial changes from a pair of multi-temporal images due to natural or man-made causes, has been widely applied in remote sensing, disaster management, urban management, etc. Most existing change detection approaches, however, are fully supervised and require labor-intensive pixel-level labels. To address this, we develop a novel weakly supervised change detection technique via Knowledge Distillation and Multiscale Sigmoid Inference (KD-MSI) that leverages image-level labels. In our approach, the Class Activation Maps (CAM) are utilized not only to derive a change probability map but also to serve as a foundation for the knowledge distillation process. This is done through a joint training strategy of the teacher and student networks, enabling the student network to highlight potential change areas more accurately than teacher network based on image-level labels. Moreover, we designed a Multiscale Sigmoid Inference (MSI) module as a post processing step to further refine the change probability map from the trained student network. Empirical results on three public datasets, i.e., WHU-CD, DSIFN-CD, and LEVIR-CD, demonstrate that our proposed technique, with its integrated training strategy, significantly outperforms the state-of-the-art.

📄 PDF Abstract BibTeX arXiv:2403.05796

Code (1)

binghaolu/kd-msi 공식 구현 pytorch

Tasks

Change DetectionKnowledge DistillationManagement

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Distilling Knowledge from Refinement in Multiple Instance Detection Networks

2020-04-23 · Luis Felipe Zeni, Claudio Jung

Weakly supervised object detection (WSOD) aims to tackle the object detection problem using only labeled image categories as supervision. A common approach used in WSOD to deal with the lack of localization information i…

Knowledge DistillationMultiple Instance LearningObjectobject-detection+4

Weakly Supervised Monocular 3D Detection with a Single-View Image

2024-02-29 · CVPR 2024 1 · Xueying Jiang, Sheng Jin, Lewei Lu, Xiaoqin Zhang 외

Monocular 3D detection (M3D) aims for precise 3D object localization from a single-view image which usually involves labor-intensive annotation of 3D detection boxes. Weakly supervised M3D has recently been studied to ob…

Knowledge DistillationObject LocalizationSelf-Knowledge DistillationTransfer Learning

SimReg: Regression as a Simple Yet Effective Tool for Self-supervised Knowledge Distillation

2022-01-13 · K L Navaneet, Soroush Abbasi Koohpayegani, Ajinkya Tejankar, Hamed Pirsiavash

Feature regression is a simple way to distill large neural network models to smaller ones. We show that with simple changes to the network architecture, regression can outperform more complex state-of-the-art approaches …

Knowledge Distillationregression

Multi-Label Image Classification via Knowledge Distillation from Weakly-Supervised Detection

2018-09-16 · Yongcheng Liu, Lu Sheng, Jing Shao, Junjie Yan 외

Multi-label image classification is a fundamental but challenging task towards general visual understanding. Existing methods found the region-level cues (e.g., features from RoIs) can facilitate multi-label classificati…

ClassificationGeneral Classificationimage-classificationImage Classification+5

Fully Convolutional Change Detection Framework with Generative Adversarial Network for Unsupervised, Weakly Supervised and Regional Supervised Change Detection

2022-01-16 · Chen Wu, Bo Du, Liangpei Zhang

Deep learning for change detection is one of the current hot topics in the field of remote sensing. However, most end-to-end networks are proposed for supervised change detection, and unsupervised change detection models…

Change DetectionGenerative Adversarial Network