paper-with-me

Papers

SAFE: a SAR Feature Extractor based on self-supervised learning and masked Siamese ViTs

2024-06-30 · Max Muzeau, Joana Frontera-Pons, Chengfang Ren, Jean-Philippe Ovarlez

Due to its all-weather and day-and-night capabilities, Synthetic Aperture Radar imagery is essential for various applications such as disaster management, earth monitoring, change detection and target recognition. However, the scarcity of labeled SAR data limits the performance of most deep learning algorithms. To address this issue, we propose a novel self-supervised learning framework based on masked Siamese Vision Transformers to create a General SAR Feature Extractor coined SAFE. Our method leverages contrastive learning principles to train a model on unlabeled SAR data, extracting robust and generalizable features. SAFE is applicable across multiple SAR acquisition modes and resolutions. We introduce tailored data augmentation techniques specific to SAR imagery, such as sub-aperture decomposition and despeckling. Comprehensive evaluations on various downstream tasks, including few-shot classification, segmentation, visualization, and pattern detection, demonstrate the effectiveness and versatility of the proposed approach. Our network competes with or surpasses other state-of-the-art methods in few-shot classification and segmentation tasks, even without being trained on the sensors used for the evaluation.

📄 PDF Abstract BibTeX arXiv:2407.00851

Code (1)

muzmax/safe 공식 구현 pytorch

Tasks

Change DetectionContrastive LearningData AugmentationFew-Shot Classification and SegmentationManagementSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Spectral-Spatial Self-Supervised Learning for Few-Shot Hyperspectral Image Classification

2025-05-18 · Wenchen Chen, Yanmei Zhang, Zhongwei Xiao, Jianping Chu 외

Few-shot classification of hyperspectral images (HSI) faces the challenge of scarce labeled samples. Self-Supervised learning (SSL) and Few-Shot Learning (FSL) offer promising avenues to address this issue. However, exis…

Classification Of Hyperspectral ImagesDiversityFew-Shot LearningHyperspectral Image Classification+3

Exploring Self-Supervised Vision Transformers for Deepfake Detection: A Comparative Analysis

2024-05-01 · Huy H. Nguyen, Junichi Yamagishi, Isao Echizen

This paper investigates the effectiveness of self-supervised pre-trained vision transformers (ViTs) compared to supervised pre-trained ViTs and conventional neural networks (ConvNets) for detecting facial deepfake images…

DeepFake DetectionFace SwappingFew-Shot LearningSelf-Supervised Learning+1

MARLIN: Masked Autoencoder for facial video Representation LearnINg

2022-11-12 · CVPR 2023 1 · Zhixi Cai, Shreya Ghosh, Kalin Stefanov, Abhinav Dhall 외

This paper proposes a self-supervised approach to learn universal facial representations from videos, that can transfer across a variety of facial analysis tasks such as Facial Attribute Recognition (FAR), Facial Express…

Action ClassificationAttributeDeepFake DetectionEmotion Classification+8

PersonViT: Large-scale Self-supervised Vision Transformer for Person Re-Identification

2024-08-10 · Bin Hu, Xinggang Wang, Wenyu Liu

Person Re-Identification (ReID) aims to retrieve relevant individuals in non-overlapping camera images and has a wide range of applications in the field of public safety. In recent years, with the development of Vision T…

Contrastive LearningPerson Re-IdentificationSelf-Supervised LearningUnsupervised Pre-training

Uni4Eye: Unified 2D and 3D Self-supervised Pre-training via Masked Image Modeling Transformer for Ophthalmic Image Classification

2022-03-09 · Zhiyuan Cai, Li Lin, Huaqing He, Xiaoying Tang

A large-scale labeled dataset is a key factor for the success of supervised deep learning in computer vision. However, a limited number of annotated data is very common, especially in ophthalmic image analysis, since man…

image-classificationImage ClassificationSelf-Supervised Learning