paper-with-me

홈 › Papers

SARMAE: Masked Autoencoder for SAR Representation Learning

2025-12-18 · Danxu Liu, Di Wang, Hebaixu Wang, Haoyang Chen, Wentao Jiang, Yilin Cheng, Haonan Guo, Wei Cui, Jing Zhang arxiv

Synthetic Aperture Radar (SAR) imagery plays a critical role in all-weather, day-and-night remote sensing applications. However, existing SAR-oriented deep learning is constrained by data scarcity, while the physically grounded speckle noise in SAR imagery further hampers fine-grained semantic representation learning. To address these challenges, we propose SARMAE, a Noise-Aware Masked Autoencoder for self-supervised SAR representation learning. Specifically, we construct SAR-1M, the first million-scale SAR dataset, with additional paired optical images, to enable large-scale pre-training. Building upon this, we design Speckle-Aware Representation Enhancement (SARE), which injects SAR-specific speckle noise into masked autoencoders to facilitate noise-aware and robust representation learning. Furthermore, we introduce Semantic Anchor Representation Constraint (SARC), which leverages paired optical priors to align SAR features and ensure semantic consistency. Extensive experiments across multiple SAR datasets demonstrate that SARMAE achieves state-of-the-art performance on classification, detection, and segmentation tasks. Code and models will be available at https://github.com/MiliLab/SARMAE.

📄 PDF Abstract BibTeX arXiv:2512.16635

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

Exploring Target Representations for Masked Autoencoders

2022-09-08 · Xingbin Liu, Jinghao Zhou, Tao Kong, Xianming Lin 외

Masked autoencoders have become popular training paradigms for self-supervised visual representation learning. These models randomly mask a portion of the input and reconstruct the masked portion according to the target …

Image ClassificationInstance SegmentationKnowledge Distillationobject-detection+5

Context Autoencoder for Self-Supervised Representation Learning

2022-02-07 · Xiaokang Chen, Mingyu Ding, Xiaodi Wang, Ying Xin 외

We present a novel masked image modeling (MIM) approach, context autoencoder (CAE), for self-supervised representation pretraining. We pretrain an encoder by making predictions in the encoded representation space. The pr…

DecoderInstance Segmentationobject-detectionObject Detection+4

Diffusion Models as Masked Autoencoders

2023-04-06 · ICCV 2023 1 · Chen Wei, Karttikeya Mangalam, Po-Yao Huang, Yanghao Li 외

There has been a longstanding belief that generation can facilitate a true understanding of visual data. In line with this, we revisit generatively pre-training visual representations in light of recent interest in denoi…

DenoisingImage Inpainting

Rethinking Patch Dependence for Masked Autoencoders

2024-01-25 · Letian Fu, Long Lian, Renhao Wang, Baifeng Shi 외

In this work, we re-examine inter-patch dependencies in the decoding mechanism of masked autoencoders (MAE). We decompose this decoding mechanism for masked patch reconstruction in MAE into self-attention and cross-atten…

DecoderInstance SegmentationRepresentation LearningSemantic Segmentation

Multi-View Masked World Models for Visual Robotic Manipulation

2023-02-05 · Younggyo Seo, Junsu Kim, Stephen James, Kimin Lee 외

Visual robotic manipulation research and applications often use multiple cameras, or views, to better perceive the world. How else can we utilize the richness of multi-view data? In this paper, we investigate how to lear…

Camera CalibrationRepresentation Learning