paper-with-me

Papers

Semi-Supervised Contrastive Learning for Remote Sensing: Identifying Ancient Urbanization in the South Central Andes

2021-12-13 · Jiachen Xu, Junlin Guo, James Zimmer-Dauphinee, Quan Liu, Yuxuan Shi, Zuhayr Asad, D. Mitchell Wilkes, Parker VanValkenburgh, Steven A. Wernke, Yuankai Huo

Archaeology has long faced fundamental issues of sampling and scalar representation. Traditionally, the local-to-regional-scale views of settlement patterns are produced through systematic pedestrian surveys. Recently, systematic manual survey of satellite and aerial imagery has enabled continuous distributional views of archaeological phenomena at interregional scales. However, such 'brute force' manual imagery survey methods are both time- and labor-intensive, as well as prone to inter-observer differences in sensitivity and specificity. The development of self-supervised learning methods offers a scalable learning scheme for locating archaeological features using unlabeled satellite and historical aerial images. However, archaeological features are generally only visible in a very small proportion relative to the landscape, while the modern contrastive-supervised learning approach typically yields an inferior performance on highly imbalanced datasets. In this work, we propose a framework to address this long-tail problem. As opposed to the existing contrastive learning approaches that treat the labelled and unlabeled data separately, our proposed method reforms the learning paradigm under a semi-supervised setting in order to utilize the precious annotated data (<7% in our setting). Specifically, the highly unbalanced nature of the data is employed as the prior knowledge in order to form pseudo negative pairs by ranking the similarities between unannotated image patches and annotated anchor images. In this study, we used 95,358 unlabeled images and 5,830 labelled images in order to solve the issues associated with detecting ancient buildings from a long-tailed satellite image dataset. From the results, our semi-supervised contrastive learning model achieved a promising testing balanced accuracy of 79.0%, which is a 3.8% improvement as compared to other state-of-the-art approaches.

📄 PDF Abstract BibTeX arXiv:2112.06437

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningSelf-Supervised LearningSpecificity

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

X-ModalNet: A Semi-Supervised Deep Cross-Modal Network for Classification of Remote Sensing Data

2020-06-24 · Danfeng Hong, Naoto Yokoya, Gui-Song Xia, Jocelyn Chanussot 외

This paper addresses the problem of semi-supervised transfer learning with limited cross-modality data in remote sensing. A large amount of multi-modal earth observation images, such as multispectral imagery (MSI) or syn…

Earth ObservationGeneral ClassificationTransfer Learning

S-CLIP: Semi-supervised Vision-Language Learning using Few Specialist Captions

2023-05-23 · NeurIPS 2023 11 · Sangwoo Mo, Minkyu Kim, Kyungmin Lee, Jinwoo Shin

Vision-language models, such as contrastive language-image pre-training (CLIP), have demonstrated impressive results in natural image domains. However, these models often struggle when applied to specialized domains like…

Contrastive LearningImage-text RetrievalPartial Label LearningPseudo Label+3

Debiased Learning for Remote Sensing Data

2023-12-24 · Chun-Hsiao Yeh, Xudong Wang, Stella X. Yu, Charles Hill 외

Deep learning has had remarkable success at analyzing handheld imagery such as consumer photos due to the availability of large-scale human annotations (e.g., ImageNet). However, remote sensing data lacks such extensive …

Dual Contrastive Network for Few-Shot Remote Sensing Image Scene Classification

2026-03-24 · Zhong Ji, Liyuan Hou, Xuan Wang, Gang Wang 외 arxiv

Few-shot remote sensing image scene classification (FS-RSISC) aims at classifying remote sensing images with only a few labeled samples. The main challenges lie in small inter-class variances and large intra-class varian…

Scene ClassificationContrastive Learning

Supervising Remote Sensing Change Detection Models with 3D Surface Semantics

2022-02-26 · Isaac Corley, Peyman Najafirad

Remote sensing change detection, identifying changes between scenes of the same location, is an active area of research with a broad range of applications. Recent advances in multimodal self-supervised pretraining have r…

Change DetectionRepresentation Learning