Learning to Interpret Satellite Images in Global Scale Using Wikipedia
Despite recent progress in computer vision, finegrained interpretation of satellite images remains challenging because of a lack of labeled training data. To overcome this limitation, we construct a novel dataset called WikiSatNet by pairing georeferenced Wikipedia articles with satellite imagery of their corresponding locations. We then propose two strategies to learn representations of satellite images by predicting properties of the corresponding articles from the images. Leveraging this new multi-modal dataset, we can drastically reduce the quantity of human-annotated labels and time required for downstream tasks. On the recently released fMoW dataset, our pre-training strategies can boost the performance of a model pre-trained on ImageNet by up to 4:5% in F1 score.
Code (3)
Tasks
ArticlesSimilar Papers 제목 키워드 기반
Learning to Interpret Satellite Images Using Wikipedia
Despite recent progress in computer vision, fine-grained interpretation of satellite images remains challenging because of a lack of labeled training data. To overcome this limitation, we propose using Wikipedia as a pre…
ArticlesEnvisioning global urban development with satellite imagery and generative AI
Urban development has been a defining force in human history, shaping cities for centuries. However, past studies mostly analyze such development as predictive tasks, failing to reflect its generative nature. Therefore, …
Building Detection from Satellite Images on a Global Scale
In the last several years, remote sensing technology has opened up the possibility of performing large scale building detection from satellite imagery. Our work is some of the first to create population density maps from…
Density EstimationFedSpace: An Efficient Federated Learning Framework at Satellites and Ground Stations
Large-scale deployments of low Earth orbit (LEO) satellites collect massive amount of Earth imageries and sensor data, which can empower machine learning (ML) to address global challenges such as real-time disaster navig…
Federated LearningDeep Learning Based Large-Scale Automatic Satellite Crosswalk Classification
High-resolution satellite imagery have been increasingly used on remote sensing classification problems. One of the main factors is the availability of this kind of data. Even though, very little effort has been placed o…
ClassificationDeep LearningGeneral Classification