paper-with-me

홈 › Papers

GeoFormer: A Lightweight Swin Transformer for Joint Building Height and Footprint Estimation from Sentinel Imagery

2026-02-10 · Han Jinzhen, JinByeong Lee, JiSung Kim, MinKyung Cho, DaHee Kim, HongSik Yun arxiv

Building height (BH) and footprint (BF) are fundamental urban morphological parameters required by climate modelling, disaster-risk assessment, and population mapping, yet globally consistent data remain scarce. In this work, we develop GeoFormer, a lightweight Swin Transformer-based multi-task learning framework that jointly estimates BH and BF on a 100 m grid using only open-access Sentinel-1 SAR, Sentinel-2 multispectral, and DEM data. A geo-blocked data-splitting strategy enforces strict spatial independence between training and evaluation regions across 54 morphologically diverse cities. We set representative CNN baselines (ResNet, UNet, SENet) as benchmarks and thoroughly evaluate GeoFormer's prediction accuracy, computational efficiency, and spatial transferability. Results show that GeoFormer achieves a BH RMSE of 3.19 m with only 0.32 M parameters -- outperforming the best CNN baseline (UNet) by 7.5% -- indicating that windowed local attention is more effective than convolution for scene-level building-parameter retrieval. Systematic ablation on context window size, model capacity, and input modality further reveals that a 5x5 (500 m) receptive field is optimal, DEM is indispensable for height estimation, and multispectral reflectance carries the dominant predictive signal. Cross-continent transfer tests confirm BH RMSE below 3.5 m without region-specific fine-tuning. All code, model weights, and the resulting global product are publicly released.

📄 PDF Abstract BibTeX arXiv:2602.09932

Code (0)

등록된 구현이 없습니다.

Tasks

Computational EfficiencyMulti-Task Learning

Similar Papers 제목 키워드 기반

GeoFormer: A Multi-Polygon Segmentation Transformer

2024-11-25 · Maxim Khomiakov, Michael Riis Andersen, Jes Frellsen

In remote sensing there exists a common need for learning scale invariant shapes of objects like buildings. Prior works relies on tweaking multiple loss functions to convert segmentation maps into the final scale invaria…

Geometric Transformer with Interatomic Positional Encoding

2023-09-21 · NeurIPS 2023 11

The widespread adoption of Transformer architectures in various data modalities has opened new avenues for the applications in molecular modeling. Nevertheless, it remains elusive that whether the Transformer-based arch…

N-Gram in Swin Transformers for Efficient Lightweight Image Super-Resolution

2022-11-21 · CVPR 2023 1 · Haram Choi, Jeongmin Lee, Jihoon Yang

While some studies have proven that Swin Transformer (Swin) with window self-attention (WSA) is suitable for single image super-resolution (SR), the plain WSA ignores the broad regions when reconstructing high-resolution…

Image Super-ResolutionSuper-Resolution

GeoFormer: Predicting Human Mobility using Generative Pre-trained Transformer (GPT)

2023-11-09 · Aivin V. Solatorio

Predicting human mobility holds significant practical value, with applications ranging from enhancing disaster risk planning to simulating epidemic spread. In this paper, we present the GeoFormer, a decoder-only transfor…

DecoderDynamic Time Warping

GeoFormer: Learning Point Cloud Completion with Tri-Plane Integrated Transformer

2024-08-13 · Jinpeng Yu, Binbin Huang, Yuxuan Zhang, Huaxia Li 외

Point cloud completion aims to recover accurate global geometry and preserve fine-grained local details from partial point clouds. Conventional methods typically predict unseen points directly from 3D point cloud coordin…

Point Cloud Completion