paper-with-me

홈 › Papers

TorchSpatial: A Location Encoding Framework and Benchmark for Spatial Representation Learning

2024-06-21 · Nemin Wu, Qian Cao, Zhangyu Wang, Zeping Liu, Yanlin Qi, Jielu Zhang, Joshua Ni, Xiaobai Yao, Hongxu Ma, Lan Mu, Stefano Ermon, Tanuja Ganu, Akshay Nambi, Ni Lao, Gengchen Mai

Spatial representation learning (SRL) aims at learning general-purpose neural network representations from various types of spatial data (e.g., points, polylines, polygons, networks, images, etc.) in their native formats. Learning good spatial representations is a fundamental problem for various downstream applications such as species distribution modeling, weather forecasting, trajectory generation, geographic question answering, etc. Even though SRL has become the foundation of almost all geospatial artificial intelligence (GeoAI) research, we have not yet seen significant efforts to develop an extensive deep learning framework and benchmark to support SRL model development and evaluation. To fill this gap, we propose TorchSpatial, a learning framework and benchmark for location (point) encoding, which is one of the most fundamental data types of spatial representation learning. TorchSpatial contains three key components: 1) a unified location encoding framework that consolidates 15 commonly recognized location encoders, ensuring scalability and reproducibility of the implementations; 2) the LocBench benchmark tasks encompassing 7 geo-aware image classification and 10 geo-aware image regression datasets; 3) a comprehensive suite of evaluation metrics to quantify geo-aware model's overall performance as well as their geographic bias, with a novel Geo-Bias Score metric. Finally, we provide a detailed analysis and insights into the model performance and geographic bias of different location encoders. We believe TorchSpatial will foster future advancement of spatial representation learning and spatial fairness in GeoAI research. The TorchSpatial model framework and LocBench benchmark are available at https://github.com/seai-lab/TorchSpatial, and the Geo-Bias Score evaluation framework is available at https://github.com/seai-lab/PyGBS.

📄 PDF Abstract BibTeX arXiv:2406.15658

Code (2)

seai-lab/pygbs 공식 구현 pytorch
seai-lab/torchspatial 공식 구현 pytorch

Tasks

FairnessGeographic Question Answeringimage-classificationImage ClassificationQuestion AnsweringRepresentation LearningWeather Forecasting

Similar Papers 제목 키워드 기반

Do Location Encoders Capture Spatial Effects? A GeoShapley Benchmark Across Scales

2026-06-22 · Daniel Kiv, Shaowen Wang arxiv

Location encoders transform geographic coordinates into high dimensional embeddings for downstream machine learning, but it is unclear how well these representations capture interpretable spatial effects. We benchmark wh…

Explicit Spatial Encoding for Deep Local Descriptors

2019-04-15 · CVPR 2019 6 · Arun Mukundan, Giorgos Tolias, Ondrej Chum

We propose a kernelized deep local-patch descriptor based on efficient match kernels of neural network activations. Response of each receptive field is encoded together with its spatial location using explicit feature ma…

Beyond Spatial Pyramid Matching: Space-time Extended Descriptor for Action Recognition

2015-10-15 · Zhenzhong Lan, Alexander G. Hauptmann

We address the problem of generating video features for action recognition. The spatial pyramid and its variants have been very popular feature models due to their success in balancing spatial location encoding and spati…

Action RecognitionDiversityTemporal Action Localization

A Review of Location Encoding for GeoAI: Methods and Applications

2021-11-07 · Gengchen Mai, Krzysztof Janowicz, Yingjie Hu, Song Gao 외

A common need for artificial intelligence models in the broader geoscience is to represent and encode various types of spatial data, such as points (e.g., points of interest), polylines (e.g., trajectories), polygons (e.…

Enhancing GeoAI and location encoding with spatial point pattern statistics: A Case Study of Terrain Feature Classification

2024-11-21 · Sizhe Wang, Wenwen Li

This study introduces a novel approach to terrain feature classification by incorporating spatial point pattern statistics into deep learning models. Inspired by the concept of location encoding, which aims to capture lo…

Decision Making