paper-with-me

홈 › Papers

GeoAI Reproducibility and Replicability: a computational and spatial perspective

2024-04-15 · Wenwen Li, Chia-Yu Hsu, Sizhe Wang, Peter Kedron

GeoAI has emerged as an exciting interdisciplinary research area that combines spatial theories and data with cutting-edge AI models to address geospatial problems in a novel, data-driven manner. While GeoAI research has flourished in the GIScience literature, its reproducibility and replicability (R&R), fundamental principles that determine the reusability, reliability, and scientific rigor of research findings, have rarely been discussed. This paper aims to provide an in-depth analysis of this topic from both computational and spatial perspectives. We first categorize the major goals for reproducing GeoAI research, namely, validation (repeatability), learning and adapting the method for solving a similar or new problem (reproducibility), and examining the generalizability of the research findings (replicability). Each of these goals requires different levels of understanding of GeoAI, as well as different methods to ensure its success. We then discuss the factors that may cause the lack of R&R in GeoAI research, with an emphasis on (1) the selection and use of training data; (2) the uncertainty that resides in the GeoAI model design, training, deployment, and inference processes; and more importantly (3) the inherent spatial heterogeneity of geospatial data and processes. We use a deep learning-based image analysis task as an example to demonstrate the results' uncertainty and spatial variance caused by different factors. The findings reiterate the importance of knowledge sharing, as well as the generation of a "replicability map" that incorporates spatial autocorrelation and spatial heterogeneity into consideration in quantifying the spatial replicability of GeoAI research.

📄 PDF Abstract BibTeX arXiv:2404.10108

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Philosophical Foundations of GeoAI: Exploring Sustainability, Diversity, and Bias in GeoAI and Spatial Data Science

2023-03-27 · Krzysztof Janowicz

This chapter presents some of the fundamental assumptions and principles that could form the philosophical foundation of GeoAI and spatial data science. Instead of reviewing the well-established characteristics of spatia…

Diversity

Building benchmarking frameworks for supporting replicability and reproducibility: spatial and textual analysis as an example

2020-07-04 · Yingjie Hu

Replicability and reproducibility (R&R) are critical for the long-term prosperity of a scientific discipline. In GIScience, researchers have discussed R&R related to different research topics and problems, such as local …

BenchmarkingPosition

Unbox Responsible GeoAI: Navigating Climate Extreme and Disaster Mapping

2026-05-01 · Hao Li, Steffen Knoblauch arxiv

As climate extreme and disaster events become more frequent and intense, Geospatial Artificial Intelligence (GeoAI) has emerged as a transformative approach for large-scale disaster mapping and risk reduction. However, t…

ReproGen: Proposal for a Shared Task on Reproducibility of Human Evaluations in NLG

2020-12-01 · INLG (ACL) 2020 12 · Anya Belz, Shubham Agarwal, Anastasia Shimorina, Ehud Reiter

Across NLP, a growing body of work is looking at the issue of reproducibility. However, replicability of human evaluation experiments and reproducibility of their results is currently under-addressed, and this is of part…

The Role of Open-Source LLMs in Shaping the Future of GeoAI

2025-04-24 · Xiao Huang, Zhengzhong Tu, Xinyue Ye, Michael Goodchild

Large Language Models (LLMs) are transforming geospatial artificial intelligence (GeoAI), offering new capabilities in data processing, spatial analysis, and decision support. This paper examines the open-source paradigm…