paper-with-me

Papers

When Geoscience Meets Foundation Models: Towards General Geoscience Artificial Intelligence System

2023-09-13 · Hao Zhang, Jin-Jian Xu, Hong-Wei Cui, Lin Li, Yaowen Yang, Chao-Sheng Tang, Niklas Boers

Artificial intelligence (AI) has significantly advanced Earth sciences, yet its full potential in to comprehensively modeling Earth's complex dynamics remains unrealized. Geoscience foundation models (GFMs) emerge as a paradigm-shifting solution, integrating extensive cross-disciplinary data to enhance the simulation and understanding of Earth system dynamics. These data-centric AI models extract insights from petabytes of structured and unstructured data, effectively addressing the complexities of Earth systems that traditional models struggle to capture. The unique strengths of GFMs include flexible task specification, diverse input-output capabilities, and multi-modal knowledge representation, enabling analyses that surpass those of individual data sources or traditional AI methods. This review not only highlights the key advantages of GFMs, but also presents essential techniques for their construction, with a focus on transformers, pre-training, and adaptation strategies. Subsequently, we examine recent advancements in GFMs, including large language models, vision models, and vision-language models, particularly emphasizing the potential applications in remote sensing. Additionally, the review concludes with a comprehensive analysis of the challenges and future trends in GFMs, addressing five critical aspects: data integration, model complexity, uncertainty quantification, interdisciplinary collaboration, and concerns related to privacy, trust, and security. This review offers a comprehensive overview of emerging geoscientific research paradigms, emphasizing the untapped opportunities at the intersection of advanced AI techniques and geoscience. It examines major methodologies, showcases advances in large-scale models, and discusses the challenges and prospects that will shape the future landscape of GFMs.

📄 PDF Abstract BibTeX arXiv:2309.06799

Code (0)

등록된 구현이 없습니다.

Tasks

Data IntegrationUncertainty Quantification

Similar Papers 제목 키워드 기반

When Geoscience Meets Generative AI and Large Language Models: Foundations, Trends, and Future Challenges

2024-01-25 · Abdenour Hadid, Tanujit Chakraborty, Daniel Busby

Generative Artificial Intelligence (GAI) represents an emerging field that promises the creation of synthetic data and outputs in different modalities. GAI has recently shown impressive results across a large spectrum of…

Decision MakingSuper-ResolutionUncertainty Quantification

K2: A Foundation Language Model for Geoscience Knowledge Understanding and Utilization

2023-06-08 · Cheng Deng, Tianhang Zhang, Zhongmou He, Yi Xu 외

Large language models (LLMs) have achieved great success in general domains of natural language processing. In this paper, we bring LLMs to the realm of geoscience with the objective of advancing research and application…

Language ModelingLanguage Modelling

Cross-Domain Foundation Model Adaptation: Pioneering Computer Vision Models for Geophysical Data Analysis

2024-08-22 · Zhixiang Guo, Xinming Wu, Luming Liang, Hanlin Sheng 외

We explore adapting foundation models (FMs) from the computer vision domain to geoscience. FMs, large neural networks trained on massive datasets, excel in diverse tasks with remarkable adaptability and generality. Howev…

Coarse-to-fine Task-driven Inpainting for Geoscience Images

2022-11-20 · Huiming Sun, Jin Ma, Qing Guo, Qin Zou 외

The processing and recognition of geoscience images have wide applications. Most of existing researches focus on understanding the high-quality geoscience images by assuming that all the images are clear. However, in man…

Data AugmentationDecoderImage InpaintingScene Recognition+1

70 years of machine learning in geoscience in review

2020-06-16 · Jesper Sören Dramsch

This review gives an overview of the development of machine learning in geoscience. A thorough analysis of the co-developments of machine learning applications throughout the last 70 years relates the recent enthusiasm f…

BIG-bench Machine LearningGaussian ProcessesGeochemistryGeophysics