paper-with-me

홈 › Papers

Transforming the Use of Earth Observation Data: Exascale Training of a Generative Compression Model with Historical Priors for up to 10,000x Data Reduction

2026-05-09 · Jinxiao Zhang, Runmin Dong, Xiyong Wu, Xihan Huang, Shenggan Cheng, Yunkai Yang, Zheng Zhou, Yunpu Xu, Zhaoyang Luo, Miao Yang, Fan Wei, Mengxuan Chen, Yang You, Juepeng Zheng, Weijia Li, Yutong Lu, Haohuan Fu arxiv

Earth observation is becoming one of the largest data-producing activities in science, yet current pipelines still treat compression as a storage and transmission tool rather than a new way to use data. We present a generative compression framework that learns from historical Earth observation archives and enables on-demand 100x to 10,000x data reduction across downstream tasks. Unlike general visual data, Earth observation repeatedly measures the same evolving planet, making historical-prior learning feasible for extreme compression. To realize this paradigm, we train large generative compression models at exascale on the LineShine Armv9 CPU supercomputer, with co-optimization across model design, kernels, memory hierarchy, runtime, and parallelism. Our implementation sustains 1.54 EFLOP/s and peaks at 2.16 EFLOP/s in end-to-end training. This work shows that historical-prior generative compression can turn Earth observation data into an active, task-adaptive foundation for acquisition, delivery, storage, and scientific use.

📄 PDF Abstract BibTeX arXiv:2605.08633

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Global Attention with Linear Complexity for Exascale Generative Data Assimilation in Earth System Prediction

2026-04-17 · Xiao Wang, Zezhong Zhang, Isaac Lyngaas, Hong-Jun Yoon 외 arxiv

Accurate weather and climate prediction relies on data assimilation (DA), which estimates the Earth system state by integrating observations with models. While exascale computing has significantly advanced earth simulati…

Stratospheric aerosol source inversion: Noise, variability, and uncertainty quantification

2024-09-10 · J. Hart, I. Manickam, M. Gulian, L. Swiler 외

Stratospheric aerosols play an important role in the earth system and can affect the climate on timescales of months to years. However, estimating the characteristics of partially observed aerosol injections, such as tho…

Dimensionality ReductionOperator learningUncertainty Quantification

Towards Scalable and Generalizable Earth Observation Data Mining via Foundation Model Composition

2025-06-25 · Man Duc Chuc

Foundation models are rapidly transforming Earth Observation data mining by enabling generalizable and scalable solutions for key tasks such as scene classification and semantic segmentation. While most efforts in the ge…

Earth ObservationKnowledge DistillationScene ClassificationSemantic Segmentation

EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues

2024-12-19 · CVPR 2025 1 · Sagar Soni, Akshay Dudhane, Hiyam Debary, Mustansar Fiaz 외

Automated analysis of vast Earth observation data via interactive Vision-Language Models (VLMs) can unlock new opportunities for environmental monitoring, disaster response, and resource management. Existing generic VLMs…

Change DetectionDisaster ResponseEarth ObservationQuestion Answering+2

FPGA-Enabled Machine Learning Applications in Earth Observation: A Systematic Review

2025-06-04 · Cédric Léonard, Dirk Stober, Martin Schulz

New UAV technologies and the NewSpace era are transforming Earth Observation missions and data acquisition. Numerous small platforms generate large data volume, straining bandwidth and requiring onboard decision-making t…

Decision MakingEarth Observation