paper-with-me

홈 › Papers

Compressing multidimensional weather and climate data into neural networks

2022-10-22 · Langwen Huang, Torsten Hoefler

Weather and climate simulations produce petabytes of high-resolution data that are later analyzed by researchers in order to understand climate change or severe weather. We propose a new method of compressing this multidimensional weather and climate data: a coordinate-based neural network is trained to overfit the data, and the resulting parameters are taken as a compact representation of the original grid-based data. While compression ratios range from 300x to more than 3,000x, our method outperforms the state-of-the-art compressor SZ3 in terms of weighted RMSE, MAE. It can faithfully preserve important large scale atmosphere structures and does not introduce artifacts. When using the resulting neural network as a 790x compressed dataloader to train the WeatherBench forecasting model, its RMSE increases by less than 2%. The three orders of magnitude compression democratizes access to high-resolution climate data and enables numerous new research directions.

📄 PDF Abstract BibTeX arXiv:2210.12538

Code (1)

spcl/nncompression 공식 구현 tf

Methods 이 논문이 사용한 방법론

MAE 설명 없음

Similar Papers 제목 키워드 기반

DIRESA, a distance-preserving nonlinear dimension reduction technique based on regularized autoencoders

2024-04-28 · Geert De Paepe, Lesley De Cruz

In meteorology, finding similar weather patterns or analogs in historical datasets can be useful for data assimilation, forecasting, and postprocessing. In climate science, analogs in historical and climate projection da…

Climate ProjectionDimensionality Reduction

XAI4Extremes: An interpretable machine learning framework for understanding extreme-weather precursors under climate change

2025-03-11 · Jiawen Wei, Aniruddha Bora, Vivek Oommen, Chenyu Dong 외

Extreme weather events are increasing in frequency and intensity due to climate change. This, in turn, is exacting a significant toll in communities worldwide. While prediction skills are increasing with advances in nume…

Interpretable Machine Learning

Foundation Models for Weather and Climate Data Understanding: A Comprehensive Survey

2023-12-05 · Shengchao Chen, Guodong Long, Jing Jiang, Dikai Liu 외

As artificial intelligence (AI) continues to rapidly evolve, the realm of Earth and atmospheric sciences is increasingly adopting data-driven models, powered by progressive developments in deep learning (DL). Specificall…

The economic impact of weather and climate

2021-02-25 · Richard S. J. Tol

I propose a new conceptual framework to disentangle the impacts of weather and climate on economic activity and growth: A stochastic frontier model with climate in the production frontier and weather shocks as a source o…

Evaluating Skill and Stability of ArchesWeather and ArchesWeatherGen under Multi-Decadal Climate Simulations

2026-05-28 · Renu Singh, Robert Brunstein, Antonia Jost, Yana Hasson 외 arxiv

We evaluate the climate simulation capabilities of ArchesWeather and ArchesWeatherGen, two machine learning models originally trained for weather forecasting and evaluated up to a 10-day lead time. ArchesWeather is a det…

Weather Forecasting