paper-with-me

Papers

DynaBench: A benchmark dataset for learning dynamical systems from low-resolution data

2023-06-09 · Andrzej Dulny, Andreas Hotho, Anna Krause

Previous work on learning physical systems from data has focused on high-resolution grid-structured measurements. However, real-world knowledge of such systems (e.g. weather data) relies on sparsely scattered measuring stations. In this paper, we introduce a novel simulated benchmark dataset, DynaBench, for learning dynamical systems directly from sparsely scattered data without prior knowledge of the equations. The dataset focuses on predicting the evolution of a dynamical system from low-resolution, unstructured measurements. We simulate six different partial differential equations covering a variety of physical systems commonly used in the literature and evaluate several machine learning models, including traditional graph neural networks and point cloud processing models, with the task of predicting the evolution of the system. The proposed benchmark dataset is expected to advance the state of art as an out-of-the-box easy-to-use tool for evaluating models in a setting where only unstructured low-resolution observations are available. The benchmark is available at https://anonymous.4open.science/r/code-2022-dynabench/.

📄 PDF Abstract BibTeX arXiv:2306.05805

Code (1)

badulion/dynabench 공식 구현 pytorch

Tasks

World Knowledge

Similar Papers 제목 키워드 기반

Dynabench: Rethinking Benchmarking in NLP

2021-04-07 · NAACL 2021 4 · Douwe Kiela, Max Bartolo, Yixin Nie, Divyansh Kaushik 외

We introduce Dynabench, an open-source platform for dynamic dataset creation and model benchmarking. Dynabench runs in a web browser and supports human-and-model-in-the-loop dataset creation: annotators seek to create ex…

Benchmarking

Dynatask: A Framework for Creating Dynamic AI Benchmark Tasks

2022-04-05 · ACL 2022 5 · Tristan Thrush, Kushal Tirumala, Anmol Gupta, Max Bartolo 외

We introduce Dynatask: an open source system for setting up custom NLP tasks that aims to greatly lower the technical knowledge and effort required for hosting and evaluating state-of-the-art NLP models, as well as for c…

Benchmarking

GrINd: Grid Interpolation Network for Scattered Observations

2024-03-28 · Andrzej Dulny, Paul Heinisch, Andreas Hotho, Anna Krause

Predicting the evolution of spatiotemporal physical systems from sparse and scattered observational data poses a significant challenge in various scientific domains. Traditional methods rely on dense grid-structured data…

DynaSent: A Dynamic Benchmark for Sentiment Analysis

2020-12-30 · ACL 2021 5 · Christopher Potts, Zhengxuan Wu, Atticus Geiger, Douwe Kiela

We introduce DynaSent ('Dynamic Sentiment'), a new English-language benchmark task for ternary (positive/negative/neutral) sentiment analysis. DynaSent combines naturally occurring sentences with sentences created using …

Sentiment Analysis

Findings of the WMT 2021 Shared Task on Large-Scale Multilingual Machine Translation

2021-11-01 · WMT (EMNLP) 2021 11 · Guillaume Wenzek, Vishrav Chaudhary, Angela Fan, Sahir Gomez 외

We present the results of the first task on Large-Scale Multilingual Machine Translation. The task consists on the many-to-many evaluation of a single model across a variety of source and target languages. This year, the…

Machine TranslationTranslation