paper-with-me

홈 › Papers

Self-Supervised Evolution Operator Learning for High-Dimensional Dynamical Systems

2025-05-24 · Giacomo Turri, Luigi Bonati, Kai Zhu, Massimiliano Pontil, Pietro Novelli

We introduce an encoder-only approach to learn the evolution operators of large-scale non-linear dynamical systems, such as those describing complex natural phenomena. Evolution operators are particularly well-suited for analyzing systems that exhibit complex spatio-temporal patterns and have become a key analytical tool across various scientific communities. As terabyte-scale weather datasets and simulation tools capable of running millions of molecular dynamics steps per day are becoming commodities, our approach provides an effective tool to make sense of them from a data-driven perspective. The core of it lies in a remarkable connection between self-supervised representation learning methods and the recently established learning theory of evolution operators. To show the usefulness of the proposed method, we test it across multiple scientific domains: explaining the folding dynamics of small proteins, the binding process of drug-like molecules in host sites, and autonomously finding patterns in climate data. Code and data to reproduce the experiments are made available open source.

📄 PDF Abstract BibTeX arXiv:2505.18671

Code (1)

pietronvll/encoderops 공식 구현 pytorch

Tasks

Learning TheoryOperator learningRepresentation Learning

Similar Papers 제목 키워드 기반

Evolutionary Augmentation Policy Optimization for Self-supervised Learning

2023-03-02 · Noah Barrett, Zahra Sadeghi, Stan Matwin

Self-supervised Learning (SSL) is a machine learning algorithm for pretraining Deep Neural Networks (DNNs) without requiring manually labeled data. The central idea of this learning technique is based on an auxiliary sta…

Data AugmentationSelf-Supervised Learning

Redefining Neural Operators in $d+1$ Dimensions

2025-05-17 · Haoze Song, Zhihao LI, Xiaobo Zhang, Zecheng Gan 외

Neural Operators have emerged as powerful tools for learning mappings between function spaces. Among them, the kernel integral operator has been widely validated on universally approximating various operators. Although r…

Super-Resolution

Learn to Evolve: Self-supervised Neural JKO Operator for Wasserstein Gradient Flow

2026-01-09 · Xue Feng, Li Wang, Deanna Needell, Rongjie Lai arxiv

The Jordan-Kinderlehrer-Otto (JKO) scheme provides a stable variational framework for computing Wasserstein gradient flows, but its practical use is often limited by the high computational cost of repeatedly solving the …

Data Augmentation

The evolution of cooperation: an evolutionary advantage of individuals impedes the evolution of the population

2022-01-14 · Xiaoliang Wang, Andrew Harrison

Range expansion is a universal process in biological systems, and therefore plays a part in biological evolution. Using a quantitative individual-based method based on the stochastic process, we identify that enhancing t…

Evolution: A Unified Formula for Feature Operators from a High-level Perspective

2023-05-23 · Zhicheng Cai

Traditionally, different types of feature operators (e.g., convolution, self-attention and involution) utilize different approaches to extract and aggregate the features. Resemblance can be hardly discovered from their m…