Benchmarking Energy-Conserving Neural Networks for Learning Dynamics from Data
The last few years have witnessed an increased interest in incorporating physics-informed inductive bias in deep learning frameworks. In particular, a growing volume of literature has been exploring ways to enforce energy conservation while using neural networks for learning dynamics from observed time-series data. In this work, we survey ten recently proposed energy-conserving neural network models, including HNN, LNN, DeLaN, SymODEN, CHNN, CLNN and their variants. We provide a compact derivation of the theory behind these models and explain their similarities and differences. Their performance are compared in 4 physical systems. We point out the possibility of leveraging some of these energy-conserving models to design energy-based controllers.
Code (0)
등록된 구현이 없습니다.
Tasks
BenchmarkingInductive BiasTime SeriesTime Series AnalysisSimilar Papers 제목 키워드 기반
Born-Infeld (BI) for AI: Energy-Conserving Descent (ECD) for Optimization
We introduce a novel framework for optimization based on energy-conserving Hamiltonian dynamics in a strongly mixing (chaotic) regime and establish its key properties analytically and numerically. The prototype is a disc…
Improving Energy Conserving Descent for Machine Learning: Theory and Practice
We develop the theory of Energy Conserving Descent (ECD) and introduce ECDSep, a gradient-based optimization algorithm able to tackle convex and non-convex optimization problems. The method is based on the novel ECD fram…
Learning TheoryClassical and Quantum Speedups for Non-Convex Optimization via Energy Conserving Descent
The Energy Conserving Descent (ECD) algorithm was recently proposed (De Luca & Silverstein, 2022) as a global non-convex optimization method. Unlike gradient descent, appropriately configured ECD dynamics escape strict l…
Learning Energy Conserving Dynamics Efficiently with Hamiltonian Gaussian Processes
Hamiltonian mechanics is one of the cornerstones of natural sciences. Recently there has been significant interest in learning Hamiltonian systems in a free-form way directly from trajectory data. Previous methods have t…
Gaussian ProcessesStabilization of Energy-Conserving Gaits for Point-Foot Planar Bipeds
The problem of designing and stabilizing impact-free, energy-conserving gaits is considered for underactuated, point-foot planar bipeds. Virtual holonomic constraints are used to design energy-conserving gaits. A desired…