paper-with-me

홈 › Papers

Deconstructing the Inductive Biases of Hamiltonian Neural Networks

2022-02-10 · ICLR 2022 4 · Nate Gruver, Marc Finzi, Samuel Stanton, Andrew Gordon Wilson

Physics-inspired neural networks (NNs), such as Hamiltonian or Lagrangian NNs, dramatically outperform other learned dynamics models by leveraging strong inductive biases. These models, however, are challenging to apply to many real world systems, such as those that don't conserve energy or contain contacts, a common setting for robotics and reinforcement learning. In this paper, we examine the inductive biases that make physics-inspired models successful in practice. We show that, contrary to conventional wisdom, the improved generalization of HNNs is the result of modeling acceleration directly and avoiding artificial complexity from the coordinate system, rather than symplectic structure or energy conservation. We show that by relaxing the inductive biases of these models, we can match or exceed performance on energy-conserving systems while dramatically improving performance on practical, non-conservative systems. We extend this approach to constructing transition models for common Mujoco environments, showing that our model can appropriately balance inductive biases with the flexibility required for model-based control.

📄 PDF Abstract BibTeX arXiv:2202.04836

Code (1)

ngruver/decon-hnn 공식 구현 pytorch

Tasks

MuJoCo

Similar Papers 제목 키워드 기반

Enhancing the Inductive Biases of Graph Neural ODE for Modeling Dynamical Systems

2022-09-22 · Suresh Bishnoi, Ravinder Bhattoo, Sayan Ranu, N. M. Anoop Krishnan

Neural networks with physics based inductive biases such as Lagrangian neural networks (LNN), and Hamiltonian neural networks (HNN) learn the dynamics of physical systems by encoding strong inductive biases. Alternativel…

Separable Hamiltonian Neural Networks

2023-09-03 · Zi-Yu Khoo, Dawen Wu, Jonathan Sze Choong Low, Stéphane Bressan

Hamiltonian neural networks (HNNs) are state-of-the-art models that regress the vector field of a dynamical system under the learning bias of Hamilton's equations. A recent observation is that embedding a bias regarding …

Physics-informed machine learningregression

Hamiltonian Graph Networks with ODE Integrators

2019-09-27 · Alvaro Sanchez-Gonzalez, Victor Bapst, Kyle Cranmer, Peter Battaglia

We introduce an approach for imposing physically informed inductive biases in learned simulation models. We combine graph networks with a differentiable ordinary differential equation integrator as a mechanism for predic…

Zero-shot Generalization

Hamiltonian Neural Networks

2019-06-04 · NeurIPS 2019 12 · Sam Greydanus, Misko Dzamba, Jason Yosinski

Even though neural networks enjoy widespread use, they still struggle to learn the basic laws of physics. How might we endow them with better inductive biases? In this paper, we draw inspiration from Hamiltonian mechanic…

Port-metriplectic neural networks: thermodynamics-informed machine learning of complex physical systems

2022-11-03 · Quercus Hernández, Alberto Badías, Francisco Chinesta, Elías Cueto

We develop inductive biases for the machine learning of complex physical systems based on the port-Hamiltonian formalism. To satisfy by construction the principles of thermodynamics in the learned physics (conservation o…