paper-with-me

홈 › Papers

Physics-integrated generative modeling using attentive planar normalizing flow based variational autoencoder

2024-04-18 · Sheikh Waqas Akhtar

Physics-integrated generative modeling is a class of hybrid or grey-box modeling in which we augment the the data-driven model with the physics knowledge governing the data distribution. The use of physics knowledge allows the generative model to produce output in a controlled way, so that the output, by construction, complies with the physical laws. It imparts improved generalization ability to extrapolate beyond the training distribution as well as improved interpretability because the model is partly grounded in firm domain knowledge. In this work, we aim to improve the fidelity of reconstruction and robustness to noise in the physics integrated generative model. To this end, we use variational-autoencoder as a generative model. To improve the reconstruction results of the decoder, we propose to learn the latent posterior distribution of both the physics as well as the trainable data-driven components using planar normalizng flow. Normalizng flow based posterior distribution harnesses the inherent dynamical structure of the data distribution, hence the learned model gets closer to the true underlying data distribution. To improve the robustness of generative model against noise injected in the model, we propose a modification in the encoder part of the normalizing flow based VAE. We designed the encoder to incorporate scaled dot product attention based contextual information in the noisy latent vector which will mitigate the adverse effect of noise in the latent vector and make the model more robust. We empirically evaluated our models on human locomotion dataset [33] and the results validate the efficacy of our proposed models in terms of improvement in reconstruction quality as well as robustness against noise injected in the model.

📄 PDF Abstract BibTeX arXiv:2404.12267

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative Modeling

2021-02-25 · NeurIPS 2021 12 · Naoya Takeishi, Alexandros Kalousis

Integrating physics models within machine learning models holds considerable promise toward learning robust models with improved interpretability and abilities to extrapolate. In this work, we focus on the integration of…

Learning Planar Ising Models

2015-02-03 · Jason K. Johnson, Diane Oyen, Michael Chertkov, Praneeth Netrapalli

Inference and learning of graphical models are both well-studied problems in statistics and machine learning that have found many applications in science and engineering. However, exact inference is intractable in genera…

Weighted Flow Matching and Physics-Informed Nonlinear Filtering for Parameter Estimation in Digital Twins

2026-05-16 · Yasar Yanik, Himadri Basu, Ricardo G. Sanfelice, Daniele Venturi arxiv

Digital twins (DTs) rely on continuous synchronization between physical systems and their virtual counterparts through online parameter estimation under uncertainty. In many practical settings, however, this task is chal…

Attentive Convolution: Equipping CNNs with RNN-style Attention Mechanisms

2017-10-02 · TACL 2018 1 · Wenpeng Yin, Hinrich Schütze

In NLP, convolutional neural networks (CNNs) have benefited less than recurrent neural networks (RNNs) from attention mechanisms. We hypothesize that this is because the attention in CNNs has been mainly implemented as a…

Claim VerificationNatural Language InferenceRepresentation LearningSentence+1

Pace: Physics-Aware Attentive Temporal Convolutional Network for Battery Health Estimation

2025-12-12 · Sara Sameer, Wei Zhang, Dhivya Dharshini Kannan, Xin Lou 외 arxiv

Batteries are critical components in modern energy systems such as electric vehicles and power grid energy storage. Effective battery health management is essential for battery system safety, cost-efficiency, and sustain…