paper-with-me

Papers

A Physics-Informed Vector Quantized Autoencoder for Data Compression of Turbulent Flow

2022-01-10 · Mohammadreza Momenifar, Enmao Diao, Vahid Tarokh, Andrew D. Bragg

Analyzing large-scale data from simulations of turbulent flows is memory intensive, requiring significant resources. This major challenge highlights the need for data compression techniques. In this study, we apply a physics-informed Deep Learning technique based on vector quantization to generate a discrete, low-dimensional representation of data from simulations of three-dimensional turbulent flows. The deep learning framework is composed of convolutional layers and incorporates physical constraints on the flow, such as preserving incompressibility and global statistical characteristics of the velocity gradients. The accuracy of the model is assessed using statistical, comparison-based similarity and physics-based metrics. The training data set is produced from Direct Numerical Simulation of an incompressible, statistically stationary, isotropic turbulent flow. The performance of this lossy data compression scheme is evaluated not only with unseen data from the stationary, isotropic turbulent flow, but also with data from decaying isotropic turbulence, and a Taylor-Green vortex flow. Defining the compression ratio (CR) as the ratio of original data size to the compressed one, the results show that our model based on vector quantization can offer CR $=85$ with a mean square error (MSE) of $O(10^{-3})$, and predictions that faithfully reproduce the statistics of the flow, except at the very smallest scales where there is some loss. Compared to the recent study based on a conventional autoencoder where compression is performed in a continuous space, our model improves the CR by more than $30$ percent, and reduces the MSE by an order of magnitude. Our compression model is an attractive solution for situations where fast, high quality and low-overhead encoding and decoding of large data are required.

📄 PDF Abstract BibTeX arXiv:2201.03617

Code (1)

diaoenmao/Dimension-Reduced-Turbulent-Flow-Data-From-Deep-Vector-Quantizers 공식 구현 pytorch

Tasks

Data CompressionQuantization

Similar Papers 제목 키워드 기반

Calo-VQ: Vector-Quantized Two-Stage Generative Model in Calorimeter Simulation

2024-05-10 · Qibin Liu, Chase Shimmin, Xiulong Liu, Eli Shlizerman 외

We introduce a novel machine learning method developed for the fast simulation of calorimeter detector response, adapting vector-quantized variational autoencoder (VQ-VAE). Our model adopts a two-stage generation strateg…

DiffPINN: Generative diffusion-initialized physics-informed neural networks for accelerating seismic wavefield representation

2025-05-31 · Shijun Cheng, Tariq Alkhalifah

Physics-informed neural networks (PINNs) offer a powerful framework for seismic wavefield modeling, yet they typically require time-consuming retraining when applied to different velocity models. Moreover, their training…

A vector quantized masked autoencoder for speech emotion recognition

2023-04-21 · Samir Sadok, Simon Leglaive, Renaud Séguier

Recent years have seen remarkable progress in speech emotion recognition (SER), thanks to advances in deep learning techniques. However, the limited availability of labeled data remains a significant challenge in the fie…

Emotion RecognitionSelf-Supervised LearningSpeech Emotion Recognition

Neural data compression for physics plasma simulation

2021-03-04 · ICLR Workshop Neural_Compression 2021 5 · Jong Choi, Michael Churchill, Qian Gong, Seung-Hoe Ku 외

We present a VAE-based data compression method, called VAe Physics Optimized Reduction (VAPOR), to compress scientific data while preserving physics constraints. VAPOR is based on Vector Quantized Variational Auto Encode…

Data Compression

Variational Information Bottleneck on Vector Quantized Autoencoders

2018-08-02 · Hanwei Wu, Markus Flierl

In this paper, we provide an information-theoretic interpretation of the Vector Quantized-Variational Autoencoder (VQ-VAE). We show that the loss function of the original VQ-VAE can be derived from the variational determ…