paper-with-me

Papers

An autoencoder compression approach for accelerating large-scale inverse problems

2023-04-10 · Jonathan Wittmer, Jacob Badger, Hari Sundar, Tan Bui-Thanh

PDE-constrained inverse problems are some of the most challenging and computationally demanding problems in computational science today. Fine meshes that are required to accurately compute the PDE solution introduce an enormous number of parameters and require large scale computing resources such as more processors and more memory to solve such systems in a reasonable time. For inverse problems constrained by time dependent PDEs, the adjoint method that is often employed to efficiently compute gradients and higher order derivatives requires solving a time-reversed, so-called adjoint PDE that depends on the forward PDE solution at each timestep. This necessitates the storage of a high dimensional forward solution vector at every timestep. Such a procedure quickly exhausts the available memory resources. Several approaches that trade additional computation for reduced memory footprint have been proposed to mitigate the memory bottleneck, including checkpointing and compression strategies. In this work, we propose a close-to-ideal scalable compression approach using autoencoders to eliminate the need for checkpointing and substantial memory storage, thereby reducing both the time-to-solution and memory requirements. We compare our approach with checkpointing and an off-the-shelf compression approach on an earth-scale ill-posed seismic inverse problem. The results verify the expected close-to-ideal speedup for both the gradient and Hessian-vector product using the proposed autoencoder compression approach. To highlight the usefulness of the proposed approach, we combine the autoencoder compression with the data-informed active subspace (DIAS) prior to show how the DIAS method can be affordably extended to large scale problems without the need of checkpointing and large memory.

📄 PDF Abstract BibTeX arXiv:2304.04781

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Deep Compression Autoencoder for Efficient High-Resolution Diffusion Models

2024-10-14 · Junyu Chen, Han Cai, Junsong Chen, Enze Xie 외

We present Deep Compression Autoencoder (DC-AE), a new family of autoencoder models for accelerating high-resolution diffusion models. Existing autoencoder models have demonstrated impressive results at a moderate spatia…

GPUImage Generation

Multiscale Augmented Normalizing Flows for Image Compression

2023-05-09 · Marc Windsheimer, Fabian Brand, André Kaup

Most learning-based image compression methods lack efficiency for high image quality due to their non-invertible design. The decoding function of the frequently applied compressive autoencoder architecture is only an app…

Image CompressionQuantization

Multilevel Graph Wavelet Compressed Sensing with Scale-Aware Neural Recovery

2026-07-23 · Amirhossein Nouranizadeh, Sarang Rajendra Patil, Alan John Varghese, Varsha Narayanan 외 arxiv

Scientific machine learning methods such as neural operators and physics-informed neural networks have advanced engineering applications and inverse problems, but their training typically requires large volumes of simula…

Graph Neural Network

Empirically Accelerating Scaled Gradient Projection Using Deep Neural Network For Inverse Problems In Image Processing

2019-02-07 · Byung Hyun Lee, Se Young Chun

Recently, deep neural networks (DNNs) have shown advantages in accelerating optimization algorithms. One approach is to unfold finite number of iterations of conventional optimization algorithms and to learn parameters i…

DeblurringImage InpaintingImage Reconstruction

Hierarchical Autoencoder-based Lossy Compression for Large-scale High-resolution Scientific Data

2023-07-09 · Hieu Le, Jian Tao

Lossy compression has become an important technique to reduce data size in many domains. This type of compression is especially valuable for large-scale scientific data, whose size ranges up to several petabytes. Althoug…