paper-with-me

홈 › Papers

Multiscale Generative Models: Improving Performance of a Generative Model Using Feedback from Other Dependent Generative Models

2022-01-24 · Changyu Chen, Avinandan Bose, Shih-Fen Cheng, Arunesh Sinha

Realistic fine-grained multi-agent simulation of real-world complex systems is crucial for many downstream tasks such as reinforcement learning. Recent work has used generative models (GANs in particular) for providing high-fidelity simulation of real-world systems. However, such generative models are often monolithic and miss out on modeling the interaction in multi-agent systems. In this work, we take a first step towards building multiple interacting generative models (GANs) that reflects the interaction in real world. We build and analyze a hierarchical set-up where a higher-level GAN is conditioned on the output of multiple lower-level GANs. We present a technique of using feedback from the higher-level GAN to improve performance of lower-level GANs. We mathematically characterize the conditions under which our technique is impactful, including understanding the transfer learning nature of our set-up. We present three distinct experiments on synthetic data, time series data, and image domain, revealing the wide applicability of our technique.

📄 PDF Abstract BibTeX arXiv:2201.09644

Code (1)

cameron-chen/mgm 공식 구현 pytorch

Tasks

Time SeriesTime Series AnalysisTransfer Learning

Similar Papers 제목 키워드 기반

Micro-Macro Consistency in Multiscale Modeling: Score-Based Model Assisted Sampling of Fast/Slow Dynamical Systems

2023-12-10 · Ellis R. Crabtree, Juan M. Bello-Rivas, Ioannis G. Kevrekidis

A valuable step in the modeling of multiscale dynamical systems in fields such as computational chemistry, biology, materials science and more, is the representative sampling of the phase space over long timescales of in…

Computational chemistry

Bayesian multiscale deep generative model for the solution of high-dimensional inverse problems

2021-02-04 · Yingzhi Xia, Nicholas Zabaras

Estimation of spatially-varying parameters for computationally expensive forward models governed by partial differential equations is addressed. A novel multiscale Bayesian inference approach is introduced based on deep …

Bayesian Inferenceparameter estimation

Geometric Generative Models based on Morphological Equivariant PDEs and GANs

2024-03-22 · El Hadji S. Diop, Thierno Fall, Alioune Mbengue, Mohamed Daoudi

Content and image generation consist in creating or generating data from noisy information by extracting specific features such as texture, edges, and other thin image structures. We are interested here in generative mod…

Image Generation

Multiscale Invertible Generative Networks for High-Dimensional Bayesian Inference

2021-05-12 · Shumao Zhang, Pengchuan Zhang, Thomas Y. Hou

We propose a Multiscale Invertible Generative Network (MsIGN) and associated training algorithm that leverages multiscale structure to solve high-dimensional Bayesian inference. To address the curse of dimensionality, Ms…

Bayesian InferenceImage GenerationVocal Bursts Intensity Prediction

Extreme Image Coding via Multiscale Autoencoders With Generative Adversarial Optimization

2019-04-08 · Chao Huang, Haojie Liu, Tong Chen, Qiu Shen 외

We propose a MultiScale AutoEncoder(MSAE) based extreme image compression framework to offer visually pleasing reconstruction at a very low bitrate. Our method leverages the "priors" at different resolution scale to impr…

Generative Adversarial NetworkImage Compression