paper-with-me

Papers

Dynamic imaging using a deep generative SToRM (Gen-SToRM) model

2021-01-29 · Qing Zou, Abdul Haseeb Ahmed, Prashant Nagpal, Stanley Kruger, Mathews Jacob

We introduce a generative smoothness regularization on manifolds (SToRM) model for the recovery of dynamic image data from highly undersampled measurements. The model assumes that the images in the dataset are non-linear mappings of low-dimensional latent vectors. We use the deep convolutional neural network (CNN) to represent the non-linear transformation. The parameters of the generator as well as the low-dimensional latent vectors are jointly estimated only from the undersampled measurements. This approach is different from traditional CNN approaches that require extensive fully sampled training data. We penalize the norm of the gradients of the non-linear mapping to constrain the manifold to be smooth, while temporal gradients of the latent vectors are penalized to obtain a smoothly varying time-series. The proposed scheme brings in the spatial regularization provided by the convolutional network. The main benefit of the proposed scheme is the improvement in image quality and the orders-of-magnitude reduction in memory demand compared to traditional manifold models. To minimize the computational complexity of the algorithm, we introduce an efficient progressive training-in-time approach and an approximate cost function. These approaches speed up the image reconstructions and offers better reconstruction performance.

📄 PDF Abstract BibTeX arXiv:2102.00034

Code (0)

등록된 구현이 없습니다.

Tasks

Time SeriesTime Series Analysis

Similar Papers 제목 키워드 기반

Deep Generative SToRM model for dynamic imaging

2021-01-29 · Qing Zou, Abdul Haseeb Ahmed, Prashant Nagpal, Stanley Kruger 외

We introduce a novel generative smoothness regularization on manifolds (SToRM) model for the recovery of dynamic image data from highly undersampled measurements. The proposed generative framework represents the image ti…

modelTime SeriesTime Series Analysis

STORM: Search-Guided Generative World Models for Robotic Manipulation

2025-12-20 · Wenjun Lin, Jensen Zhang, Kaitong Cai, Keze Wang arxiv

We present STORM (Search-Guided Generative World Models), a novel framework for spatio-temporal reasoning in robotic manipulation that unifies diffusion-based action generation, conditional video prediction, and search-b…

Video Prediction

Kilometer-Scale Convection Allowing Model Emulation using Generative Diffusion Modeling

2024-08-20 · Jaideep Pathak, Yair Cohen, Piyush Garg, Peter Harrington 외

Storm-scale convection-allowing models (CAMs) are an important tool for predicting the evolution of thunderstorms and mesoscale convective systems that result in damaging extreme weather. By explicitly resolving convecti…

Weather Forecasting

Into the Unknown Unknowns: Engaged Human Learning through Participation in Language Model Agent Conversations

2024-08-27 · Yucheng Jiang, Yijia Shao, Dekun Ma, Sina J. Semnani 외

While language model (LM)-powered chatbots and generative search engines excel at answering concrete queries, discovering information in the terrain of unknown unknowns remains challenging for users. To emulate the commo…

Sentiment Analysis

Using Generative Models to Produce Realistic Populations of UK Windstorms

2025-01-27 · Yee Chun Tsoi, Kieran M. R. Hunt, Len Shaffrey, Atta Badii 외

This study evaluates the potential of generative models, trained on historical ERA5 reanalysis data, for simulating windstorms over the UK. Four generative models, including a standard GAN, a WGAN-GP, a U-net diffusion m…