Invertible Image Signal Processing
Unprocessed RAW data is a highly valuable image format for image editing and computer vision. However, since the file size of RAW data is huge, most users can only get access to processed and compressed sRGB images. To bridge this gap, we design an Invertible Image Signal Processing (InvISP) pipeline, which not only enables rendering visually appealing sRGB images but also allows recovering nearly perfect RAW data. Due to our framework's inherent reversibility, we can reconstruct realistic RAW data instead of synthesizing RAW data from sRGB images without any memory overhead. We also integrate a differentiable JPEG compression simulator that empowers our framework to reconstruct RAW data from JPEG images. Extensive quantitative and qualitative experiments on two DSLR demonstrate that our method obtains much higher quality in both rendered sRGB images and reconstructed RAW data than alternative methods.
Code (1)
Similar Papers 제목 키워드 기반
Understanding Neural Network Systems for Image Analysis using Vector Spaces and Inverse Maps
There is strong interest in developing mathematical methods that can be used to understand complex neural networks used in image analysis. In this paper, we introduce techniques from Linear Algebra to model neural networ…
Plug-and-Play Tri-Branch Invertible Block for Image Rescaling
High-resolution (HR) images are commonly downscaled to low-resolution (LR) to reduce bandwidth, followed by upscaling to restore their original details. Recent advancements in image rescaling algorithms have employed inv…
Compressed Image Super-resolutionImage ReconstructionImage RescalingImage Super-ResolutionLiftPool: Bidirectional ConvNet Pooling
Pooling is a critical operation in convolutional neural networks for increasing receptive fields and improving robustness to input variations. Most existing pooling operations downsample the feature maps, which is a loss…
image-classificationImage ClassificationImage-to-Image TranslationPhilosophy+2Deep Invertible Networks for EEG-based brain-signal decoding
In this manuscript, we investigate deep invertible networks for EEG-based brain signal decoding and find them to generate realistic EEG signals as well as classify novel signals above chance. Further ideas for their regu…
EEGElectroencephalogram (EEG)Learning Non-linear Wavelet Transformation via Normalizing Flow
Wavelet transformation stands as a cornerstone in modern data analysis and signal processing. Its mathematical essence is an invertible transformation that discerns slow patterns from fast ones in the frequency domain. S…
Super-Resolution