paper-with-me

Papers

Efficient Parallel Algorithms for Inpainting-Based Representations of 4K Images -- Part I: Homogeneous Diffusion Inpainting

2024-01-12 · Niklas Kämper, Vassillen Chizhov, Joachim Weickert

In recent years inpainting-based compression methods have been shown to be a viable alternative to classical codecs such as JPEG and JPEG2000. Unlike transform-based codecs, which store coefficients in the transform domain, inpainting-based approaches store a small subset of the original image pixels and reconstruct the image from those by using a suitable inpainting operator. A good candidate for such an inpainting operator is homogeneous diffusion inpainting, as it is simple, theoretically well-motivated, and can achieve good reconstruction quality for optimized data. However, a major challenge has been to design fast solvers for homogeneous diffusion inpainting that scale to 4K image resolution ($3840 \times 2160$ pixels) and are real-time capable. We overcome this with a careful adaptation and fusion of two of the most efficient concept from numerical analysis: multigrid and domain decomposition. Our domain decomposition algorithm efficiently utilizes GPU parallelism by solving inpainting problems on small overlapping blocks. Unlike simple block decomposition strategies such as the ones in JPEG, our approach yields block artifact-free reconstructions. Furthermore, embedding domain decomposition in a full multigrid scheme provides global interactions and allows us to achieve optimal convergence by reducing both low- and high-frequency errors at the same rate. We are able to achieve 4K color image reconstruction at more than $60$ frames per second even from very sparse data - something which has been previously unfeasible.

📄 PDF Abstract BibTeX arXiv:2401.06744

Code (0)

등록된 구현이 없습니다.

Tasks

4kGPUImage Reconstruction

Methods 이 논문이 사용한 방법론

Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Domain Decomposition Algorithms for Real-time Homogeneous Diffusion Inpainting in 4K

2021-10-08 · Niklas Kämper, Joachim Weickert

Inpainting-based compression methods are qualitatively promising alternatives to transform-based codecs, but they suffer from the high computational cost of the inpainting step. This prevents them from being applicable t…

4k

Parallel Multi-Resolution Fusion Network for Image Inpainting

2021-01-01 · ICCV 2021 10 · Wentao Wang, Jianfu Zhang, Li Niu, Haoyu Ling 외

Conventional deep image inpainting methods are based on auto-encoder architecture, in which the spatial details of images will be lost in the down-sampling process, leading to the degradation of generated results. Al…

Image Inpainting

Efficient Parallel Data Optimization for Homogeneous Diffusion Inpainting of 4K Images

2024-01-12 · Niklas Kämper, Vassillen Chizhov, Joachim Weickert

Homogeneous diffusion inpainting can reconstruct missing image areas with high quality from a sparse subset of known pixels, provided that their location as well as their gray or color values are well optimized. This pro…

4kGPUImage Compression

Personalized Face Inpainting with Diffusion Models by Parallel Visual Attention

2023-12-06 · Jianjin Xu, Saman Motamed, Praneetha Vaddamanu, Chen Henry Wu 외

Face inpainting is important in various applications, such as photo restoration, image editing, and virtual reality. Despite the significant advances in face generative models, ensuring that a person's unique facial iden…

DenoisingFacial Inpainting

The Brain Tumor Segmentation (BraTS) Challenge: Local Synthesis of Healthy Brain Tissue via Inpainting

2023-05-15 · Florian Kofler, Felix Meissen, Felix Steinbauer, Robert Graf 외

A myriad of algorithms for the automatic analysis of brain MR images is available to support clinicians in their decision-making. For brain tumor patients, the image acquisition time series typically starts with an alrea…

AnatomyBrain Tumor SegmentationDecision MakingTime Series+1