paper-with-me

Papers

Resolution-robust Large Mask Inpainting with Fourier Convolutions

2021-09-15 · Roman Suvorov, Elizaveta Logacheva, Anton Mashikhin, Anastasia Remizova, Arsenii Ashukha, Aleksei Silvestrov, Naejin Kong, Harshith Goka, Kiwoong Park, Victor Lempitsky

Modern image inpainting systems, despite the significant progress, often struggle with large missing areas, complex geometric structures, and high-resolution images. We find that one of the main reasons for that is the lack of an effective receptive field in both the inpainting network and the loss function. To alleviate this issue, we propose a new method called large mask inpainting (LaMa). LaMa is based on i) a new inpainting network architecture that uses fast Fourier convolutions (FFCs), which have the image-wide receptive field; ii) a high receptive field perceptual loss; iii) large training masks, which unlocks the potential of the first two components. Our inpainting network improves the state-of-the-art across a range of datasets and achieves excellent performance even in challenging scenarios, e.g. completion of periodic structures. Our model generalizes surprisingly well to resolutions that are higher than those seen at train time, and achieves this at lower parameter&time costs than the competitive baselines. The code is available at \url{https://github.com/saic-mdal/lama}.

📄 PDF Abstract BibTeX arXiv:2109.07161

Code (8)

saic-mdal/lama 공식 구현 pytorch
Moldoteck/lama pytorch
NilsBochow/lama_reconstruction pytorch
advimman/lama pytorch
geekyutao/inpaint-anything pytorch
geomagical/lama-with-refiner pytorch
haiv-lab/ospcoop_imagenet-bg pytorch
rawmean/lama pytorch

Tasks

Image InpaintingSeeing Beyond the Visible

Methods 이 논문이 사용한 방법론

Inpainting Train a convolutional neural network to generate the contents of an arbitrary image region conditioned on its surroundings.
Tanh Activation 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
LAMA 설명 없음

Similar Papers 제목 키워드 기반

ZITS++: Image Inpainting by Improving the Incremental Transformer on Structural Priors

2022-10-12 · Chenjie Cao, Qiaole Dong, Yanwei Fu

Image inpainting involves filling missing areas of a corrupted image. Despite impressive results have been achieved recently, restoring images with both vivid textures and reasonable structures remains a significant chal…

Image Inpainting

MAT: Mask-Aware Transformer for Large Hole Image Inpainting

2022-03-29 · CVPR 2022 1 · Wenbo Li, Zhe Lin, Kun Zhou, Lu Qi 외

Recent studies have shown the importance of modeling long-range interactions in the inpainting problem. To achieve this goal, existing approaches exploit either standalone attention techniques or transformers, but usuall…

DiversityImage Inpaintingvalid

A Benchmark for Inpainting of Clothing Images with Irregular Holes

2020-07-09 · Furkan Kınlı, Barış Özcan, Furkan Kıraç

Fashion image understanding is an active research field with a large number of practical applications for the industry. Despite its practical impacts on intelligent fashion analysis systems, clothing image inpainting has…

Image Inpainting

Reconstructing Historical Climate Fields With Deep Learning

2023-11-30 · Nils Bochow, Anna Poltronieri, Martin Rypdal, Niklas Boers

Historical records of climate fields are often sparse due to missing measurements, especially before the introduction of large-scale satellite missions. Several statistical and model-based methods have been introduced to…

Deep Learning

Free-form Video Inpainting with 3D Gated Convolution and Temporal PatchGAN

2019-04-23 · ICCV 2019 10 · Ya-Liang Chang, Zhe Yu Liu, Kuan-Ying Lee, Winston Hsu

Free-form video inpainting is a very challenging task that could be widely used for video editing such as text removal. Existing patch-based methods could not handle non-repetitive structures such as faces, while directl…

FormVideo EditingVideo Inpainting