Contextual Attention Mechanism, SRGAN Based Inpainting System for Eliminating Interruptions from Images
The new alternative is to use deep learning to inpaint any image by utilizing image classification and computer vision techniques. In general, image inpainting is a task of recreating or reconstructing any broken image which could be a photograph or oil/acrylic painting. With the advancement in the field of Artificial Intelligence, this topic has become popular among AI enthusiasts. With our approach, we propose an initial end-to-end pipeline for inpainting images using a complete Machine Learning approach instead of a conventional application-based approach. We first use the YOLO model to automatically identify and localize the object we wish to remove from the image. Using the result obtained from the model we can generate a mask for the same. After this, we provide the masked image and original image to the GAN model which uses the Contextual Attention method to fill in the region. It consists of two generator networks and two discriminator networks and is also called a coarse-to-fine network structure. The two generators use fully convolutional networks while the global discriminator gets hold of the entire image as input while the local discriminator gets the grip of the filled region as input. The contextual Attention mechanism is proposed to effectively borrow the neighbor information from distant spatial locations for reconstructing the missing pixels. The third part of our implementation uses SRGAN to resolve the inpainted image back to its original size. Our work is inspired by the paper Free-Form Image Inpainting with Gated Convolution and Generative Image Inpainting with Contextual Attention.
Code (0)
등록된 구현이 없습니다.
Tasks
image-classificationImage ClassificationImage InpaintingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Image inpainting for corrupted images by using the semi-super resolution GAN
Image inpainting is a valuable technique for enhancing images that have been corrupted. The primary challenge in this research revolves around the extent of corruption in the input image that the deep learning model must…
Generative Adversarial NetworkImage InpaintingSuper-ResolutionLearning to Scale Temperature in Masked Self-Attention for Image Inpainting
Recent advances in deep generative adversarial networks (GAN) and self-attention mechanism have led to significant improvements in the challenging task of inpainting large missing regions in an image. These methods integ…
Image InpaintingPatch MatchingRethinking Degradation: Radiograph Super-Resolution via AID-SRGAN
In this paper, we present a medical AttentIon Denoising Super Resolution Generative Adversarial Network (AID-SRGAN) for diographic image super-resolution. First, we present a medical practical degradation model that cons…
DenoisingGenerative Adversarial NetworkImage Super-ResolutionSuper-ResolutionLeveraging Depth Maps and Attention Mechanisms for Enhanced Image Inpainting
Existing deep learning-based image inpainting methods typically rely on convolutional networks with RGB images to reconstruct images. However, relying exclusively on RGB images may neglect important depth information, wh…
Image InpaintingDeepGIN: Deep Generative Inpainting Network for Extreme Image Inpainting
The degree of difficulty in image inpainting depends on the types and sizes of the missing parts. Existing image inpainting approaches usually encounter difficulties in completing the missing parts in the wild with pleas…
Image Inpainting