paper-with-me

홈 › Papers

Fully Automated Image De-fencing using Conditional Generative Adversarial Networks

2019-08-19 · Divyanshu Gupta, Shorya Jain, Utkarsh Tripathi, Pratik Chattopadhyay, Lipo Wang

Image de-fencing is one of the important aspects of recreational photography in which the objective is to remove the fence texture present in an image and generate an aesthetically pleasing version of the same image without the fence texture. In this paper, we aim to develop an automated and effective technique for fence removal and image reconstruction using conditional Generative Adversarial Networks (cGANs). These networks have been successfully applied in several domains of Computer Vision focusing on image generation and rendering. Our initial approach is based on a two-stage architecture involving two cGANs that generate the fence mask and the inpainted image, respectively. Training of these networks is carried out independently and, during evaluation, the input image is passed through the two generators in succession to obtain the de-fenced image. The results obtained from this approach are satisfactory, but the response time is long since the image has to pass through two sets of convolution layers. To reduce the response time, we propose a second approach involving only a single cGAN architecture that is trained using the ground-truth of fenced de-fenced image pairs along with the edge map of the fenced image produced by the Canny Filter. Incorporation of the edge map helps the network to precisely detect the edges present in the input image, and also imparts it an ability to carry out high quality de-fencing in an efficient manner, even in the presence of a fewer number of layers as compared to the two-stage network. Qualitative and quantitative experimental results reported in the manuscript reveal that the de-fenced images generated by the single-stage de-fencing network have similar visual quality to those produced by the two-stage network. Comparative performance analysis also emphasizes the effectiveness of our approach over state-of-the-art image de-fencing techniques.

📄 PDF Abstract BibTeX arXiv:1908.06837

Code (0)

등록된 구현이 없습니다.

Tasks

Image GenerationImage Reconstruction

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Towards an Automated Image De-fencing Algorithm Using Sparsity

2016-12-10 · Sankaraganesh Jonna, Krishna K. Nakka, Rajiv R. Sahay

Conventional approaches to image de-fencing suffer from non-robust fence detection and are limited to processing images of static scenes. In this position paper, we propose an automatic de-fencing algorithm for images of…

Motion EstimationPosition

My camera can see through fences: A deep learning approach for image de-fencing

2018-05-18 · Sankaraganesh Jonna, Krishna Kanth Nakka, Rajiv R. Sahay

In recent times, the availability of inexpensive image capturing devices such as smartphones/tablets has led to an exponential increase in the number of images/videos captured. However, sometimes the amateur photographer…

Deep learning based fence segmentation and removal from an image using a video sequence

2016-09-25 · Sankaraganesh Jonna, Krishna K. Nakka, Rajiv R. Sahay

Conventional approaches to image de-fencing use multiple adjacent frames for segmentation of fences in the reference image and are limited to restoring images of static scenes only. In this paper, we propose a de-fencing…

Motion EstimationOptical Flow EstimationSegmentation

Efficient Flow-Guided Multi-frame De-fencing

2023-01-25 · Stavros Tsogkas, Fengjia Zhang, Allan Jepson, Alex Levinshtein

Taking photographs ''in-the-wild'' is often hindered by fence obstructions that stand between the camera user and the scene of interest, and which are hard or impossible to avoid. De-fencing is the algorithmic process of…

Image Inpainting

Combating the "Sameness" in AI Art: Reflections on the Interactive AI Installation Fencing Hallucination

2023-11-28 · Weihao Qiu, George Legrady

The article summarizes three types of "sameness" issues in Artificial Intelligence(AI) art, each occurring at different stages of development in AI image creation tools. Through the Fencing Hallucination project, the art…

Hallucination