Accurate and efficient video de-fencing using convolutional neural networks and temporal information
De-fencing is to eliminate the captured fence on an image or a video, providing a clear view of the scene. It has been applied for many purposes including assisting photographers and improving the performance of computer vision algorithms such as object detection and recognition. However, the state-of-the-art de-fencing methods have limited performance caused by the difficulty of fence segmentation and also suffer from the motion of the camera or objects. To overcome these problems, we propose a novel method consisting of segmentation using convolutional neural networks and a fast/robust recovery algorithm. The segmentation algorithm using convolutional neural network achieves significant improvement in the accuracy of fence segmentation. The recovery algorithm using optical flow produces plausible de-fenced images and videos. The proposed method is experimented on both our diverse and complex dataset and publicly available datasets. The experimental results demonstrate that the proposed method achieves the state-of-the-art performance for both segmentation and content recovery.
Code (1)
Tasks
object-detectionObject DetectionOptical Flow EstimationSegmentationSimilar Papers 제목 키워드 기반
FenceNet: Fine-grained Footwork Recognition in Fencing
Current data analysis for the Canadian Olympic fencing team is primarily done manually by coaches and analysts. Due to the highly repetitive, yet dynamic and subtle movements in fencing, manual data analysis can be ineff…
Action RecognitionFeature EngineeringSkeleton Based Action RecognitionMy camera can see through fences: A deep learning approach for image de-fencing
In recent times, the availability of inexpensive image capturing devices such as smartphones/tablets has led to an exponential increase in the number of images/videos captured. However, sometimes the amateur photographer…
Efficient Flow-Guided Multi-frame De-fencing
Taking photographs ''in-the-wild'' is often hindered by fence obstructions that stand between the camera user and the scene of interest, and which are hard or impossible to avoid. De-fencing is the algorithmic process of…
Image InpaintingDeep learning based fence segmentation and removal from an image using a video sequence
Conventional approaches to image de-fencing use multiple adjacent frames for segmentation of fences in the reference image and are limited to restoring images of static scenes only. In this paper, we propose a de-fencing…
Motion EstimationOptical Flow EstimationSegmentationFACTS: Fine-Grained Action Classification for Tactical Sports
Classifying fine-grained actions in fast-paced, close-combat sports such as fencing and boxing presents unique challenges due to the complexity, speed, and nuance of movements. Traditional methods reliant on pose estimat…
Action ClassificationAction RecognitionClassificationFine-grained Action Recognition+2