VHS to HDTV Video Translation using Multi-task Adversarial Learning
There are large amount of valuable video archives in Video Home System (VHS) format. However, due to the analog nature, their quality is often poor. Compared to High-definition television (HDTV), VHS video not only has a dull color appearance but also has a lower resolution and often appears blurry. In this paper, we focus on the problem of translating VHS video to HDTV video and have developed a solution based on a novel unsupervised multi-task adversarial learning model. Inspired by the success of generative adversarial network (GAN) and CycleGAN, we employ cycle consistency loss, adversarial loss and perceptual loss together to learn a translation model. An important innovation of our work is the incorporation of super-resolution model and color transfer model that can solve unsupervised multi-task problem. To our knowledge, this is the first work that dedicated to the study of the relation between VHS and HDTV and the first computational solution to translate VHS to HDTV. We present experimental results to demonstrate the effectiveness of our solution qualitatively and quantitatively.
Code (0)
등록된 구현이 없습니다.
Tasks
Generative Adversarial NetworkSuper-ResolutionTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Artifacts Detection and Error Block Analysis from Broadcasted Videos
With the advancement of IPTV and HDTV technology, previous subtle errors in videos are now becoming more prominent because of the structure oriented and compression based artifacts. In this paper, we focus towards the de…
RetrievalVideo-to-Video Translation for Visual Speech Synthesis
Despite remarkable success in image-to-image translation that celebrates the advancements of generative adversarial networks (GANs), very limited attempts are known for video domain translation. We study the task of vide…
Image-to-Image TranslationSpeech SynthesisTranslationRevealing Microscopic Objects in Fluorescence Live Imaging by Video-to-video Translation Based on A Spatial-temporal Generative Adversarial Network
In spite of being a valuable tool to simultaneously visualize multiple types of subcellular structures using spectrally distinct fluorescent labels, a standard fluoresce microscope is only able to identify a few microsco…
Generative Adversarial NetworkTranslationGenerative Adversarial Networks for Video-to-Video Domain Adaptation
Endoscopic videos from multicentres often have different imaging conditions, e.g., color and illumination, which make the models trained on one domain usually fail to generalize well to another. Domain adaptation is one …
Domain AdaptationGenerative Adversarial NetworkTranslationText2Sign: Towards Sign Language Production Using Neural Machine Translation and Generative Adversarial Networks
We present a novel approach to automatic Sign Language Production using recent developments in Neural Machine Translation (NMT), Generative Adversarial Networks, and motion generation. Our system is capable of producing …
Generative Adversarial NetworkMachine TranslationMotion GenerationNMT+4