Unsupervised Adversarial Visual Level Domain Adaptation for Learning Video Object Detectors from Images

2018-10-04 · Avisek Lahiri, Charan Reddy, Prabir Kumar Biswas

Deep learning based object detectors require thousands of diversified bounding box and class annotated examples. Though image object detectors have shown rapid progress in recent years with the release of multiple large-scale static image datasets, object detection on videos still remains an open problem due to scarcity of annotated video frames. Having a robust video object detector is an essential component for video understanding and curating large-scale automated annotations in videos. Domain difference between images and videos makes the transferability of image object detectors to videos sub-optimal. The most common solution is to use weakly supervised annotations where a video frame has to be tagged for presence/absence of object categories. This still takes up manual effort. In this paper we take a step forward by adapting the concept of unsupervised adversarial image-to-image translation to perturb static high quality images to be visually indistinguishable from a set of video frames. We assume the presence of a fully annotated static image dataset and an unannotated video dataset. Object detector is trained on adversarially transformed image dataset using the annotations of the original dataset. Experiments on Youtube-Objects and Youtube-Objects-Subset datasets with two contemporary baseline object detectors reveal that such unsupervised pixel level domain adaptation boosts the generalization performance on video frames compared to direct application of original image object detector. Also, we achieve competitive performance compared to recent baselines of weakly supervised methods. This paper can be seen as an application of image translation for cross domain object detection.

📄 PDF Abstract BibTeX arXiv:1810.02074

Code (1)

avisekiit/wacv_2019 pytorch

Tasks

Domain Adaptation Image-to-Image TranslationObjectobject-detection Object Detection TranslationVideo Understanding

Transferable Feature Learning on Graphs Across Visual Domains

2021-01-01 · Ronghang Zhu, Xiaodong Jiang, Jiasen Lu, Sheng Li

Unsupervised domain adaptation has attracted increasing attention in recent years, which adapts classifiers to an unlabeled target domain by exploiting a labeled source domain. To reduce discrepancy between source and ta…

Domain Adaptation Unsupervised Domain Adaptation

Preserving Semantic Consistency in Unsupervised Domain Adaptation Using Generative Adversarial Networks

2021-04-28 · Mohammad Mahfujur Rahman, Clinton Fookes, Sridha Sridharan

Unsupervised domain adaptation seeks to mitigate the distribution discrepancy between source and target domains, given labeled samples of the source domain and unlabeled samples of the target domain. Generative adversari…

Domain Adaptation Generative Adversarial Network Unsupervised Domain Adaptation

Unsupervised Domain Adaptation for Semantic Segmentation using One-shot Image-to-Image Translation via Latent Representation Mixing

2022-12-07 · Sarmad F. Ismael, Koray Kayabol, Erchan Aptoula

Domain adaptation is one of the prominent strategies for handling both domain shift, that is widely encountered in large-scale land use/land cover map calculation, and the scarcity of pixel-level ground truth that is cru…

Decoder Domain Adaptation Image-to-Image Translation Semantic Segmentation+1

A Review of Single-Source Deep Unsupervised Visual Domain Adaptation

2020-09-01 · Sicheng Zhao, Xiangyu Yue, Shanghang Zhang, Bo Li 외

Large-scale labeled training datasets have enabled deep neural networks to excel across a wide range of benchmark vision tasks. However, in many applications, it is prohibitively expensive and time-consuming to obtain la…