paper-with-me

홈 › Papers

Contrastive Learning and Cycle Consistency-based Transductive Transfer Learning for Target Annotation

2024-01-22 · Shoaib Meraj Sami, Md Mahedi Hasan, Nasser M. Nasrabadi, Raghuveer Rao

Annotating automatic target recognition (ATR) is a highly challenging task, primarily due to the unavailability of labeled data in the target domain. Hence, it is essential to construct an optimal target domain classifier by utilizing the labeled information of the source domain images. The transductive transfer learning (TTL) method that incorporates a CycleGAN-based unpaired domain translation network has been previously proposed in the literature for effective ATR annotation. Although this method demonstrates great potential for ATR, it severely suffers from lower annotation performance, higher Fr\'echet Inception Distance (FID) score, and the presence of visual artifacts in the synthetic images. To address these issues, we propose a hybrid contrastive learning base unpaired domain translation (H-CUT) network that achieves a significantly lower FID score. It incorporates both attention and entropy to emphasize the domain-specific region, a noisy feature mixup module to generate high variational synthetic negative patches, and a modulated noise contrastive estimation (MoNCE) loss to reweight all negative patches using optimal transport for better performance. Our proposed contrastive learning and cycle-consistency-based TTL (C3TTL) framework consists of two H-CUT networks and two classifiers. It simultaneously optimizes cycle-consistency, MoNCE, and identity losses. In C3TTL, two H-CUT networks have been employed through a bijection mapping to feed the reconstructed source domain images into a pretrained classifier to guide the optimal target domain classifier. Extensive experimental analysis conducted on three ATR datasets demonstrates that the proposed C3TTL method is effective in annotating civilian and military vehicles, as well as ship targets.

📄 PDF Abstract BibTeX arXiv:2401.12340

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningTransfer LearningTranslation

Methods 이 논문이 사용한 방법론

Mixup Mixup is a data augmentation technique that generates a weighted combination of random image pairs from the training data. Given two images and their ground truth labels:…
Contrastive Learning 설명 없음
BASE 설명 없음

Similar Papers 제목 키워드 기반

Deep Transductive Transfer Learning for Automatic Target Recognition

2023-05-23 · Shoaib M. Sami, Nasser M. Nasrabadi, Raghuveer Rao

One of the major obstacles in designing an automatic target recognition (ATR) algorithm, is that there are often labeled images in one domain (i.e., infrared source domain) but no annotated images in the other target dom…

Transfer Learning

Transductive Learning for Unsupervised Text Style Transfer

2021-09-16 · EMNLP 2021 11 · Fei Xiao, Liang Pang, Yanyan Lan, Yan Wang 외

Unsupervised style transfer models are mainly based on an inductive learning approach, which represents the style as embeddings, decoder parameters, or discriminator parameters and directly applies these general rules to…

DecoderInductive LearningRetrievalStyle Transfer+3

Transductive Zero-Shot Learning using Cross-Modal CycleGAN

2020-11-13 · Patrick Bordes, Eloi Zablocki, Benjamin Piwowarski, Patrick Gallinari

In Computer Vision, Zero-Shot Learning (ZSL) aims at classifying unseen classes -- classes for which no matching training image exists. Most of ZSL works learn a cross-modal mapping between images and class labels for se…

SentenceZero-Shot Learning

Cross-database non-frontal facial expression recognition based on transductive deep transfer learning

2018-11-30 · Keyu Yan, Wenming Zheng, Tong Zhang, Yuan Zong 외

Cross-database non-frontal expression recognition is a very meaningful but rather difficult subject in the fields of computer vision and affect computing. In this paper, we proposed a novel transductive deep transfer lea…

Facial Expression RecognitionFacial Expression Recognition (FER)Transfer Learning

Contrastive Learning of Image Representations with Cross-Video Cycle-Consistency

2021-05-13 · ICCV 2021 10 · Haiping Wu, Xiaolong Wang

Recent works have advanced the performance of self-supervised representation learning by a large margin. The core among these methods is intra-image invariance learning. Two different transformations of one image instanc…

Action RecognitionContrastive Learningimage-classificationImage Classification+4