paper-with-me

홈 › Papers

Cycle-Consistent Deep Generative Hashing for Cross-Modal Retrieval

2018-04-30 · Lin Wu, Yang Wang, Ling Shao

In this paper, we propose a novel deep generative approach to cross-modal retrieval to learn hash functions in the absence of paired training samples through the cycle consistency loss. Our proposed approach employs adversarial training scheme to lean a couple of hash functions enabling translation between modalities while assuming the underlying semantic relationship. To induce the hash codes with semantics to the input-output pair, cycle consistency loss is further proposed upon the adversarial training to strengthen the correlations between inputs and corresponding outputs. Our approach is generative to learn hash functions such that the learned hash codes can maximally correlate each input-output correspondence, meanwhile can also regenerate the inputs so as to minimize the information loss. The learning to hash embedding is thus performed to jointly optimize the parameters of the hash functions across modalities as well as the associated generative models. Extensive experiments on a variety of large-scale cross-modal data sets demonstrate that our proposed method achieves better retrieval results than the state-of-the-arts.

📄 PDF Abstract BibTeX arXiv:1804.11013

Code (0)

등록된 구현이 없습니다.

Tasks

Cross-Modal RetrievalRetrievalTranslation

Methods 이 논문이 사용한 방법론

Cycle Consistency Loss Cycle Consistency Loss is a type of loss used for generative adversarial networks that performs unpaired image-to-image translation. It was introduced with the…

Similar Papers 제목 키워드 기반

Coupled CycleGAN: Unsupervised Hashing Network for Cross-Modal Retrieval

2019-03-06 · Chao Li, Cheng Deng, Lei Wang, De Xie 외

In recent years, hashing has attracted more and more attention owing to its superior capacity of low storage cost and high query efficiency in large-scale cross-modal retrieval. Benefiting from deep leaning, continuously…

Cross-Modal RetrievalRetrieval

SCH-GAN: Semi-supervised Cross-modal Hashing by Generative Adversarial Network

2018-02-07 · Jian Zhang, Yuxin Peng, Mingkuan Yuan

Cross-modal hashing aims to map heterogeneous multimedia data into a common Hamming space, which can realize fast and flexible retrieval across different modalities. Supervised cross-modal hashing methods have achieved c…

Generative Adversarial NetworkReinforcement LearningRetrieval

Unsupervised Generative Adversarial Cross-modal Hashing

2017-12-01 · Jian Zhang, Yuxin Peng, Mingkuan Yuan

Cross-modal hashing aims to map heterogeneous multimedia data into a common Hamming space, which can realize fast and flexible retrieval across different modalities. Unsupervised cross-modal hashing is more flexible and …

Cross-Modal RetrievalGenerative Adversarial NetworkRepresentation LearningRetrieval

Generative Domain-Migration Hashing for Sketch-to-Image Retrieval

2018-09-01 · ECCV 2018 9 · Jingyi Zhang, Fumin Shen, Li Liu, Fan Zhu 외

Due to the succinct nature of free-hand sketch drawings, sketch-based image retrieval (SBIR) has abundant practical use cases in consumer electronics. However, SBIR remains a long-standing unsolved problem mainly due to …

Image RetrievalMulti-Task LearningRetrievalSketch-Based Image Retrieval

Plasma-CycleGAN: Plasma Biomarker-Guided MRI to PET Cross-modality Translation Using Conditional CycleGAN

2025-01-04 · Yanxi Chen, Yi Su, Celine Dumitrascu, Kewei Chen 외

Cross-modality translation between MRI and PET imaging is challenging due to the distinct mechanisms underlying these modalities. Blood-based biomarkers (BBBMs) are revolutionizing Alzheimer's disease (AD) detection by i…

Image GenerationTranslation