paper-with-me

홈 › Papers

Deep Cross-modal Hashing via Margin-dynamic-softmax Loss

2020-11-06 · Rong-Cheng Tu, Xian-Ling Mao, Rongxin Tu, Binbin Bian, Wei Wei, Heyan Huang

Due to their high retrieval efficiency and low storage cost for cross-modal search task, cross-modal hashing methods have attracted considerable attention. For the supervised cross-modal hashing methods, how to make the learned hash codes preserve semantic information sufficiently contained in the label of datapoints is the key to further enhance the retrieval performance. Hence, almost all supervised cross-modal hashing methods usually depends on defining a similarity between datapoints with the label information to guide the hashing model learning fully or partly. However, the defined similarity between datapoints can only capture the label information of datapoints partially and misses abundant semantic information, then hinders the further improvement of retrieval performance. Thus, in this paper, different from previous works, we propose a novel cross-modal hashing method without defining the similarity between datapoints, called Deep Cross-modal Hashing via \textit{Margin-dynamic-softmax Loss} (DCHML). Specifically, DCHML first trains a proxy hashing network to transform each category information of a dataset into a semantic discriminative hash code, called proxy hash code. Each proxy hash code can preserve the semantic information of its corresponding category well. Next, without defining the similarity between datapoints to supervise the training process of the modality-specific hashing networks , we propose a novel \textit{margin-dynamic-softmax loss} to directly utilize the proxy hashing codes as supervised information. Finally, by minimizing the novel \textit{margin-dynamic-softmax loss}, the modality-specific hashing networks can be trained to generate hash codes which can simultaneously preserve the cross-modal similarity and abundant semantic information well.

📄 PDF Abstract BibTeX arXiv:2011.03451

Code (0)

등록된 구현이 없습니다.

Tasks

Cross-Modal RetrievalRetrieval

Similar Papers 제목 키워드 기반

Error-Corrected Margin-Based Deep Cross-Modal Hashing for Facial Image Retrieval

2020-04-03 · Fariborz Taherkhani, Veeru Talreja, Matthew C. Valenti, Nasser M. Nasrabadi

Cross-modal hashing facilitates mapping of heterogeneous multimedia data into a common Hamming space, which can beutilized for fast and flexible retrieval across different modalities. In this paper, we propose a novel cr…

AttributeDecoderFace Image RetrievalImage Retrieval+1

SCH-GAN: Semi-supervised Cross-modal Hashing by Generative Adversarial Network

2018-02-07 · Jian Zhang, Yuxin Peng, Mingkuan Yuan

Cross-modal hashing aims to map heterogeneous multimedia data into a common Hamming space, which can realize fast and flexible retrieval across different modalities. Supervised cross-modal hashing methods have achieved c…

Generative Adversarial NetworkReinforcement LearningRetrieval

Correlation Hashing Network for Efficient Cross-Modal Retrieval

2016-02-22 · Yue Cao, Mingsheng Long, Jian-Min Wang, Philip S. Yu

Hashing is widely applied to approximate nearest neighbor search for large-scale multimodal retrieval with storage and computation efficiency. Cross-modal hashing improves the quality of hash coding by exploiting semanti…

Cross-Modal RetrievalQuantizationRetrieval

Deep Robust Multilevel Semantic Cross-Modal Hashing

2020-02-07 · Ge Song, Jun Zhao, Xiaoyang Tan

Hashing based cross-modal retrieval has recently made significant progress. But straightforward embedding data from different modalities into a joint Hamming space will inevitably produce false codes due to the intrinsic…

Cross-Modal RetrievalRetrievalTriplet

Creating Something from Nothing: Unsupervised Knowledge Distillation for Cross-Modal Hashing

2020-04-01 · CVPR 2020 6 · Hengtong Hu, Lingxi Xie, Richang Hong, Qi Tian

In recent years, cross-modal hashing (CMH) has attracted increasing attentions, mainly because its potential ability of mapping contents from different modalities, especially in vision and language, into the same space, …

Knowledge DistillationRetrieval