paper-with-me

홈 › Papers

Dual-level Semantic Transfer Deep Hashing for Efficient Social Image Retrieval

2020-06-10 · Lei Zhu, Hui Cui, Zhiyong Cheng, Jingjing Li, Zheng Zhang

Social network stores and disseminates a tremendous amount of user shared images. Deep hashing is an efficient indexing technique to support large-scale social image retrieval, due to its deep representation capability, fast retrieval speed and low storage cost. Particularly, unsupervised deep hashing has well scalability as it does not require any manually labelled data for training. However, owing to the lacking of label guidance, existing methods suffer from severe semantic shortage when optimizing a large amount of deep neural network parameters. Differently, in this paper, we propose a Dual-level Semantic Transfer Deep Hashing (DSTDH) method to alleviate this problem with a unified deep hash learning framework. Our model targets at learning the semantically enhanced deep hash codes by specially exploiting the user-generated tags associated with the social images. Specifically, we design a complementary dual-level semantic transfer mechanism to efficiently discover the potential semantics of tags and seamlessly transfer them into binary hash codes. On the one hand, instance-level semantics are directly preserved into hash codes from the associated tags with adverse noise removing. Besides, an image-concept hypergraph is constructed for indirectly transferring the latent high-order semantic correlations of images and tags into hash codes. Moreover, the hash codes are obtained simultaneously with the deep representation learning by the discrete hash optimization strategy. Extensive experiments on two public social image retrieval datasets validate the superior performance of our method compared with state-of-the-art hashing methods. The source codes of our method can be obtained at https://github.com/research2020-1/DSTDH

📄 PDF Abstract BibTeX arXiv:2006.05586

Code (1)

research2020-1/DSTDH 공식 구현

Tasks

Deep HashingImage RetrievalRepresentation LearningRetrieval

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Zero-Shot Hashing via Transferring Supervised Knowledge

2016-06-16 · Yang Yang, Wei-Lun Chen, Yadan Luo, Fumin Shen 외

Hashing has shown its efficiency and effectiveness in facilitating large-scale multimedia applications. Supervised knowledge e.g. semantic labels or pair-wise relationship) associated to data is capable of significantly …

Image RetrievalRetrievalZero-shot Image Retrieval

Exploring Auxiliary Context: Discrete Semantic Transfer Hashing for Scalable Image Retrieval

2019-04-25 · Lei Zhu, Zi Huang, Zhihui Li, Liang Xie 외

Unsupervised hashing can desirably support scalable content-based image retrieval (SCBIR) for its appealing advantages of semantic label independence, memory and search efficiency. However, the learned hash codes are emb…

Content-Based Image RetrievalImage RetrievalRetrieval

Weakly-Supervised Online Hashing

2020-09-16 · Yu-Wei Zhan, Xin Luo, Yu Sun, Yongxin Wang 외

With the rapid development of social websites, recent years have witnessed an explosive growth of social images with user-provided tags which continuously arrive in a streaming fashion. Due to the fast query speed and lo…

Image RetrievalRetrieval

Dual-Stream Knowledge-Preserving Hashing for Unsupervised Video Retrieval

2023-10-12 · Pandeng Li, Hongtao Xie, Jiannan Ge, Lei Zhang 외

Unsupervised video hashing usually optimizes binary codes by learning to reconstruct input videos. Such reconstruction constraint spends much effort on frame-level temporal context changes without focusing on video-level…

RetrievalSemantic RetrievalSemantic SimilaritySemantic Textual Similarity+1

Prototype-supervised Adversarial Network for Targeted Attack of Deep Hashing

2021-05-17 · CVPR 2021 1 · Xunguang Wang, Zheng Zhang, Baoyuan Wu, Fumin Shen 외

Due to its powerful capability of representation learning and high-efficiency computation, deep hashing has made significant progress in large-scale image retrieval. However, deep hashing networks are vulnerable to adver…

Deep HashingImage RetrievalRepresentation LearningRetrieval