Shuffle and Learn: Minimizing Mutual Information for Unsupervised Hashing
Unsupervised binary representation allows fast data retrieval without any annotations, enabling practical application like fast person re-identification and multimedia retrieval. It is argued that conflicts in binary space are one of the major barriers to high-performance unsupervised hashing as current methods failed to capture the precise code conflicts in the full domain. A novel relaxation method called Shuffle and Learn is proposed to tackle code conflicts in the unsupervised hash. Approximated derivatives for joint probability and the gradients for the binary layer are introduced to bridge the update from the hash to the input. Proof on $\epsilon$-Convergence of joint probability with approximated derivatives is provided to guarantee the preciseness on update applied on the mutual information. The proposed algorithm is carried out with iterative global updates to minimize mutual information, diverging the code before regular unsupervised optimization. Experiments suggest that the proposed method can relax the code optimization from local optimum and help to generate binary representations that are more discriminative and informative without any annotations. Performance benchmarks on image retrieval with the unsupervised binary code are conducted on three open datasets, and the model achieves state-of-the-art accuracy on image retrieval task for all those datasets. Datasets and reproducible code are provided.
Code (1)
Tasks
Image RetrievalPerson Re-IdentificationRetrievalSimilar Papers 제목 키워드 기반
Sequential Convex Relaxation for Mutual Information-Based Unsupervised Figure-Ground Segmentation
We propose an optimization algorithm for mutual-information-based unsupervised figure-ground separation. The algorithm jointly estimates the color distributions of the foreground and background, and separates them based …
SegmentationUnsupervised Style and Content Separation by Minimizing Mutual Information for Speech Synthesis
We present a method to generate speech from input text and a style vector that is extracted from a reference speech signal in an unsupervised manner, i.e., no style annotation, such as speaker information, is required. E…
DecoderSpeech SynthesisUnsupervised Domain Adaptation for Cardiac Segmentation: Towards Structure Mutual Information Maximization
Unsupervised domain adaptation approaches have recently succeeded in various medical image segmentation tasks. The reported works often tackle the domain shift problem by aligning the domain-invariant features and minimi…
Cardiac SegmentationDomain AdaptationImage SegmentationMedical Image Segmentation+4An Information Minimization Based Contrastive Learning Model for Unsupervised Sentence Embeddings Learning
Unsupervised sentence embeddings learning has been recently dominated by contrastive learning methods (e.g., SimCSE), which keep positive pairs similar and push negative pairs apart. The contrast operation aims to keep a…
Contrastive LearningRepresentation LearningSemantic Textual SimilaritySentence+3PointShuffleNet: Learning Non-Euclidean Features with Homotopy Equivalence and Mutual Information
Point cloud analysis is still a challenging task due to the disorder and sparsity of samplings of their geometric structures from 3D sensors. In this paper, we introduce the homotopy equivalence relation (HER) to make th…
Contrastive LearningPoint Cloud Classification