paper-with-me

홈 › Papers

Shuffle and Learn: Minimizing Mutual Information for Unsupervised Hashing

2020-11-20 · Fangrui Liu, Zheng Liu

Unsupervised binary representation allows fast data retrieval without any annotations, enabling practical application like fast person re-identification and multimedia retrieval. It is argued that conflicts in binary space are one of the major barriers to high-performance unsupervised hashing as current methods failed to capture the precise code conflicts in the full domain. A novel relaxation method called Shuffle and Learn is proposed to tackle code conflicts in the unsupervised hash. Approximated derivatives for joint probability and the gradients for the binary layer are introduced to bridge the update from the hash to the input. Proof on $\epsilon$-Convergence of joint probability with approximated derivatives is provided to guarantee the preciseness on update applied on the mutual information. The proposed algorithm is carried out with iterative global updates to minimize mutual information, diverging the code before regular unsupervised optimization. Experiments suggest that the proposed method can relax the code optimization from local optimum and help to generate binary representations that are more discriminative and informative without any annotations. Performance benchmarks on image retrieval with the unsupervised binary code are conducted on three open datasets, and the model achieves state-of-the-art accuracy on image retrieval task for all those datasets. Datasets and reproducible code are provided.

📄 PDF Abstract BibTeX arXiv:2011.10239

Code (1)

mpskex/Minimizing-Mutual-Information 공식 구현 pytorch

Tasks

Image RetrievalPerson Re-IdentificationRetrieval

Similar Papers 제목 키워드 기반

Sequential Convex Relaxation for Mutual Information-Based Unsupervised Figure-Ground Segmentation

2014-06-01 · CVPR 2014 6 · Youngwook Kee, Mohamed Souiai, Daniel Cremers, Junmo Kim

We propose an optimization algorithm for mutual-information-based unsupervised figure-ground separation. The algorithm jointly estimates the color distributions of the foreground and background, and separates them based …

Segmentation

Unsupervised Style and Content Separation by Minimizing Mutual Information for Speech Synthesis

2020-03-09 · Ting-yao Hu, Ashish Shrivastava, Oncel Tuzel, Chandra Dhir

We present a method to generate speech from input text and a style vector that is extracted from a reference speech signal in an unsupervised manner, i.e., no style annotation, such as speaker information, is required. E…

DecoderSpeech Synthesis

Unsupervised Domain Adaptation for Cardiac Segmentation: Towards Structure Mutual Information Maximization

2022-04-20 · Changjie Lu, Shen Zheng, Gaurav Gupta

Unsupervised domain adaptation approaches have recently succeeded in various medical image segmentation tasks. The reported works often tackle the domain shift problem by aligning the domain-invariant features and minimi…

Cardiac SegmentationDomain AdaptationImage SegmentationMedical Image Segmentation+4

An Information Minimization Based Contrastive Learning Model for Unsupervised Sentence Embeddings Learning

2022-09-22 · COLING 2022 10 · Shaobin Chen, Jie zhou, Yuling Sun, Liang He

Unsupervised sentence embeddings learning has been recently dominated by contrastive learning methods (e.g., SimCSE), which keep positive pairs similar and push negative pairs apart. The contrast operation aims to keep a…

Contrastive LearningRepresentation LearningSemantic Textual SimilaritySentence+3

PointShuffleNet: Learning Non-Euclidean Features with Homotopy Equivalence and Mutual Information

2021-03-31 · Linchao He, Mengting Luo, Dejun Zhang, Xiao Yang 외

Point cloud analysis is still a challenging task due to the disorder and sparsity of samplings of their geometric structures from 3D sensors. In this paper, we introduce the homotopy equivalence relation (HER) to make th…

Contrastive LearningPoint Cloud Classification