LoOp: Looking for Optimal Hard Negative Embeddings for Deep Metric Learning
Deep metric learning has been effectively used to learn distance metrics for different visual tasks like image retrieval, clustering, etc. In order to aid the training process, existing methods either use a hard mining strategy to extract the most informative samples or seek to generate hard synthetics using an additional network. Such approaches face different challenges and can lead to biased embeddings in the former case, and (i) harder optimization (ii) slower training speed (iii) higher model complexity in the latter case. In order to overcome these challenges, we propose a novel approach that looks for optimal hard negatives (LoOp) in the embedding space, taking full advantage of each tuple by calculating the minimum distance between a pair of positives and a pair of negatives. Unlike mining-based methods, our approach considers the entire space between pairs of embeddings to calculate the optimal hard negatives. Extensive experiments combining our approach and representative metric learning losses reveal a significant boost in performance on three benchmark datasets.
Code (1)
Tasks
Image RetrievalMetric LearningRetrievalSimilar Papers 제목 키워드 기반
Two-Stage Triplet Loss Training with Curriculum Augmentation for Audio-Visual Retrieval
The cross-modal retrieval model leverages the potential of triple loss optimization to learn robust embedding spaces. However, existing methods often train these models in a singular pass, overlooking the distinction bet…
Cross-Modal RetrievalRetrievalTripletGreenback Bears and Fiscal Hawks: Finance is a Jungle and Text Embeddings Must Adapt
Financial documents are filled with specialized terminology, arcane jargon, and curious acronyms that pose challenges for general-purpose text embeddings. Yet, few text embeddings specialized for finance have been report…
Question AnsweringStructure-Aware Hard Negative Mining for Heterogeneous Graph Contrastive Learning
Recently, heterogeneous Graph Neural Networks (GNNs) have become a de facto model for analyzing HGs, while most of them rely on a relative large number of labeled data. In this work, we investigate Contrastive Learning (…
Contrastive LearningClustering-based hard negative sampling for supervised contrastive speaker verification
In speaker verification, contrastive learning is gaining popularity as an alternative to the traditionally used classification-based approaches. Contrastive methods can benefit from an effective use of hard negative pair…
Representation LearningSpeaker VerificationContrastive LearningVSE++: Improving Visual-Semantic Embeddings with Hard Negatives
We present a new technique for learning visual-semantic embeddings for cross-modal retrieval. Inspired by hard negative mining, the use of hard negatives in structured prediction, and ranking loss functions, we introduce…
Cross-Modal RetrievalImage RetrievalRetrievalStructured Prediction+1