paper-with-me

홈 › Papers

LoOp: Looking for Optimal Hard Negative Embeddings for Deep Metric Learning

2021-08-20 · ICCV 2021 10 · Bhavya Vasudeva, Puneesh Deora, Saumik Bhattacharya, Umapada Pal, Sukalpa Chanda

Deep metric learning has been effectively used to learn distance metrics for different visual tasks like image retrieval, clustering, etc. In order to aid the training process, existing methods either use a hard mining strategy to extract the most informative samples or seek to generate hard synthetics using an additional network. Such approaches face different challenges and can lead to biased embeddings in the former case, and (i) harder optimization (ii) slower training speed (iii) higher model complexity in the latter case. In order to overcome these challenges, we propose a novel approach that looks for optimal hard negatives (LoOp) in the embedding space, taking full advantage of each tuple by calculating the minimum distance between a pair of positives and a pair of negatives. Unlike mining-based methods, our approach considers the entire space between pairs of embeddings to calculate the optimal hard negatives. Extensive experiments combining our approach and representative metric learning losses reveal a significant boost in performance on three benchmark datasets.

📄 PDF Abstract BibTeX arXiv:2108.09335

Code (1)

puneesh00/loop 공식 구현 mxnet

Tasks

Image RetrievalMetric LearningRetrieval

Similar Papers 제목 키워드 기반

Two-Stage Triplet Loss Training with Curriculum Augmentation for Audio-Visual Retrieval

2023-10-20 · Donghuo Zeng, Kazushi Ikeda

The cross-modal retrieval model leverages the potential of triple loss optimization to learn robust embedding spaces. However, existing methods often train these models in a singular pass, overlooking the distinction bet…

Cross-Modal RetrievalRetrievalTriplet

Greenback Bears and Fiscal Hawks: Finance is a Jungle and Text Embeddings Must Adapt

2024-11-11 · Peter Anderson, Mano Vikash Janardhanan, Jason He, Wei Cheng 외

Financial documents are filled with specialized terminology, arcane jargon, and curious acronyms that pose challenges for general-purpose text embeddings. Yet, few text embeddings specialized for finance have been report…

Question Answering

Structure-Aware Hard Negative Mining for Heterogeneous Graph Contrastive Learning

2021-08-31 · Yanqiao Zhu, Yichen Xu, Hejie Cui, Carl Yang 외

Recently, heterogeneous Graph Neural Networks (GNNs) have become a de facto model for analyzing HGs, while most of them rely on a relative large number of labeled data. In this work, we investigate Contrastive Learning (…

Contrastive Learning

Clustering-based hard negative sampling for supervised contrastive speaker verification

2025-07-23 · Piotr Masztalski, Michał Romaniuk, Jakub Żak, Mateusz Matuszewski 외 arxiv

In speaker verification, contrastive learning is gaining popularity as an alternative to the traditionally used classification-based approaches. Contrastive methods can benefit from an effective use of hard negative pair…

Representation LearningSpeaker VerificationContrastive Learning

VSE++: Improving Visual-Semantic Embeddings with Hard Negatives

2017-07-18 · Fartash Faghri, David J. Fleet, Jamie Ryan Kiros, Sanja Fidler

We present a new technique for learning visual-semantic embeddings for cross-modal retrieval. Inspired by hard negative mining, the use of hard negatives in structured prediction, and ranking loss functions, we introduce…

Cross-Modal RetrievalImage RetrievalRetrievalStructured Prediction+1