Learning Deep Embeddings with Histogram Loss
We suggest a loss for learning deep embeddings. The new loss does not introduce parameters that need to be tuned and results in very good embeddings across a range of datasets and problems. The loss is computed by estimating two distribution of similarities for positive (matching) and negative (non-matching) sample pairs, and then computing the probability of a positive pair to have a lower similarity score than a negative pair based on the estimated similarity distributions. We show that such operations can be performed in a simple and piecewise-differentiable manner using 1D histograms with soft assignment operations. This makes the proposed loss suitable for learning deep embeddings using stochastic optimization. In the experiments, the new loss performs favourably compared to recently proposed alternatives.
Code (1)
Tasks
Stochastic OptimizationSimilar Papers 제목 키워드 기반
The Earth Mover's Pinball Loss: Quantiles for Histogram-Valued Regression
Although ubiquitous in the sciences, histogram data have not received much attention by the Deep Learning community. Whilst regression and classification tasks for scalar and vector data are routinely solved by neural ne…
regressionContinuous Histogram Loss: Beyond Neural Similarity
Similarity learning has gained a lot of attention from researches in recent years and tons of successful approaches have been recently proposed. However, the majority of the state-of-the-art similarity learning methods c…
Data VisualizationRepresentation LearningTwo-Layer Lossless HDR Coding using Histogram Packing Technique with Backward Compatibility to JPEG
An efficient two-layer coding method using the histogram packing technique with the backward compatibility to the legacy JPEG is proposed in this paper. The JPEG XT, which is the international standard to compress HDR im…
Image CompressionTwo-layer Lossless HDR Coding considering Histogram Sparseness with Backward Compatibility to JPEG
An efficient two-layer coding method using the histogram packing technique with the backward compatibility to the legacy JPEG is proposed in this paper. The JPEG XT, which is the international standard to compress HDR im…
Stochastic Learning of Multi-Instance Dictionary for Earth Mover's Distance based Histogram Comparison
Dictionary plays an important role in multi-instance data representation. It maps bags of instances to histograms. Earth mover's distance (EMD) is the most effective histogram distance metric for the application of multi…
Dictionary LearningImage RetrievalMedical Image RetrievalMulti-Instance Retrieval+4