Learning Non-Metric Visual Similarity for Image Retrieval
Measuring visual similarity between two or more instances within a data distribution is a fundamental task in image retrieval. Theoretically, non-metric distances are able to generate a more complex and accurate similarity model than metric distances, provided that the non-linear data distribution is precisely captured by the system. In this work, we explore neural networks models for learning a non-metric similarity function for instance search. We argue that non-metric similarity functions based on neural networks can build a better model of human visual perception than standard metric distances. As our proposed similarity function is differentiable, we explore a real end-to-end trainable approach for image retrieval, i.e. we learn the weights from the input image pixels to the final similarity score. Experimental evaluation shows that non-metric similarity networks are able to learn visual similarities between images and improve performance on top of state-of-the-art image representations, boosting results in standard image retrieval datasets with respect standard metric distances.
Code (0)
등록된 구현이 없습니다.
Tasks
Content-Based Image RetrievalImage RetrievalInstance SearchRetrievalSimilar Papers 제목 키워드 기반
Revisiting Self-Similarity: Structural Embedding for Image Retrieval
Despite advances in global image representation, existing image retrieval approaches rarely consider geometric structure during the global retrieval stage. In this work, we revisit the conventional self-similarity de…
Image RetrievalRetrievalIntegrating Visual and Semantic Similarity Using Hierarchies for Image Retrieval
Most of the research in content-based image retrieval (CBIR) focus on developing robust feature representations that can effectively retrieve instances from a database of images that are visually similar to a query. Howe…
Content-Based Image RetrievalImage RetrievalRetrievalSemantic Similarity+1DR-KFS: A Differentiable Visual Similarity Metric for 3D Shape Reconstruction
We introduce a differential visual similarity metric to train deep neural networks for 3D reconstruction, aimed at improving reconstruction quality. The metric compares two 3D shapes by measuring distances between multi-…
3D Reconstruction3D Shape ReconstructionRetrievalLearning Visual Hierarchies with Hyperbolic Embeddings
Structuring latent representations in a hierarchical manner enables models to learn patterns at multiple levels of abstraction. However, most prevalent image understanding models focus on visual similarity, and learning …
Image RetrievalRetrievalEarly Burst Detection for Memory-Efficient Image Retrieval
Recent works show that image comparison based on local descriptors is corrupted by visual bursts, which tend to dominate the image similarity. The existing strategies, like power-law normalization, improve the results by…
Image RetrievalRetrieval