Revisiting Self-Similarity: Structural Embedding for Image Retrieval
Despite advances in global image representation, existing image retrieval approaches rarely consider geometric structure during the global retrieval stage. In this work, we revisit the conventional self-similarity descriptor from a convolutional perspective, to encode both the visual and structural cues of the image to global image representation. Our proposed network, named Structural Embedding Network (SENet), captures the internal structure of the images and gradually compresses them into dense self-similarity descriptors while learning diverse structures from various images. These self-similarity descriptors and original image features are fused and then pooled into global embedding, so that global embedding can represent both geometric and visual cues of the image. Along with this novel structural embedding, our proposed network sets new state-of-the-art performances on several image retrieval benchmarks, convincing its robustness to look-alike distractors. The code and models are available: https://github.com/sungonce/SENet.
Code (1)
Tasks
Image RetrievalRetrievalSimilar Papers 제목 키워드 기반
Revisiting Cosine Similarity via Normalized ICA-transformed Embeddings
Cosine similarity is widely used to measure the similarity between two embeddings, while interpretations based on angle and correlation coefficient are common. In this study, we focus on the interpretable axes of embeddi…
RetrievalSemantic SimilaritySemantic Textual SimilarityRevisiting Nonlocal Self-Similarity from Continuous Representation
Nonlocal self-similarity (NSS) is an important prior that has been successfully applied in multi-dimensional data processing tasks, e.g., image and video recovery. However, existing NSS-based methods are solely suitable …
DenoisingImage DenoisingImage InpaintingUsing Structural Similarity and Kolmogorov-Arnold Networks for Anatomical Embedding of 3-hinge Gyrus
The 3-hinge gyrus (3HG) is a newly defined folding pattern, which is the conjunction of gyri coming from three directions in cortical folding. Many studies demonstrated that 3HGs can be reliable nodes when constructing b…
Kolmogorov-Arnold NetworksLearning Genomic Sequence Representations using Graph Neural Networks over De Bruijn Graphs
The rapid expansion of genomic sequence data calls for new methods to achieve robust sequence representations. Existing techniques often neglect intricate structural details, emphasizing mainly contextual information. To…
Contrastive LearningRetrievalEmbedding-Based Entity Alignment Using Relation Structural Similarity
Entity alignment aims to find entities in different knowledge graphs that semantically represent the same real-world entity. Recently, embedding-based entity alignment methods, which represent knowledge graphs as low-dim…
Entity AlignmentEntity EmbeddingsGraph EmbeddingKnowledge Graph Embedding+2