Deep Feature Aggregation and Image Re-ranking with Heat Diffusion for Image Retrieval
Image retrieval based on deep convolutional features has demonstrated state-of-the-art performance in popular benchmarks. In this paper, we present a unified solution to address deep convolutional feature aggregation and image re-ranking by simulating the dynamics of heat diffusion. A distinctive problem in image retrieval is that repetitive or \emph{bursty} features tend to dominate final image representations, resulting in representations less distinguishable. We show that by considering each deep feature as a heat source, our unsupervised aggregation method is able to avoid over-representation of \emph{bursty} features. We additionally provide a practical solution for the proposed aggregation method and further show the efficiency of our method in experimental evaluation. Inspired by the aforementioned deep feature aggregation method, we also propose a method to re-rank a number of top ranked images for a given query image by considering the query as the heat source. Finally, we extensively evaluate the proposed approach with pre-trained and fine-tuned deep networks on common public benchmarks and show superior performance compared to previous work.
Code (1)
Tasks
Image RetrievalRe-RankingRetrievalSimilar Papers 제목 키워드 기반
Learning Structure-Guided Diffusion Model for 2D Human Pose Estimation
One of the mainstream schemes for 2D human pose estimation (HPE) is learning keypoints heatmaps by a neural network. Existing methods typically improve the quality of heatmaps by customized architectures, such as high-re…
2D Human Pose EstimationDenoisingPose EstimationHATIR: Heat-Aware Diffusion for Turbulent Infrared Video Super-Resolution
Infrared video has been of great interest in visual tasks under challenging environments, but often suffers from severe atmospheric turbulence and compression degradation. Existing video super-resolution (VSR) methods ei…
Video Super-ResolutionQuantifying and Visualizing Hidden Preferential Aggregations Amid Heterogeneity
Biological systems often exhibit a heterogeneous arrangement of objects, such as assorted nuclear chromatin patterns in a tumor, assorted species of bacteria in biofilms, or assorted aggregates of subcellular particles. …
DoubleDiffusion: Combining Heat Diffusion with Denoising Diffusion for Texture Generation on 3D Meshes
This paper addresses the problem of generating textures for 3D mesh assets. Existing approaches often rely on image diffusion models to generate multi-view image observations, which are then transformed onto the mesh sur…
3D Surface GenerationGeometry-based operator learningLatent Diffusion Model for 3DTexture SynthesisContextual Similarity Aggregation with Self-attention for Visual Re-ranking
In content-based image retrieval, the first-round retrieval result by simple visual feature comparison may be unsatisfactory, which can be refined by visual re-ranking techniques. In image retrieval, it is observed that …
Content-Based Image RetrievalData AugmentationImage RetrievalRe-Ranking+1