Spatially Optimized Compact Deep Metric Learning Model for Similarity Search
Spatial optimization is often overlooked in many computer vision tasks. Filters should be able to recognize the features of an object regardless of where it is in the image. Similarity search is a crucial task where spatial features decide an important output. The capacity of convolution to capture visual patterns across various locations is limited. In contrast to convolution, the involution kernel is dynamically created at each pixel based on the pixel value and parameters that have been learned. This study demonstrates that utilizing a single layer of involution feature extractor alongside a compact convolution model significantly enhances the performance of similarity search. Additionally, we improve predictions by using the GELU activation function rather than the ReLU. The negligible amount of weight parameters in involution with a compact model with better performance makes the model very useful in real-world implementations. Our proposed model is below 1 megabyte in size. We have experimented with our proposed methodology and other models on CIFAR-10, FashionMNIST, and MNIST datasets. Our proposed method outperforms across all three datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Image Similarity SearchMetric LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SASNet: Spatially-Adaptive Sinusoidal Neural Networks
Sinusoidal neural networks (SNNs) have emerged as powerful implicit neural representations (INRs) for low-dimensional signals in computer vision and graphics. They enable high-frequency signal reconstruction and smooth m…
Super-ResolutionPerformance Evaluation and Optimization of Math-Similarity Search
Similarity search in math is to find mathematical expressions that are similar to a user's query. We conceptualized the similarity factors between mathematical expressions, and proposed an approach to math similarity sea…
MathUnidirectional imaging with partially coherent light
Unidirectional imagers form images of input objects only in one direction, e.g., from field-of-view (FOV) A to FOV B, while blocking the image formation in the reverse direction, from FOV B to FOV A. Here, we report unid…
BlockingLearning to Search Efficiently in High Dimensions
High dimensional similarity search in large scale databases becomes an important challenge due to the advent of Internet. For such applications, specialized data structures are required to achieve computational efficienc…
Computational EfficiencyVocal Bursts Intensity PredictionUnsupervised Deep Asymmetric Stereo Matching With Spatially-Adaptive Self-Similarity
Unsupervised stereo matching has received a lot of attention since it enables the learning of disparity estimation without ground-truth data. However, most of the unsupervised stereo matching algorithms assume that t…
Disparity EstimationStereo Matching