ACTNET: end-to-end learning of feature activations and multi-stream aggregation for effective instance image retrieval
We propose a novel CNN architecture called ACTNET for robust instance image retrieval from large-scale datasets. Our key innovation is a learnable activation layer designed to improve the signal-to-noise ratio (SNR) of deep convolutional feature maps. Further, we introduce a controlled multi-stream aggregation, where complementary deep features from different convolutional layers are optimally transformed and balanced using our novel activation layers, before aggregation into a global descriptor. Importantly, the learnable parameters of our activation blocks are explicitly trained, together with the CNN parameters, in an end-to-end manner minimising triplet loss. This means that our network jointly learns the CNN filters and their optimal activation and aggregation for retrieval tasks. To our knowledge, this is the first time parametric functions have been used to control and learn optimal aggregation. We conduct an in-depth experimental study on three non-linear activation functions: Sine-Hyperbolic, Exponential and modified Weibull, showing that while all bring significant gains the Weibull function performs best thanks to its ability to equalise strong activations. The results clearly demonstrate that our ACTNET architecture significantly enhances the discriminative power of deep features, improving significantly over the state-of-the-art retrieval results on all datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Image RetrievalRetrievalTripletSimilar Papers 제목 키워드 기반
FactNet: A Billion-Scale Knowledge Graph for Multilingual Factual Grounding
Large language models hallucinate factual claims and struggle to ground their outputs in retrievable evidence, particularly in non-English languages. Existing resources impose a trade-off: structured knowledge bases lack…
Knowledge Graph CompletionQuestion AnsweringFact CheckingCompactNet: Platform-Aware Automatic Optimization for Convolutional Neural Networks
Convolutional Neural Network (CNN) based Deep Learning (DL) has achieved great progress in many real-life applications. Meanwhile, due to the complex model structures against strict latency and memory restriction, the im…
CPUimage-classificationImage ClassificationDynamic Binary Neural Network by learning channel-wise thresholds
Binary neural networks (BNNs) constrain weights and activations to +1 or -1 with limited storage and computational cost, which is hardware-friendly for portable devices. Recently, BNNs have achieved remarkable progress a…
Deep Learning Alternatives of the Kolmogorov Superposition Theorem
This paper explores alternative formulations of the Kolmogorov Superposition Theorem (KST) as a foundation for neural network design. The original KST formulation, while mathematically elegant, presents practical challen…
Deep LearningKolmogorov-Arnold NetworksDeep Aggregation of Regional Convolutional Activations for Content Based Image Retrieval
One of the key challenges of deep learning based image retrieval remains in aggregating convolutional activations into one highly representative feature vector. Ideally, this descriptor should encode semantic, spatial an…
Content-Based Image RetrievalImage RetrievalMetric LearningRetrieval