Efficient Codebook and Factorization for Second Order Representation Learning
Learning rich and compact representations is an open topic in many fields such as object recognition or image retrieval. Deep neural networks have made a major breakthrough during the last few years for these tasks but their representations are not necessary as rich as needed nor as compact as expected. To build richer representations, high order statistics have been exploited and have shown excellent performances, but they produce higher dimensional features. While this drawback has been partially addressed with factorization schemes, the original compactness of first order models has never been retrieved, or at the cost of a strong performance decrease. Our method, by jointly integrating codebook strategy to factorization scheme, is able to produce compact representations while keeping the second order performances with few additional parameters. This formulation leads to state-of-the-art results on three image retrieval datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Image RetrievalObject RecognitionRepresentation LearningRetrievalSimilar Papers 제목 키워드 기반
Transfer of codebook latent factors for cross-domain recommendation with non-overlapping data
Recommender systems based on collaborative filtering play a vital role in many E-commerce applications as they guide the user in finding their items of interest based on the user's past transactions and feedback of other…
Collaborative FilteringRecommendation SystemsTransfer LearningFactorized Visual Tokenization and Generation
Visual tokenizers are fundamental to image generation. They convert visual data into discrete tokens, enabling transformer-based models to excel at image generation. Despite their success, VQ-based tokenizers like VQGAN …
DisentanglementImage GenerationQuantizationRepresentation LearningNetwork Memory Footprint Compression Through Jointly Learnable Codebooks and Mappings
The massive interest in deep neural networks (DNNs) for both computer vision and natural language processing has been sparked by the growth in computational power. However, this led to an increase in the memory footprint…
QuantizationLess is More: Multimodal Region Representation via Pairwise Inter-view Learning
With the increasing availability of geospatial datasets, researchers have explored region representation learning (RRL) to analyze complex region characteristics. Recent RRL methods use contrastive learning (CL) to captu…
Contrastive LearningRepresentation LearningA Second-Order Majorant Algorithm for Nonnegative Matrix Factorization
Nonnegative Matrix Factorization (NMF) is a fundamental tool in unsupervised learning, widely used for tasks such as dimensionality reduction, feature extraction, representation learning, and topic modeling. Many algorit…
Dimensionality ReductionRepresentation Learning