Exploit Clues from Views: Self-Supervised and Regularized Learning for Multiview Object Recognition
Multiview recognition has been well studied in the literature and achieves decent performance in object recognition and retrieval task. However, most previous works rely on supervised learning and some impractical underlying assumptions, such as the availability of all views in training and inference time. In this work, the problem of multiview self-supervised learning (MV-SSL) is investigated, where only image to object association is given. Given this setup, a novel surrogate task for self-supervised learning is proposed by pursuing "object invariant" representation. This is solved by randomly selecting an image feature of an object as object prototype, accompanied with multiview consistency regularization, which results in view invariant stochastic prototype embedding (VISPE). Experiments shows that the recognition and retrieval results using VISPE outperform that of other self-supervised learning methods on seen and unseen data. VISPE can also be applied to semi-supervised scenario and demonstrates robust performance with limited data available. Code is available at https://github.com/chihhuiho/VISPE
Code (1)
Tasks
ObjectObject RecognitionRetrievalSelf-Supervised LearningSimilar Papers 제목 키워드 기반
Learning Self-Regularized Adversarial Views for Self-Supervised Vision Transformers
Automatic data augmentation (AutoAugment) strategies are indispensable in supervised data-efficient training protocols of vision transformers, and have led to state-of-the-art results in supervised learning. Despite the …
Data AugmentationImage RetrievalRetrievalSelf-Supervised Learning+1RGI : Regularized Graph Infomax for self-supervised learning on graphs
Self-supervised learning is gaining considerable attention as a solution to avoid the requirement of extensive annotations in representation learning on graphs. We introduce \textit{Regularized Graph Infomax (RGI)}, a si…
Graph Neural NetworkRepresentation LearningSelf-Supervised LearningSelf-Supervised Deep Depth Denoising
Depth perception is considered an invaluable source of information for various vision tasks. However, depth maps acquired using consumer-level sensors still suffer from non-negligible noise. This fact has recently motiva…
3D ReconstructionDenoisingExploiting Review Neighbors for Contextualized Helpfulness Prediction
Helpfulness prediction techniques have been widely used to identify and recommend high-quality online reviews to customers. Currently, the vast majority of studies assume that a review's helpfulness is self-contained. In…
PredictionKernelized Multiview Subspace Analysis by Self-weighted Learning
With the popularity of multimedia technology, information is always represented or transmitted from multiple views. Most of the existing algorithms are graph-based ones to learn the complex structures within multiview da…
Dimensionality ReductionImage RetrievalRetrieval