Matching Multiple Perspectives for Efficient Representation Learning
Representation learning approaches typically rely on images of objects captured from a single perspective that are transformed using affine transformations. Additionally, self-supervised learning, a successful paradigm of representation learning, relies on instance discrimination and self-augmentations which cannot always bridge the gap between observations of the same object viewed from a different perspective. Viewing an object from multiple perspectives aids holistic understanding of an object which is particularly important in situations where data annotations are limited. In this paper, we present an approach that combines self-supervised learning with a multi-perspective matching technique and demonstrate its effectiveness on learning higher quality representations on data captured by a robotic vacuum with an embedded camera. We show that the availability of multiple views of the same object combined with a variety of self-supervised pretraining algorithms can lead to improved object classification performance without extra labels.
Code (0)
등록된 구현이 없습니다.
Tasks
ObjectRepresentation LearningSelf-Supervised LearningSimilar Papers 제목 키워드 기반
Knowledge Base Relation Detection via Multi-View Matching
Relation detection is a core component for Knowledge Base Question Answering (KBQA). In this paper, we propose a KB relation detection model via multi-view matching which utilizes more useful information extracted from q…
Knowledge Base Question AnsweringQuestion AnsweringRelationIntra-Correlation Encoding for Chinese Sentence Intention Matching
Sentence intention matching is vital for natural language understanding. Especially for Chinese sentence intention matching task, due to the ambiguity of Chinese words, semantic missing or semantic confusion are more lik…
Natural Language UnderstandingSentenceSemantic Matching from Different Perspectives
In this paper, we pay attention to the issue which is usually overlooked, i.e., similarity should be determined from different perspectives. To explore this issue, we release a Multi-Perspective Text Similarity (MPTS) da…
SentenceText Matchingtext similarityFeature matching in Ultrasound images
Feature matching is an important technique to identify a single object in different images. It helps machines to construct recognition of a specific object from multiple perspectives. For years, feature matching has been…
One-Shot Action Recognition via Multi-Scale Spatial-Temporal Skeleton Matching
One-shot skeleton action recognition, which aims to learn a skeleton action recognition model with a single training sample, has attracted increasing interest due to the challenge of collecting and annotating large-scale…
Action Recognition