Not All Classes Stand on Same Embeddings: Calibrating a Semantic Distance with Metric Tensor
The consistency training (CT)-based semi-supervised learning (SSL) bites state-of-the-art performance on SSL-based image classification. However the existing CT-based SSL methods do not highlight the non-Euclidean characteristics and class-wise varieties of embedding spaces in an SSL model thus they cannot fully utilize the effectiveness of CT. Thus we propose a metric tensor-based consistency regularization exploiting the class-variant geometrical structure of embeddings on the high-dimensional feature space. The proposed method not only minimizes the prediction discrepancy between different views of a given image but also estimates the intrinsic geometric curvature of embedding spaces by employing the global and local metric tensors. The global metric tensor is used to globally estimate the class-invariant embeddings from the whole data distribution while the local metric tensor is exploited to estimate the class-variant embeddings of each cluster. The two metric tensors are optimized by the consistency regularization based on the weak and strong augmentation strategy. The proposed method provides the highest classification accuracy on average compared to the existing state-of-the-art SSL methods on conventional datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Allimage-classificationImage ClassificationSimilar Papers 제목 키워드 기반
Contextual Semantic Embeddings for Ontology Subsumption Prediction
Automating ontology construction and curation is an important but challenging task in knowledge engineering and artificial intelligence. Prediction by machine learning techniques such as contextual semantic embedding is …
Knowledge Graph EmbeddingsLanguage ModelingLanguage ModellingPrediction+1Improving Zero Shot Learning Baselines with Commonsense Knowledge
Zero shot learning -- the problem of training and testing on a completely disjoint set of classes -- relies greatly on its ability to transfer knowledge from train classes to test classes. Traditionally semantic embeddin…
Word EmbeddingsZero-Shot LearningClass Vectors: Embedding representation of Document Classes
Distributed representations of words and paragraphs as semantic embeddings in high dimensional data are used across a number of Natural Language Understanding tasks such as retrieval, translation, and classification. In …
General ClassificationNatural Language UnderstandingRetrievalSentiment Analysis+1Understanding Dark Scenes by Contrasting Multi-Modal Observations
Understanding dark scenes based on multi-modal image data is challenging, as both the visible and auxiliary modalities provide limited semantic information for the task. Previous methods focus on fusing the two modalitie…
Contrastive LearningScene UnderstandingSemantic SegmentationTowards Calibrating Prompt Tuning of Vision-Language Models
Prompt tuning of large-scale vision-language models such as CLIP enables efficient task adaptation without updating model weights. However, it often leads to poor confidence calibration and unreliable predictive uncertai…