paper-with-me

Papers

Not All Classes Stand on Same Embeddings: Calibrating a Semantic Distance with Metric Tensor

2024-01-01 · CVPR 2024 1 · Jae Hyeon Park, Gyoomin Lee, Seunggi Park, Sung In Cho

The consistency training (CT)-based semi-supervised learning (SSL) bites state-of-the-art performance on SSL-based image classification. However the existing CT-based SSL methods do not highlight the non-Euclidean characteristics and class-wise varieties of embedding spaces in an SSL model thus they cannot fully utilize the effectiveness of CT. Thus we propose a metric tensor-based consistency regularization exploiting the class-variant geometrical structure of embeddings on the high-dimensional feature space. The proposed method not only minimizes the prediction discrepancy between different views of a given image but also estimates the intrinsic geometric curvature of embedding spaces by employing the global and local metric tensors. The global metric tensor is used to globally estimate the class-invariant embeddings from the whole data distribution while the local metric tensor is exploited to estimate the class-variant embeddings of each cluster. The two metric tensors are optimized by the consistency regularization based on the weak and strong augmentation strategy. The proposed method provides the highest classification accuracy on average compared to the existing state-of-the-art SSL methods on conventional datasets.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Allimage-classificationImage Classification

Similar Papers 제목 키워드 기반

Contextual Semantic Embeddings for Ontology Subsumption Prediction

2022-02-20 · Jiaoyan Chen, Yuan He, Yuxia Geng, Ernesto Jimenez-Ruiz 외

Automating ontology construction and curation is an important but challenging task in knowledge engineering and artificial intelligence. Prediction by machine learning techniques such as contextual semantic embedding is …

Knowledge Graph EmbeddingsLanguage ModelingLanguage ModellingPrediction+1

Improving Zero Shot Learning Baselines with Commonsense Knowledge

2020-12-11 · Abhinaba Roy, Deepanway Ghosal, Erik Cambria, Navonil Majumder 외

Zero shot learning -- the problem of training and testing on a completely disjoint set of classes -- relies greatly on its ability to transfer knowledge from train classes to test classes. Traditionally semantic embeddin…

Word EmbeddingsZero-Shot Learning

Class Vectors: Embedding representation of Document Classes

2015-08-02 · Devendra Singh Sachan, Shailesh Kumar

Distributed representations of words and paragraphs as semantic embeddings in high dimensional data are used across a number of Natural Language Understanding tasks such as retrieval, translation, and classification. In …

General ClassificationNatural Language UnderstandingRetrievalSentiment Analysis+1

Understanding Dark Scenes by Contrasting Multi-Modal Observations

2023-08-23 · Xiaoyu Dong, Naoto Yokoya

Understanding dark scenes based on multi-modal image data is challenging, as both the visible and auxiliary modalities provide limited semantic information for the task. Previous methods focus on fusing the two modalitie…

Contrastive LearningScene UnderstandingSemantic Segmentation

Towards Calibrating Prompt Tuning of Vision-Language Models

2026-02-22 · Ashshak Sharifdeen, Fahad Shamshad, Muhammad Akhtar Munir, Abhishek Basu 외 arxiv

Prompt tuning of large-scale vision-language models such as CLIP enables efficient task adaptation without updating model weights. However, it often leads to poor confidence calibration and unreliable predictive uncertai…