paper-with-me

홈 › Papers

Deep Semi-supervised Learning with Double-Contrast of Features and Semantics

2022-11-28 · Quan Feng, Jiayu Yao, Zhison Pan, Guojun Zhou

In recent years, the field of intelligent transportation systems (ITS) has achieved remarkable success, which is mainly due to the large amount of available annotation data. However, obtaining these annotated data has to afford expensive costs in reality. Therefore, a more realistic strategy is to leverage semi-supervised learning (SSL) with a small amount of labeled data and a large amount of unlabeled data. Typically, semantic consistency regularization and the two-stage learning methods of decoupling feature extraction and classification have been proven effective. Nevertheless, representation learning only limited to semantic consistency regularization may not guarantee the separation or discriminability of representations of samples with different semantics; due to the inherent limitations of the two-stage learning methods, the extracted features may not match the specific downstream tasks. In order to deal with the above drawbacks, this paper proposes an end-to-end deep semi-supervised learning double contrast of semantic and feature, which extracts effective tasks specific discriminative features by contrasting the semantics/features of positive and negative augmented samples pairs. Moreover, we leverage information theory to explain the rationality of double contrast of semantics and features and slack mutual information to contrastive loss in a simpler way. Finally, the effectiveness of our method is verified in benchmark datasets.

📄 PDF Abstract BibTeX arXiv:2211.15671

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

MoCL: Data-driven Molecular Fingerprint via Knowledge-aware Contrastive Learning from Molecular Graph

2021-06-05 · Mengying Sun, Jing Xing, Huijun Wang, Bin Chen 외

Recent years have seen a rapid growth of utilizing graph neural networks (GNNs) in the biomedical domain for tackling drug-related problems. However, like any other deep architectures, GNNs are data hungry. While requiri…

Contrastive LearningRepresentation Learning

Contrastive Multi-graph Learning with Neighbor Hierarchical Sifting for Semi-supervised Text Classification

2024-11-25 · Wei Ai, Jianbin Li, Ze Wang, Yingying Wei 외

Graph contrastive learning has been successfully applied in text classification due to its remarkable ability for self-supervised node representation learning. However, explicit graph augmentations may lead to a loss of …

Contrastive LearningGraph AttentionGraph LearningRepresentation Learning+3

Multi-Scale Cross Contrastive Learning for Semi-Supervised Medical Image Segmentation

2023-06-25 · Qianying Liu, Xiao Gu, Paul Henderson, Fani Deligianni

Semi-supervised learning has demonstrated great potential in medical image segmentation by utilizing knowledge from unlabeled data. However, most existing approaches do not explicitly capture high-level semantic relation…

Contrastive LearningImage SegmentationMedical Image SegmentationRepresentation Learning+3

Contrastive Regularization for Semi-Supervised Learning

2022-01-17 · Doyup Lee, Sungwoong Kim, Ildoo Kim, Yeongjae Cheon 외

Consistency regularization on label predictions becomes a fundamental technique in semi-supervised learning, but it still requires a large number of training iterations for high performance. In this study, we analyze tha…

Semi-Supervised Image Classification

Self-supervised Learning for Semi-supervised Temporal Language Grounding

2021-09-23 · Fan Luo, Shaoxiang Chen, Jingjing Chen, Zuxuan Wu 외

Given a text description, Temporal Language Grounding (TLG) aims to localize temporal boundaries of the segments that contain the specified semantics in an untrimmed video. TLG is inherently a challenging task, as it req…

Contrastive LearningPseudo LabelSelf-Supervised LearningSentence