paper-with-me

Papers

Self-supervised Pseudo Multi-class Pre-training for Unsupervised Anomaly Detection and Segmentation in Medical Images

2021-09-03 · Yu Tian, Fengbei Liu, Guansong Pang, Yuanhong Chen, Yuyuan Liu, Johan W. Verjans, Rajvinder Singh, Gustavo Carneiro

Unsupervised anomaly detection (UAD) methods are trained with normal (or healthy) images only, but during testing, they are able to classify normal and abnormal (or disease) images. UAD is an important medical image analysis (MIA) method to be applied in disease screening problems because the training sets available for those problems usually contain only normal images. However, the exclusive reliance on normal images may result in the learning of ineffective low-dimensional image representations that are not sensitive enough to detect and segment unseen abnormal lesions of varying size, appearance, and shape. Pre-training UAD methods with self-supervised learning, based on computer vision techniques, can mitigate this challenge, but they are sub-optimal because they do not explore domain knowledge for designing the pretext tasks, and their contrastive learning losses do not try to cluster the normal training images, which may result in a sparse distribution of normal images that is ineffective for anomaly detection. In this paper, we propose a new self-supervised pre-training method for MIA UAD applications, named Pseudo Multi-class Strong Augmentation via Contrastive Learning (PMSACL). PMSACL consists of a novel optimisation method that contrasts a normal image class from multiple pseudo classes of synthesised abnormal images, with each class enforced to form a dense cluster in the feature space. In the experiments, we show that our PMSACL pre-training improves the accuracy of SOTA UAD methods on many MIA benchmarks using colonoscopy, fundus screening and Covid-19 Chest X-ray datasets. The code is made publicly available via https://github.com/tianyu0207/PMSACL.

📄 PDF Abstract BibTeX arXiv:2109.01303

Code (1)

tianyu0207/CCD 공식 구현 pytorch

Tasks

Anomaly DetectionContrastive LearningData AugmentationMedical Image AnalysisSelf-Supervised LearningUnsupervised Anomaly Detection

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Exploiting Completeness and Uncertainty of Pseudo Labels for Weakly Supervised Video Anomaly Detection

2022-12-08 · CVPR 2023 1 · Chen Zhang, Guorong Li, Yuankai Qi, Shuhui Wang 외

Weakly supervised video anomaly detection aims to identify abnormal events in videos using only video-level labels. Recently, two-stage self-training methods have achieved significant improvements by self-generating pseu…

Anomaly DetectionDiversityPseudo LabelVideo Anomaly Detection+1

RefRec: Pseudo-labels Refinement via Shape Reconstruction for Unsupervised 3D Domain Adaptation

2021-10-21 · Adriano Cardace, Riccardo Spezialetti, Pierluigi Zama Ramirez, Samuele Salti 외

Unsupervised Domain Adaptation (UDA) for point cloud classification is an emerging research problem with relevant practical motivations. Reliance on multi-task learning to align features across domains has been the stand…

Domain AdaptationMulti-Task LearningPoint Cloud ClassificationUnsupervised Domain Adaptation

IPCL: Iterative Pseudo-Supervised Contrastive Learning to Improve Self-Supervised Feature Representation

2024-03-18 · IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2024 3 · Sonal Kumar; Anirudh Phukan, Arijit Sur

Self-supervised learning with a contrastive batch approach has become a powerful tool for representation learning in computer vision. The performance of downstream tasks is proportional to the quality of visual features …

Contrastive LearningData Augmentationimage-classificationImage Classification+5

3SD: Self-Supervised Saliency Detection With No Labels

2022-03-09 · Rajeev Yasarla, Renliang Weng, Wongun Choi, Vishal Patel 외

We present a conceptually simple self-supervised method for saliency detection. Our method generates and uses pseudo-ground truth labels for training. The generated pseudo-GT labels don't require any kind of human annota…

ClassificationContrastive Learningobject-detectionObject Detection+2

Semi-Supervised Learning with Balanced Deep Representation Distributions

2026-03-22 · Changchun Li, Ximing Li, Bingjie Zhang, Wenting Wang 외 arxiv

Semi-Supervised Text Classification (SSTC) mainly works under the spirit of self-training. They initialize the deep classifier by training over labeled texts; and then alternatively predict unlabeled texts as their pseud…

Semi-Supervised Text ClassificationMulti-Label ClassificationMulti-class Classification