Pseudo-Labeling Enhanced by Privileged Information and Its Application to In Situ Sequencing Images
Various strategies for label-scarce object detection have been explored by the computer vision research community. These strategies mainly rely on assumptions that are specific to natural images and not directly applicable to the biological and biomedical vision domains. For example, most semi-supervised learning strategies rely on a small set of labeled data as a confident source of ground truth. In many biological vision applications, however, the ground truth is unknown and indirect information might be available in the form of noisy estimations or orthogonal evidence. In this work, we frame a crucial problem in spatial transcriptomics - decoding barcodes from In-Situ-Sequencing (ISS) images - as a semi-supervised object detection (SSOD) problem. Our proposed framework incorporates additional available sources of information into a semi-supervised learning framework in the form of privileged information. The privileged information is incorporated into the teacher's pseudo-labeling in a teacher-student self-training iteration. Although the available privileged information could be data domain specific, we have introduced a general strategy of pseudo-labeling enhanced by privileged information (PLePI) and exemplified the concept using ISS images, as well on the COCO benchmark using extra evidence provided by CLIP.
Code (0)
등록된 구현이 없습니다.
Tasks
object-detectionObject DetectionSemi-Supervised Object DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Gaussian Process Classification with Privileged Information by Soft-to-Hard Labeling Transfer
Learning using privileged information is an attractive problem setting that helps many learning scenarios in the real world. A state-of-the-art method of Gaussian process classification (GPC) with privileged information …
Gaussian ProcessesGeneral ClassificationTransfer LearningATPL: Mutually enhanced adversarial training and pseudo labeling for unsupervised domain adaptation
Unsupervised domain adaptation aims to transfer knowledge from a labeled source domain to a related but unlabeled target domain. Most existing approaches either adversarially reduce the domain shift or use pseudo-labels …
Domain AdaptationUnsupervised Domain AdaptationPEPL: Precision-Enhanced Pseudo-Labeling for Fine-Grained Image Classification in Semi-Supervised Learning
Fine-grained image classification has witnessed significant advancements with the advent of deep learning and computer vision technologies. However, the scarcity of detailed annotations remains a major challenge, especia…
Data AugmentationFine-Grained Image Classificationimage-classificationImage Classification+1TrajSSL: Trajectory-Enhanced Semi-Supervised 3D Object Detection
Semi-supervised 3D object detection is a common strategy employed to circumvent the challenge of manually labeling large-scale autonomous driving perception datasets. Pseudo-labeling approaches to semi-supervised learnin…
3D Object DetectionAutonomous DrivingMotion ForecastingObject+3PIGDreamer: Privileged Information Guided World Models for Safe Partially Observable Reinforcement Learning
Partial observability presents a significant challenge for Safe Reinforcement Learning (Safe RL), as it impedes the identification of potential risks and rewards. Leveraging specific types of privileged information durin…
Reinforcement Learning