Offline versus Online Triplet Mining based on Extreme Distances of Histopathology Patches
We analyze the effect of offline and online triplet mining for colorectal cancer (CRC) histopathology dataset containing 100,000 patches. We consider the extreme, i.e., farthest and nearest patches to a given anchor, both in online and offline mining. While many works focus solely on selecting the triplets online (batch-wise), we also study the effect of extreme distances and neighbor patches before training in an offline fashion. We analyze extreme cases' impacts in terms of embedding distance for offline versus online mining, including easy positive, batch semi-hard, batch hard triplet mining, neighborhood component analysis loss, its proxy version, and distance weighted sampling. We also investigate online approaches based on extreme distance and comprehensively compare offline, and online mining performance based on the data patterns and explain offline mining as a tractable generalization of the online mining with large mini-batch size. As well, we discuss the relations of different colorectal tissue types in terms of extreme distances. We found that offline and online mining approaches have comparable performances for a specific architecture, such as ResNet-18 in this study. Moreover, we found the assorted case, including different extreme distances, is promising, especially in the online approach.
Code (1)
Tasks
Dimensionality ReductionHistopathological Image ClassificationMetric LearningTripletSimilar Papers 제목 키워드 기반
Batch-Incremental Triplet Sampling for Training Triplet Networks Using Bayesian Updating Theorem
Variants of Triplet networks are robust entities for learning a discriminative embedding subspace. There exist different triplet mining approaches for selecting the most suitable training triplets. Some of these mining m…
Dimensionality ReductionHistopathological Image ClassificationMetric LearningTripletHow to Train Triplet Networks with 100K Identities?
Training triplet networks with large-scale data is challenging in face recognition. Due to the number of possible triplets explodes with the number of samples, previous studies adopt the online hard negative mining(OHNM)…
Face RecognitionImage RetrievalRetrievalTripletTriplet-Trained Vector Space and Sieve-Based Search Improve Biomedical Concept Normalization
Concept normalization, the task of linking textual mentions of concepts to concepts in an ontology, is critical for mining and analyzing biomedical texts. We propose a vector-space model for concept normalization, where …
TripletExtreme Triplet Learning: Effectively Optimizing Easy Positives and Hard Negatives
The Triplet Loss approach to Distance Metric Learning is defined by the strategy to select triplets and the loss function through which those triplets are optimized. During optimization, two especially important cases a…
Metric LearningTripletSemi Supervised Learning For Few-shot Audio Classification By Episodic Triplet Mining
Few-shot learning aims to generalize unseen classes that appear during testing but are unavailable during training. Prototypical networks incorporate few-shot metric learning, by constructing a class prototype in the for…
Audio ClassificationEvent DetectionFew-Shot Audio ClassificationFew-Shot Learning+5