Learning for Transductive Threshold Calibration in Open-World Recognition
In deep metric learning for visual recognition, the calibration of distance thresholds is crucial for achieving desired model performance in the true positive rates (TPR) or true negative rates (TNR). However, calibrating this threshold presents challenges in open-world scenarios, where the test classes can be entirely disjoint from those encountered during training. We define the problem of finding distance thresholds for a trained embedding model to achieve target performance metrics over unseen open-world test classes as open-world threshold calibration. Existing posthoc threshold calibration methods, reliant on inductive inference and requiring a calibration dataset with a similar distance distribution as the test data, often prove ineffective in open-world scenarios. To address this, we introduce OpenGCN, a Graph Neural Network-based transductive threshold calibration method with enhanced adaptability and robustness. OpenGCN learns to predict pairwise connectivity for the unlabeled test instances embedded in a graph to determine its TPR and TNR at various distance thresholds, allowing for transductive inference of the distance thresholds which also incorporates test-time information. Extensive experiments across open-world visual recognition benchmarks validate OpenGCN's superiority over existing posthoc calibration methods for open-world threshold calibration.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph Neural NetworkMetric LearningOpen Set LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
EOL: Transductive Few-Shot Open-Set Recognition by Enhancing Outlier Logits
In Few-Shot Learning (FSL), models are trained to recognise unseen objects from a query set, given a few labelled examples from a support set. In standard FSL, models are evaluated on query instances sampled from the sam…
Few-Shot LearningOpen Set LearningOutlier DetectionPseudo LabelCommunity-aware evaluation and threshold calibration for open-set plankton image recognition
Automated plankton image recognition is increasingly used in aquatic ecosystem monitoring, but deployed classifiers inevitably encounter unseen taxa and non-target particles. Open-set recognition methods are usually eval…
Few-Shot Open-Set Audio Classification via Transductive Prototype Refinement and Class Logit Enhancement
Few-shot Open-set audio classification requires classifying query samples from known classes with a few labeled support samples while rejecting query samples from unknown classes. Transductive inference jointly observes …
Audio ClassificationLearning Placeholders for Open-Set Recognition
Traditional classifiers are deployed under closed-set setting, with both training and test classes belong to the same set. However, real-world applications probably face the input of unknown categories, and the model wil…
Open Set LearningOpen-Set Likelihood Maximization for Few-Shot Learning
We tackle the Few-Shot Open-Set Recognition (FSOSR) problem, i.e. classifying instances among a set of classes for which we only have a few labeled samples, while simultaneously detecting instances that do not belong to …
Few-Shot Image ClassificationFew-Shot LearningOpen Set LearningOutlier Detection