A Contrastive Teacher-Student Framework for Novelty Detection under Style Shifts
There have been several efforts to improve Novelty Detection (ND) performance. However, ND methods often suffer significant performance drops under minor distribution shifts caused by changes in the environment, known as style shifts. This challenge arises from the ND setup, where the absence of out-of-distribution (OOD) samples during training causes the detector to be biased toward the dominant style features in the in-distribution (ID) data. As a result, the model mistakenly learns to correlate style with core features, using this shortcut for detection. Robust ND is crucial for real-world applications like autonomous driving and medical imaging, where test samples may have different styles than the training data. Motivated by this, we propose a robust ND method that crafts an auxiliary OOD set with style features similar to the ID set but with different core features. Then, a task-based knowledge distillation strategy is utilized to distinguish core features from style features and help our model rely on core features for discriminating crafted OOD and ID sets. We verified the effectiveness of our method through extensive experimental evaluations on several datasets, including synthetic and real-world benchmarks, against nine different ND methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingKnowledge DistillationNovelty DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
P-KDGAN: Progressive Knowledge Distillation with GANs for One-class Novelty Detection
One-class novelty detection is to identify anomalous instances that do not conform to the expected normal instances. In this paper, the Generative Adversarial Networks (GANs) based on encoder-decoder-encoder pipeline are…
Anomaly DetectionDecoderKnowledge DistillationNovelty Detection+1Distilling Calibrated Student from an Uncalibrated Teacher
Knowledge distillation is a common technique for improving the performance of a shallow student network by transferring information from a teacher network, which in general, is comparatively large and deep. These teacher…
Data AugmentationKnowledge DistillationSemi-Supervised Object Detection with Object-wise Contrastive Learning and Regression Uncertainty
Semi-supervised object detection (SSOD) aims to boost detection performance by leveraging extra unlabeled data. The teacher-student framework has been shown to be promising for SSOD, in which a teacher network generates …
ClassificationContrastive LearningObjectobject-detection+7Redefining Normal: A Novel Object-Level Approach for Multi-Object Novelty Detection
In the realm of novelty detection, accurately identifying outliers in data without specific class information poses a significant challenge. While current methods excel in single-object scenarios, they struggle with mult…
Knowledge DistillationNovelty DetectionObjectTopic Shift Detection in Chinese Dialogues: Corpus and Benchmark
Dialogue topic shift detection is to detect whether an ongoing topic has shifted or should shift in a dialogue, which can be divided into two categories, i.e., response-known task and response-unknown task. Currently, on…
Contrastive Learning