paper-with-me

홈 › Papers

A Contrastive Teacher-Student Framework for Novelty Detection under Style Shifts

2025-01-28 · Hossein Mirzaei, Mojtaba Nafez, Moein Madadi, Arad Maleki, Mahdi Hajialilue, Zeinab Sadat Taghavi, Sepehr Rezaee, Ali Ansari, Bahar Dibaei Nia, Kian Shamsaie, Mohammadreza Salehi, Mackenzie W. Mathis, Mahdieh Soleymani Baghshah, Mohammad Sabokrou, Mohammad Hossein Rohban

There have been several efforts to improve Novelty Detection (ND) performance. However, ND methods often suffer significant performance drops under minor distribution shifts caused by changes in the environment, known as style shifts. This challenge arises from the ND setup, where the absence of out-of-distribution (OOD) samples during training causes the detector to be biased toward the dominant style features in the in-distribution (ID) data. As a result, the model mistakenly learns to correlate style with core features, using this shortcut for detection. Robust ND is crucial for real-world applications like autonomous driving and medical imaging, where test samples may have different styles than the training data. Motivated by this, we propose a robust ND method that crafts an auxiliary OOD set with style features similar to the ID set but with different core features. Then, a task-based knowledge distillation strategy is utilized to distinguish core features from style features and help our model rely on core features for discriminating crafted OOD and ID sets. We verified the effectiveness of our method through extensive experimental evaluations on several datasets, including synthetic and real-world benchmarks, against nine different ND methods.

📄 PDF Abstract BibTeX arXiv:2501.17289

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingKnowledge DistillationNovelty Detection

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

P-KDGAN: Progressive Knowledge Distillation with GANs for One-class Novelty Detection

2020-07-14 · Zhiwei Zhang, Shifeng Chen, Lei Sun

One-class novelty detection is to identify anomalous instances that do not conform to the expected normal instances. In this paper, the Generative Adversarial Networks (GANs) based on encoder-decoder-encoder pipeline are…

Anomaly DetectionDecoderKnowledge DistillationNovelty Detection+1

Distilling Calibrated Student from an Uncalibrated Teacher

2023-02-22 · Ishan Mishra, Sethu Vamsi Krishna, Deepak Mishra

Knowledge distillation is a common technique for improving the performance of a shallow student network by transferring information from a teacher network, which in general, is comparatively large and deep. These teacher…

Data AugmentationKnowledge Distillation

Semi-Supervised Object Detection with Object-wise Contrastive Learning and Regression Uncertainty

2022-12-06 · Honggyu Choi, Zhixiang Chen, Xuepeng Shi, Tae-Kyun Kim

Semi-supervised object detection (SSOD) aims to boost detection performance by leveraging extra unlabeled data. The teacher-student framework has been shown to be promising for SSOD, in which a teacher network generates …

ClassificationContrastive LearningObjectobject-detection+7

Redefining Normal: A Novel Object-Level Approach for Multi-Object Novelty Detection

2024-12-15 · Mohammadreza Salehi, Nikolaos Apostolikas, Efstratios Gavves, Cees G. M. Snoek 외

In the realm of novelty detection, accurately identifying outliers in data without specific class information poses a significant challenge. While current methods excel in single-object scenarios, they struggle with mult…

Knowledge DistillationNovelty DetectionObject

Topic Shift Detection in Chinese Dialogues: Corpus and Benchmark

2023-05-02 · Jiangyi Lin, Yaxin Fan, Feng Jiang, Xiaomin Chu 외

Dialogue topic shift detection is to detect whether an ongoing topic has shifted or should shift in a dialogue, which can be divided into two categories, i.e., response-known task and response-unknown task. Currently, on…

Contrastive Learning