paper-with-me

홈 › Papers

Do We Really Need to Learn Representations from In-domain Data for Outlier Detection?

2021-05-19 · Zhisheng Xiao, Qing Yan, Yali Amit

Unsupervised outlier detection, which predicts if a test sample is an outlier or not using only the information from unlabelled inlier data, is an important but challenging task. Recently, methods based on the two-stage framework achieve state-of-the-art performance on this task. The framework leverages self-supervised representation learning algorithms to train a feature extractor on inlier data, and applies a simple outlier detector in the feature space. In this paper, we explore the possibility of avoiding the high cost of training a distinct representation for each outlier detection task, and instead using a single pre-trained network as the universal feature extractor regardless of the source of in-domain data. In particular, we replace the task-specific feature extractor by one network pre-trained on ImageNet with a self-supervised loss. In experiments, we demonstrate competitive or better performance on a variety of outlier detection benchmarks compared with previous two-stage methods, suggesting that learning representations from in-domain data may be unnecessary for outlier detection.

📄 PDF Abstract BibTeX arXiv:2105.09270

Code (0)

등록된 구현이 없습니다.

Tasks

Outlier DetectionRepresentation Learning

Similar Papers 제목 키워드 기반

Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptation

2020-02-20 · ICML 2020 1 · Jian Liang, Dapeng Hu, Jiashi Feng

Unsupervised domain adaptation (UDA) aims to leverage the knowledge learned from a labeled source dataset to solve similar tasks in a new unlabeled domain. Prior UDA methods typically require to access the source data wh…

Domain AdaptationPartial Domain AdaptationRepresentation LearningSource-Free Domain Adaptation+2

Do We Really Need Specialization? Evaluating Generalist Text Embeddings for Zero-Shot Recommendation and Search

2025-07-07 · Matteo Attimonelli, Alessandro De Bellis, Claudio Pomo, Dietmar Jannach 외 arxiv

Pre-trained language models (PLMs) are widely used to derive semantic representations from item metadata in recommendation and search. In sequential recommendation, PLMs enhance ID-based embeddings through textual metada…

Sequential Recommendation

Do We Really Need Lexical Information? Towards a Top-down Approach to Sentiment Analysis of Product Reviews

2015-05-01 · HLT 2015 5 · Hyopil Shin, Yulia Otmakhova
NegationSentiment Analysis

Do We Really Need All Those Rich Linguistic Features? A Neural Network-Based Approach to Implicit Sense Labeling

2016-08-01 · CONLL 2016 8 · Niko Schenk, Christian Chiarcos, Don, Kathrin t 외
AllReading ComprehensionWord Embeddings

Is Neural Topic Modelling Better than Clustering? An Empirical Study on Clustering with Contextual Embeddings for Topics

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Recent work incorporates pre-trained word embeddings such as BERT embeddings into Neural Topic Models (NTMs), generating highly coherent topics. However, with high-quality contextualized document representations, do we r…

ClusteringSentenceSentence EmbeddingsTopic Models+1