Semantic Novelty Detection and Characterization in Factual Text Involving Named Entities
Much of the existing work on text novelty detection has been studied at the topic level, i.e., identifying whether the topic of a document or a sentence is novel or not. Little work has been done at the fine-grained semantic level (or contextual level). For example, given that we know Elon Musk is the CEO of a technology company, the sentence "Elon Musk acted in the sitcom The Big Bang Theory" is novel and surprising because normally a CEO would not be an actor. Existing topic-based novelty detection methods work poorly on this problem because they do not perform semantic reasoning involving relations between named entities in the text and their background knowledge. This paper proposes an effective model (called PAT-SND) to solve the problem, which can also characterize the novelty. An annotated dataset is also created. Evaluation shows that PAT-SND outperforms 10 baselines by large margins.
Code (1)
Tasks
Novelty DetectionSentenceSimilar Papers 제목 키워드 기반
Novelty Detection Through Model-Based Characterization of Neural Networks
In this paper, we propose a model-based characterization of neural networks to detect novel input types and conditions. Novelty detection is crucial to identify abnormal inputs that can significantly degrade the performa…
Novelty DetectionAutoencoder-based Semantic Novelty Detection: Towards Dependable AI-based Systems
Many autonomous systems, such as driverless taxis, perform safety critical functions. Autonomous systems employ artificial intelligence (AI) techniques, specifically for the environment perception. Engineers cannot compl…
Novelty DetectionEvaluating Research Novelty Detection: Counterfactual Approaches
In this paper, we explore strategies to evaluate models for the task research paper novelty detection: Given all papers released at a given date, which of the papers discuss new ideas and influence future research? We fi…
counterfactualfeature selectionNovelty DetectionOLED: One-Class Learned Encoder-Decoder Network with Adversarial Context Masking for Novelty Detection
Novelty detection is the task of recognizing samples that do not belong to the distribution of the target class. During training, the novelty class is absent, preventing the use of traditional classification approaches. …
Anomaly DetectionDecoderNovelty DetectionNovelty Detection: A Perspective from Natural Language Processing
The quest for new information is an inborn human trait and has always been quintessential for human survival and progress. Novelty drives curiosity, which in turn drives innovation. In Natural Language Processing (NLP), …
Natural Language InferenceNovelty Detection