Two Kinds of Recall
It is an established assumption that pattern-based models are good at precision, while learning based models are better at recall. But is that really the case? I argue that there are two kinds of recall: d-recall, reflecting diversity, and e-recall, reflecting exhaustiveness. I demonstrate through experiments that while neural methods are indeed significantly better at d-recall, it is sometimes the case that pattern-based methods are still substantially better at e-recall. Ideal methods should aim for both kinds, and this ideal should in turn be reflected in our evaluations.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityVocal Bursts Valence PredictionSimilar Papers 제목 키워드 기반
J-NERD: Joint Named Entity Recognition and Disambiguation with Rich Linguistic Features
Methods for Named Entity Recognition and Disambiguation (NERD) perform NER and NED in two separate stages. Therefore, NED may be penalized with respect to precision by NER false positives, and suffers in recall from NER …
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERPreCall: A Visual Interface for Threshold Optimization in ML Model Selection
Machine learning systems are ubiquitous in various kinds of digital applications and have a huge impact on our everyday life. But a lack of explainability and interpretability of such systems hinders meaningful participa…
BIG-bench Machine LearningModel SelectionToxBuster: In-game Chat Toxicity Buster with BERT
Detecting toxicity in online spaces is challenging and an ever more pressing problem given the increase in social media and gaming consumption. We introduce ToxBuster, a simple and scalable model trained on a relatively …
Temporal Information Extraction for Question Answering Using Syntactic Dependencies in an LSTM-based Architecture
In this paper, we propose to use a set of simple, uniform in architecture LSTM-based models to recover different kinds of temporal relations from text. Using the shortest dependency path between entities as input, the sa…
General ClassificationQuestion AnsweringSentenceTemporal Information ExtractionSemEval-2017 Task 4: Sentiment Analysis in Twitter using BERT
This paper uses the BERT model, which is a transformer-based architecture, to solve task 4A, English Language, Sentiment Analysis in Twitter of SemEval2017. BERT is a very powerful large language model for classification…
Binary ClassificationClassificationLanguage ModelingLanguage Modelling+3