TermEval 2020: Shared Task on Automatic Term Extraction Using the Annotated Corpora for Term Extraction Research (ACTER) Dataset
The TermEval 2020 shared task provided a platform for researchers to work on automatic term extraction (ATE) with the same dataset: the Annotated Corpora for Term Extraction Research (ACTER). The dataset covers three languages (English, French, and Dutch) and four domains, of which the domain of \textit{heart failure} was kept as a held-out test set on which final f1-scores were calculated. The aim was to provide a large, transparent, qualitatively annotated, and diverse dataset to the ATE research community, with the goal of promoting comparative research and thus identifying strengths and weaknesses of various state-of-the-art methodologies. The results show a lot of variation between different systems and illustrate how some methodologies reach higher precision or recall, how different systems extract different types of terms, how some are exceptionally good at finding rare terms, or are less impacted by term length. The current contribution offers an overview of the shared task with a comparative evaluation, which complements the individual papers by all participants.
Code (0)
등록된 구현이 없습니다.
Tasks
Term ExtractionSimilar Papers 제목 키워드 기반
TermEval 2020: RACAI's automatic term extraction system
This paper describes RACAI{'}s automatic term extraction system, which participated in the TermEval 2020 shared task on English monolingual term extraction. We discuss the system architecture, some of the challenges that…
Term ExtractionTermEval 2020: TALN-LS2N System for Automatic Term Extraction
Automatic terminology extraction is a notoriously difficult task aiming to ease effort demanded to manually identify terms in domain-specific corpora by automatically providing a ranked list of candidate terms. The main …
Term ExtractionTermEval 2020: Using TSR Filtering Method to Improve Automatic Term Extraction
The identification of terms from domain-specific corpora using computational methods is a highly time-consuming task because terms has to be validated by specialists. In order to improve term candidate selection, we have…
POSTerm ExtractionMethods for Recognizing Nested Terms
In this paper, we describe our participation in the RuTermEval competition devoted to extracting nested terms. We apply the Binder model, which was previously successfully applied to the recognition of nested named entit…
Dialogue Evaluationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+6Unsupervised Technical Domain Terms Extraction using Term Extractor
Terminology extraction, also known as term extraction, is a subtask of information extraction. The goal of terminology extraction is to extract relevant words or phrases from a given corpus automatically. This paper focu…
ChunkingTask 2Term Extraction