The CogALex-V Shared Task on the Corpus-Based Identification of Semantic Relations

2016-12-01 · WS 2016 12 · Enrico Santus, Anna Gladkova, Stefan Evert, Aless Lenci, ro

The shared task of the 5th Workshop on Cognitive Aspects of the Lexicon (CogALex-V) aims at providing a common benchmark for testing current corpus-based methods for the identification of lexical semantic relations (synonymy, antonymy, hypernymy, part-whole meronymy) and at gaining a better understanding of their respective strengths and weaknesses. The shared task uses a challenging dataset extracted from EVALution 1.0, which contains word pairs holding the above-mentioned relations as well as semantically unrelated control items (random). The task is split into two subtasks: (i) identification of related word pairs vs. unrelated ones; (ii) classification of the word pairs according to their semantic relation. This paper describes the subtasks, the dataset, the evaluation metrics, the seven participating systems and their results. The best performing system in subtask 1 is GHHH (F1 = 0.790), while the best system in subtask 2 is LexNet (F1 = 0.445). The dataset and the task description are available at \url{https://sites.google.com/site/cogalex2016/home/shared-task}.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Language Acquisition Paraphrase Generation

CogALex-V Shared Task: CGSRC - Classifying Semantic Relations using Convolutional Neural Networks

2016-12-01 · WS 2016 12 · Chinnappa Guggilla

In this paper, we describe a system (CGSRC) for classifying four semantic relations: synonym, hypernym, antonym and meronym using convolutional neural networks (CNN). We have participated in CogALex-V semantic shared tas…

Machine Translation Paraphrase Generation Question Answering Relation+2

CogALex-V Shared Task: LexNET - Integrated Path-based and Distributional Method for the Identification of Semantic Relations

2016-10-27 · WS 2016 12 · Vered Shwartz, Ido Dagan

We present a submission to the CogALex 2016 shared task on the corpus-based identification of semantic relations, using LexNET (Shwartz and Dagan, 2016), an integrated path-based and distributional method for semantic re…

Classification General Classification Relation Relation Classification

CogALex-V Shared Task: GHHH - Detecting Semantic Relations via Word Embeddings

2016-12-01 · WS 2016 12 · Mohammed Attia, Suraj Maharjan, Younes Samih, Laura Kallmeyer 외

This paper describes our system submission to the CogALex-2016 Shared Task on Corpus-Based Identification of Semantic Relations. Our system won first place for Task-1 and second place for Task-2. The evaluation results o…

Binary Classification General Classification Information Retrieval Knowledge Graphs+5

CogALex-VI Shared Task: Bidirectional Transformer based Identification of Semantic Relations

2020-12-01 · COLING (CogALex) 2020 12 · Saurav Karmakar, John P. McCrae

This paper presents a bidirectional transformer based approach for recognising semantic relationships between a pair of words as proposed by CogALex VI shared task in 2020. The system presented here works by employing BE…

The CogALex Shared Task on Monolingual and Multilingual Identification of Semantic Relations

2020-12-01 · COLING (CogALex) 2020 12 · Rong Xiang, Emmanuele Chersoni, Luca Iacoponi, Enrico Santus

The shared task of the CogALex-VI workshop focuses on the monolingual and multilingual identification of semantic relations. We provided training and validation data for the following languages: English, German and Chine…

Relation