CogALex-V Shared Task: GHHH - Detecting Semantic Relations via Word Embeddings
This paper describes our system submission to the CogALex-2016 Shared Task on Corpus-Based Identification of Semantic Relations. Our system won first place for Task-1 and second place for Task-2. The evaluation results of our system on the test set is 88.1{\%} (79.0{\%} for TRUE only) f-measure for Task-1 on detecting semantic similarity, and 76.0{\%} (42.3{\%} when excluding RANDOM) for Task-2 on identifying finer-grained semantic relations. In our experiments, we try word analogy, linear regression, and multi-task Convolutional Neural Networks (CNNs) with word embeddings from publicly available word vectors. We found that linear regression performs better in the binary classification (Task-1), while CNNs have better performance in the multi-class semantic classification (Task-2). We assume that word analogy is more suited for deterministic answers rather than handling the ambiguity of one-to-many and many-to-many relationships. We also show that classifier performance could benefit from balancing the distribution of labels in the training data.
Code (0)
등록된 구현이 없습니다.
Tasks
Binary ClassificationGeneral ClassificationInformation RetrievalKnowledge GraphsregressionSemantic SimilaritySemantic Textual SimilarityTask 2Word EmbeddingsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
The CogALex-V Shared Task on the Corpus-Based Identification of Semantic Relations
The shared task of the 5th Workshop on Cognitive Aspects of the Lexicon (CogALex-V) aims at providing a common benchmark for testing current corpus-based methods for the identification of lexical semantic relations (syno…
Language AcquisitionParaphrase GenerationCogALex-V Shared Task: CGSRC - Classifying Semantic Relations using Convolutional Neural Networks
In this paper, we describe a system (CGSRC) for classifying four semantic relations: synonym, hypernym, antonym and meronym using convolutional neural networks (CNN). We have participated in CogALex-V semantic shared tas…
Machine TranslationParaphrase GenerationQuestion AnsweringRelation+2CogALex-V Shared Task: Mach5 -- A traditional DSM approach to semantic relatedness
This contribution provides a strong baseline result for the CogALex-V shared task using a traditional {``}count{''}-type DSM (placed in rank 2 out of 7 in subtask 1 and rank 3 out of 6 in subtask 2). Parameter tuning exp…
CogALex-V Shared Task: ROOT18
In this paper, we describe ROOT 18, a classifier using the scores of several unsupervised distributional measures as features to discriminate between semantically related and unrelated words, and then to classify the rel…
CogALex-VI Shared Task: Bidirectional Transformer based Identification of Semantic Relations
This paper presents a bidirectional transformer based approach for recognising semantic relationships between a pair of words as proposed by CogALex VI shared task in 2020. The system presented here works by employing BE…