Evaluation of automatic collocation extraction methods for language learning
A number of methods have been proposed to automatically extract collocations, i.e., conventionalized lexical combinations, from text corpora. However, the attempts to evaluate and compare them with a specific application in mind lag behind. This paper compares three end-to-end resources for collocation learning, all of which used the same corpus but different methods. Adopting a gold-standard evaluation method, the results show that the method of dependency parsing outperforms regex-over-pos in collocation identification. The lexical association measures (AMs) used for collocation ranking perform about the same overall but differently for individual collocation types. Further analysis has also revealed that there are considerable differences between other commonly used AMs.
Code (1)
Tasks
Dependency ParsingPOSSimilar Papers 제목 키워드 기반
Evaluation of automatic collocation extraction methods for language learning
A number of methods have been proposed to automatically extract collocations, i.e., conventionalized lexical combinations, from text corpora. However, the attempts to evaluate and compare them with a specific application…
Dependency ParsingPOSAutomatic detection of unexpected/erroneous collocations in learner corpus
This research investigates the collocational errors made by English learners in a learner corpus. It focuses on the extraction of unexpected collocations. A system was proposed and implemented with open source toolkit. F…
Using bilingual word-embeddings for multilingual collocation extraction
This paper presents a new strategy for multilingual collocation extraction which takes advantage of parallel corpora to learn bilingual word-embeddings. Monolingual collocation candidates are retrieved using Universal De…
Machine TranslationTranslationWord EmbeddingsA comparison of statistical association measures for identifying dependency-based collocations in various languages.
This paper presents an exploration of different statistical association measures to automatically identify collocations from corpora in English, Portuguese, and Spanish. To evaluate the impact of the association metrics …
ICE: Idiom and Collocation Extractor for Research and Education
Collocation and idiom extraction are well-known challenges with many potential applications in Natural Language Processing (NLP). Our experimental, open-source software system, called ICE, is a python package for flexibl…
POSQuestion Answering