paper-with-me

홈 › Papers

CoAM: Corpus of All-Type Multiword Expressions

2024-12-24 · Yusuke Ide, Joshua Tanner, Adam Nohejl, Jacob Hoffman, Justin Vasselli, Hidetaka Kamigaito, Taro Watanabe

Multiword expressions (MWEs) refer to idiomatic sequences of multiple words. MWE identification, i.e., detecting MWEs in text, can play a key role in downstream tasks such as machine translation. Existing datasets for MWE identification are inconsistently annotated, limited to a single type of MWE, or limited in size. To enable reliable and comprehensive evaluation, we created CoAM: Corpus of All-Type Multiword Expressions, a dataset of 1.3K sentences constructed through a multi-step process to enhance data quality consisting of human annotation, human review, and automated consistency checking. MWEs in CoAM are tagged with MWE types, such as Noun and Verb, to enable fine-grained error analysis. Annotations for CoAM were collected using a new interface created with our interface generator, which allows easy and flexible annotation of MWEs in any form, including discontinuous ones. Through experiments using CoAM, we find that a fine-tuned large language model outperforms the current state-of-the-art approach for MWE identification. Furthermore, analysis using our MWE type tagged data reveals that Verb MWEs are easier than Noun MWEs to identify across approaches.

📄 PDF Abstract BibTeX arXiv:2412.18151

Code (0)

등록된 구현이 없습니다.

Tasks

AllLanguage ModelingLanguage ModellingLarge Language ModelMachine Translation

Similar Papers 제목 키워드 기반

The Romanian Corpus Annotated with Verbal Multiword Expressions

2019-08-01 · WS 2019 8 · Verginica Barbu Mititelu, Mihaela Cristescu, Mihaela Onofrei

This paper reports on the Romanian journalistic corpus annotated with verbal multiword expressions following the PARSEME guidelines. The corpus is sentence split, tokenized, part-of-speech tagged, lemmatized, syntactical…

DiversitySentence

Comprehensive Annotation of Multiword Expressions in a Social Web Corpus

2014-05-01 · LREC 2014 5 · Nathan Schneider, Spencer Onuffer, Nora Kazour, Emily Danchik 외

Multiword expressions (MWEs) are quite frequent in languages such as English, but their diversity, the scarcity of individual MWE types, and contextual ambiguity have presented obstacles to corpus-based studies and NLP s…

DiversityLanguage AcquisitionMachine TranslationSentence

A Romanian Treebank Annotated with Verbal Multiword Expressions

2022-09-01 · CLIB 2022 9 · Verginica Barbu Mititelu, Mihaela Cristescu, Maria Mitrofan, Bianca-Mădălina Zgreabăn 외

In this paper we present a new version of the Romanian journalistic treebank annotated with verbal multiword expressions of four types: idioms, light verb constructions, reflexive verbs and inherently adpositional verbs,…

Multilingual Multiword Expressions

2016-12-01 · Lahari Poddar

The project aims to provide a semi-supervised approach to identify Multiword Expressions in a multilingual context consisting of English and most of the major Indian languages. Multiword expressions are a group of words …

POS

Development of Hybrid Algorithm for Automatic Extraction of Multiword Expressions from Monolingual and Parallel Corpus of English and Punjabi

2020-12-01 · ICON 2020 12 · Kapil Dev Goyal, Vishal Goyal

Identification and extraction of Multiword Expressions (MWEs) is very hard and challenging task in various Natural Language processing applications like Information Retrieval (IR), Information Extraction (IE), Question-A…

Information RetrievalMachine TranslationQuestion AnsweringRetrieval+4