Japanese Lexical Complexity for Non-Native Readers: A New Dataset
Lexical complexity prediction (LCP) is the task of predicting the complexity of words in a text on a continuous scale. It plays a vital role in simplifying or annotating complex words to assist readers. To study lexical complexity in Japanese, we construct the first Japanese LCP dataset. Our dataset provides separate complexity scores for Chinese/Korean annotators and others to address the readers' L1-specific needs. In the baseline experiment, we demonstrate the effectiveness of a BERT-based system for Japanese LCP.
Code (2)
Tasks
Lexical Complexity PredictionSimilar Papers 제목 키워드 기반
Word Complexity is in the Eye of the Beholder
Lexical complexity is a highly subjective notion, yet this factor is often neglected in lexical simplification and readability systems which use a {''}one-size-fits-all{''} approach. In this paper, we investigate which a…
Lexical SimplificationDetecting Multiword Expression Type Helps Lexical Complexity Assessment
Multiword expressions (MWEs) represent lexemes that should be treated as single lexical units due to their idiosyncratic nature. Multiple NLP applications have been shown to benefit from MWE identification, however the r…
Complex Word IdentificationText SimplificationVocal Bursts Type PredictionWord Complexity Estimation for Japanese Lexical Simplification
We introduce three language resources for Japanese lexical simplification: 1) a large-scale word complexity lexicon, 2) the first synonym lexicon for converting complex words to simpler ones, and 3) the first toolkit for…
BenchmarkingLexical SimplificationDifficult for Whom? A Study of Japanese Lexical Complexity
The tasks of lexical complexity prediction (LCP) and complex word identification (CWI) commonly presuppose that difficult to understand words are shared by the target population. Meanwhile, personalization methods have a…
Complex Word IdentificationLexical Complexity PredictionJapanese Lexical Simplification for Non-Native Speakers
This paper introduces Japanese lexical simplification. Japanese lexical simplification is the task of replacing difficult words in a given sentence to produce a new sentence with simple words without changing the origina…
Embeddings EvaluationLanguage ModelingLanguage ModellingLexical Simplification+5