Modeling Hierarchical Syntactic Structures in Morphological Processing
Sentences are represented as hierarchical syntactic structures, which have been successfully modeled in sentence processing. In contrast, despite the theoretical agreement on hierarchical syntactic structures within words, words have been argued to be computationally less complex than sentences and implemented by finite-state models as linear strings of morphemes, and even the psychological reality of morphemes has been denied. In this paper, extending the computational models employed in sentence processing to morphological processing, we performed a computational simulation experiment where, given incremental surprisal as a linking hypothesis, five computational models with different representational assumptions were evaluated against human reaction times in visual lexical decision experiments available from the English Lexicon Project (ELP), a {`}shared task{''} in the morphological processing literature. The simulation experiment demonstrated that (i) {}amorphous{''} models without morpheme units underperformed relative to {}morphous{''} models, (ii) a computational model with hierarchical syntactic structures, Probabilistic Context-Free Grammar (PCFG), most accurately explained human reaction times, and (iii) this performance was achieved on top of surface frequency effects. These results strongly suggest that morphological processing tracks morphemes incrementally from left to right and parses them into hierarchical syntactic structures, contrary to {`}amorphous{''} and finite-state models of morphological processing.
Code (0)
등록된 구현이 없습니다.
Tasks
SentenceSimilar Papers 제목 키워드 기반
Hierarchical Word Structure-based Parsing: A Feasibility Study on UD-style Dependency Parsing in Japanese
In applying word-based dependency parsing such as Universal Dependencies (UD) to Japanese, the uncertainty of word segmentation emerges for defining a word unit of the dependencies. We introduce the following hierarchica…
ChunkingDependency ParsingMorphological AnalysisSentenceRecursive Tree Attention: Improving Semantic Representations with Syntactic Tree Structured Attention Mechanism
Attention mechanism has shown its effectiveness in state-of-the-art methods on various tasks in natural language processing (NLP). However, these methods are still using attention mechanism in plain, linear topological s…
Constituency ParsingRepresentation LearningSentencetext-classification+1Modeling Syntactic and Semantic Structures in Hierarchical Phrase-based Translation
A type-theoretical reduction of morphological, syntactic and semantic compositionality to a single level of description
The paper presents NLC, a new formalism for modeling natural language (NL) compositionality. NLC is a functional type system (i.e. one based on mathematical functions and their types). Its main features include a close c…
Evaluating Transformer-Based Multilingual Text Classification
As NLP tools become ubiquitous in today's technological landscape, they are increasingly applied to languages with a variety of typological structures. However, NLP research does not focus primarily on typological differ…
ClassificationGeneral ClassificationLanguage ModelingLanguage Modelling+4