Modeling Bilingual Sentence Processing: Evaluating RNN and Transformer Architectures for Cross-Language Structural Priming
This study evaluates the performance of Recurrent Neural Network (RNN) and Transformer models in replicating cross-language structural priming, a key indicator of abstract grammatical representations in human language processing. Focusing on Chinese-English priming, which involves two typologically distinct languages, we examine how these models handle the robust phenomenon of structural priming, where exposure to a particular sentence structure increases the likelihood of selecting a similar structure subsequently. Our findings indicate that transformers outperform RNNs in generating primed sentence structures, with accuracy rates that exceed 25.84\% to 33. 33\%. This challenges the conventional belief that human sentence processing primarily involves recurrent and immediate processing and suggests a role for cue-based retrieval mechanisms. This work contributes to our understanding of how computational models may reflect human cognitive processes across diverse language families.
Code (0)
등록된 구현이 없습니다.
Tasks
RetrievalSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Bilingual Autoencoders with Global Descriptors for Modeling Parallel Sentences
Parallel sentence representations are important for bilingual and cross-lingual tasks in natural language processing. In this paper, we explore a bilingual autoencoder approach to model parallel sentences. We extract sen…
Information RetrievalMachine TranslationSentenceTranslation+1Fast Bilingual Grapheme-To-Phoneme Conversion
Autoregressive transformer (ART)-based grapheme-to-phoneme (G2P) models have been proposed for bi/multilingual text-to-speech systems. Although they have achieved great success, they suffer from high inference latency in…
Data AugmentationGrapheme-to-Phoneme ConversionSentencetext-to-speech+1Bilingual Subword Segmentation for Neural Machine Translation
This paper proposed a new subword segmentation method for neural machine translation, {``}Bilingual Subword Segmentation,{''} which tokenizes sentences to minimize the difference between the number of subword units in a …
Machine TranslationSegmentationSentenceTranslationMultilingual Corpus Creation for Multilingual Semantic Similarity Task
In natural language processing, the performance of a semantic similarity task relies heavily on the availability of a large corpus. Various monolingual corpora are available (mainly English); but multilingual resources a…
Semantic SimilaritySemantic Textual SimilaritySentenceParallel Sentence Compression
Sentence compression is a way to perform text simplification and is usually handled in a monolingual setting. In this paper, we study ways to extend sentence compression in a bilingual context, where the goal is to obtai…
ArticlesMachine TranslationSemantic Role LabelingSentence+2