paper-with-me

Papers

Modeling Bilingual Sentence Processing: Evaluating RNN and Transformer Architectures for Cross-Language Structural Priming

2024-05-15 · Demi Zhang, Bushi Xiao, Chao GAO, Sangpil Youm, Bonnie J Dorr

This study evaluates the performance of Recurrent Neural Network (RNN) and Transformer models in replicating cross-language structural priming, a key indicator of abstract grammatical representations in human language processing. Focusing on Chinese-English priming, which involves two typologically distinct languages, we examine how these models handle the robust phenomenon of structural priming, where exposure to a particular sentence structure increases the likelihood of selecting a similar structure subsequently. Our findings indicate that transformers outperform RNNs in generating primed sentence structures, with accuracy rates that exceed 25.84\% to 33. 33\%. This challenges the conventional belief that human sentence processing primarily involves recurrent and immediate processing and suggests a role for cue-based retrieval mechanisms. This work contributes to our understanding of how computational models may reflect human cognitive processes across diverse language families.

📄 PDF Abstract BibTeX arXiv:2405.09508

Code (0)

등록된 구현이 없습니다.

Tasks

RetrievalSentence

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Position-Wise Feed-Forward Layer 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Bilingual Autoencoders with Global Descriptors for Modeling Parallel Sentences

2016-12-01 · COLING 2016 12 · Biao Zhang, Deyi Xiong, Jinsong Su, Hong Duan 외

Parallel sentence representations are important for bilingual and cross-lingual tasks in natural language processing. In this paper, we explore a bilingual autoencoder approach to model parallel sentences. We extract sen…

Information RetrievalMachine TranslationSentenceTranslation+1

Fast Bilingual Grapheme-To-Phoneme Conversion

2022-07-01 · NAACL (ACL) 2022 7 · Hwa-Yeon Kim, Jong-Hwan Kim, Jae-Min Kim

Autoregressive transformer (ART)-based grapheme-to-phoneme (G2P) models have been proposed for bi/multilingual text-to-speech systems. Although they have achieved great success, they suffer from high inference latency in…

Data AugmentationGrapheme-to-Phoneme ConversionSentencetext-to-speech+1

Bilingual Subword Segmentation for Neural Machine Translation

2020-12-01 · COLING 2020 8 · Hiroyuki Deguchi, Masao Utiyama, Akihiro Tamura, Takashi Ninomiya 외

This paper proposed a new subword segmentation method for neural machine translation, {``}Bilingual Subword Segmentation,{''} which tokenizes sentences to minimize the difference between the number of subword units in a …

Machine TranslationSegmentationSentenceTranslation

Multilingual Corpus Creation for Multilingual Semantic Similarity Task

2020-05-01 · LREC 2020 5 · Mahtab Ahmed, Chahna Dixit, Robert E. Mercer, Atif Khan 외

In natural language processing, the performance of a semantic similarity task relies heavily on the availability of a large corpus. Various monolingual corpora are available (mainly English); but multilingual resources a…

Semantic SimilaritySemantic Textual SimilaritySentence

Parallel Sentence Compression

2016-12-01 · COLING 2016 12 · Julia Ive, Fran{\c{c}}ois Yvon

Sentence compression is a way to perform text simplification and is usually handled in a monolingual setting. In this paper, we study ways to extend sentence compression in a bilingual context, where the goal is to obtai…

ArticlesMachine TranslationSemantic Role LabelingSentence+2