paper-with-me

홈 › Papers

Syntactic Structure Processing in the Brain while Listening

2023-02-16 · Subba Reddy Oota, Mounika Marreddy, Manish Gupta, Bapi Raju Surampud

Syntactic parsing is the task of assigning a syntactic structure to a sentence. There are two popular syntactic parsing methods: constituency and dependency parsing. Recent works have used syntactic embeddings based on constituency trees, incremental top-down parsing, and other word syntactic features for brain activity prediction given the text stimuli to study how the syntax structure is represented in the brain's language network. However, the effectiveness of dependency parse trees or the relative predictive power of the various syntax parsers across brain areas, especially for the listening task, is yet unexplored. In this study, we investigate the predictive power of the brain encoding models in three settings: (i) individual performance of the constituency and dependency syntactic parsing based embedding methods, (ii) efficacy of these syntactic parsing based embedding methods when controlling for basic syntactic signals, (iii) relative effectiveness of each of the syntactic embedding methods when controlling for the other. Further, we explore the relative importance of syntactic information (from these syntactic embedding methods) versus semantic information using BERT embeddings. We find that constituency parsers help explain activations in the temporal lobe and middle-frontal gyrus, while dependency parsers better encode syntactic structure in the angular gyrus and posterior cingulate cortex. Although semantic signals from BERT are more effective compared to any of the syntactic features or embedding methods, syntactic embedding methods explain additional variance for a few brain regions.

📄 PDF Abstract BibTeX arXiv:2302.08589

Code (0)

등록된 구현이 없습니다.

Tasks

Activity PredictionDependency ParsingSentence

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
WordPiece 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

Information-Restricted Neural Language Models Reveal Different Brain Regions' Sensitivity to Semantics, Syntax and Context

2023-02-28 · Alexandre Pasquiou, Yair Lakretz, Bertrand Thirion, Christophe Pallier

A fundamental question in neurolinguistics concerns the brain regions involved in syntactic and semantic processing during speech comprehension, both at the lexical (word processing) and supra-lexical levels (sentence an…

Language ModelingLanguage ModellingSensitivitySentence

Neural Language Taskonomy: Which NLP Tasks are the most Predictive of fMRI Brain Activity?

2022-05-03 · NAACL 2022 7 · Subba Reddy Oota, Jashn Arora, Veeral Agarwal, Mounika Marreddy 외

Several popular Transformer based language models have been found to be successful for text-driven brain encoding. However, existing literature leverages only pretrained text Transformer models and has not explored the e…

coreference-resolutionCoreference ResolutionNatural Language InferenceNER+2

Syntactic representations in the human brain: beyond effort-based metrics

2021-01-01 · Aniketh Janardhan Reddy, Leila Wehbe

We are far from having a complete mechanistic understanding of the brain computations involved in language processing and of the role that syntax plays in those computations. Most language studies do not computationally…

Sentence

The Role of Syntax During Pronoun Resolution: Evidence from fMRI

2018-07-01 · WS 2018 7 · Jixing Li, Murielle Fabre, Wen-Ming Luh, John Hale

The current study examined the role of syntactic structure during pronoun resolution. We correlated complexity measures derived by the syntax-sensitive Hobbs algorithm and a neural network model for pronoun resolution wi…

Coreference Resolution

Can fMRI reveal the representation of syntactic structure in the brain?

2021-12-01 · NeurIPS 2021 12 · Aniketh Janardhan Reddy, Leila Wehbe

While studying semantics in the brain, neuroscientists use two approaches. One is to identify areas that are correlated with semantic processing load. Another is to find areas that are predicted by the semantic represent…