Advancing NLP with Cognitive Language Processing Signals
When we read, our brain processes language and generates cognitive processing data such as gaze patterns and brain activity. These signals can be recorded while reading. Cognitive language processing data such as eye-tracking features have shown improvements on single NLP tasks. We analyze whether using such human features can show consistent improvement across tasks and data sources. We present an extensive investigation of the benefits and limitations of using cognitive processing data for NLP. Specifically, we use gaze and EEG features to augment models of named entity recognition, relation classification, and sentiment analysis. These methods significantly outperform the baselines and show the potential and current limitations of employing human language processing data for NLP.
Code (3)
Tasks
EEGElectroencephalogram (EEG)General Classificationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Relation ClassificationSentiment AnalysisSimilar Papers 제목 키워드 기반
Towards Best Practices for Leveraging Human Language Processing Signals for Natural Language Processing
NLP models are imperfect and lack intricate capabilities that humans access automatically when processing speech or reading a text. Human language processing data can be leveraged to increase the performance of models an…
EEGElectroencephalogram (EEG)CogAlign: Learning to Align Textual Neural Representations to Cognitive Language Processing Signals
Most previous studies integrate cognitive language processing signals (e.g., eye-tracking or EEG data) into neural models of natural language processing (NLP) just by directly concatenating word embeddings with cognitive…
EEGElectroencephalogram (EEG)named-entity-recognitionNamed Entity Recognition+4Bridging between Cognitive Processing Signals and Linguistic Features via a Unified Attentional Network
Cognitive processing signals can be used to improve natural language processing (NLP) tasks. However, it is not clear how these signals correlate with linguistic information. Bridging between human language processing an…
SentenceDo Large Language Models Mirror Cognitive Language Processing?
Large Language Models (LLMs) have demonstrated remarkable abilities in text comprehension and logical reasoning, indicating that the text representations learned by LLMs can facilitate their language processing capabilit…
ChatbotLogical ReasoningMMLUReading ComprehensionBridging Auditory Perception and Language Comprehension through MEG-Driven Encoding Models
Understanding the neural mechanisms behind auditory and linguistic processing is key to advancing cognitive neuroscience. In this study, we use Magnetoencephalography (MEG) data to analyze brain responses to spoken langu…