Relation Classification with Cognitive Attention Supervision
Many current language models such as BERT utilize attention mechanisms to transform sequence representations. We ask whether we can influence BERT’s attention with human reading patterns by using eye-tracking and brain imaging data. We fine-tune BERT for relation extraction with auxiliary attention supervision in which BERT’s attention weights are supervised by cognitive data. Through a variety of metrics we find that this attention supervision can be used to increase similarity between model attention distributions over sequences and the cognitive data without significantly affecting classification performance while making unique errors from the baseline. In particular, models with cognitive attention supervision more often correctly classified samples misclassified by the baseline.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationRelationRelation ClassificationRelation ExtractionSimilar Papers 제목 키워드 기반
ARNOR: Attention Regularization based Noise Reduction for Distant Supervision Relation Classification
Distant supervision is widely used in relation classification in order to create large-scale training data by aligning a knowledge base with an unlabeled corpus. However, it also introduces amounts of noisy labels where …
ClassificationGeneral ClassificationRelationRelation Classification+1Learning to Look: Cognitive Attention Alignment with Vision-Language Models
Convolutional Neural Networks (CNNs) frequently "cheat" by exploiting superficial correlations, raising concerns about whether they make predictions for the right reasons. Inspired by cognitive science, which highlights …
Beyond Single-Source Cognitive Taskonomy:Multi-Source Task Relations through fMRI Transfer Learning
Cognitive tasks are organized by shared and specialized neural processes. Masked fMRI reconstruction provides a common self-supervised objective for quantifying transfer relations among task states, but existing reconstr…
Transfer LearningCognitive Alignment At No Cost: Inducing Human Attention Biases For Interpretable Vision Transformers
For state-of-the-art image understanding, Vision Transformers (ViTs) have become the standard architecture but their processing diverges substantially from human attentional characteristics. We investigate whether this c…
SLIP: Structural-aware Language-Image Pretraining for Vision-Language Alignment
Vision-Language Pretraining (VLP) has achieved remarkable success across various downstream tasks, but such gains are largely driven by scaling up on training data. Yet, literature methods treat image-text pairs as isola…
Cross-Modal Retrieval