Construction and Evaluation of a Self-Attention Model for Semantic Understanding of Sentence-Final Particles
Sentence-final particles serve an essential role in spoken Japanese because they express the speaker's mental attitudes toward a proposition and/or an interlocutor. They are acquired at early ages and occur very frequently in everyday conversation. However, there has been little proposal for a computational model of acquiring sentence-final particles. This paper proposes Subjective BERT, a self-attention model that takes various subjective senses in addition to language and images as input and learns the relationship between words and subjective senses. An evaluation experiment revealed that the model understands the usage of "yo", which expresses the speaker's intention to communicate new information, and that of "ne", which denotes the speaker's desire to confirm that some information is shared.
Code (0)
등록된 구현이 없습니다.
Tasks
SentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Knowledge Graph Guided Semantic Evaluation of Language Models For User Trust
A fundamental question in natural language processing is - what kind of language structure and semantics is the language model capturing? Graph formats such as knowledge graphs are easy to evaluate as they explicitly exp…
Knowledge GraphsLanguage ModellingAttention-Guided Multi-Scale Local Reconstruction for Point Clouds via Masked Autoencoder Self-Supervised Learning
Self-supervised learning has emerged as a prominent research direction in point cloud processing. While existing models predominantly concentrate on reconstruction tasks at higher encoder layers, they often neglect the e…
Self-Supervised LearningScene SegmentationPoint CloudsStudying the Effects of Self-Attention for Medical Image Analysis
When the trained physician interprets medical images, they understand the clinical importance of visual features. By applying cognitive attention, they apply greater focus onto clinically relevant regions while disregard…
Medical Image AnalysisAdversarial Self-Attention for Language Understanding
Deep neural models (e.g. Transformer) naturally learn spurious features, which create a ``shortcut'' between the labels and inputs, thus impairing the generalization and robustness. This paper advances the self-attention…
Machine Reading ComprehensionNamed Entity Recognition (NER)Natural Language InferenceParaphrase Identification+3Free Lunch for Surgical Video Understanding by Distilling Self-Supervisions
Self-supervised learning has witnessed great progress in vision and NLP; recently, it also attracted much attention to various medical imaging modalities such as X-ray, CT, and MRI. Existing methods mostly focus on build…
Contrastive LearningSelf-Supervised LearningSurgical phase recognitionVideo Understanding