Explicit Contextual Semantics for Text Comprehension
Who did what to whom is a major focus in natural language understanding, which is right the aim of semantic role labeling (SRL) task. Despite of sharing a lot of processing characteristics and even task purpose, it is surprisingly that jointly considering these two related tasks was never formally reported in previous work. Thus this paper makes the first attempt to let SRL enhance text comprehension and inference through specifying verbal predicates and their corresponding semantic roles. In terms of deep learning models, our embeddings are enhanced by explicit contextual semantic role labels for more fine-grained semantics. We show that the salient labels can be conveniently added to existing models and significantly improve deep learning models in challenging text comprehension tasks. Extensive experiments on benchmark machine reading comprehension and inference datasets verify that the proposed semantic learning helps our system reach new state-of-the-art over strong baselines which have been enhanced by well pretrained language models from the latest progress.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine Reading ComprehensionNatural Language UnderstandingReading ComprehensionSemantic Role LabelingSimilar Papers 제목 키워드 기반
Semantics-Aware Inferential Network for Natural Language Understanding
For natural language understanding tasks, either machine reading comprehension or natural language inference, both semantics-aware and inference are favorable features of the concerned modeling for better understanding p…
Machine Reading ComprehensionNatural Language InferenceNatural Language UnderstandingReading ComprehensionSemantics-aware BERT for Language Understanding
The latest work on language representations carefully integrates contextualized features into language model training, which enables a series of success especially in various machine reading comprehension and natural lan…
Language ModelingLanguage ModellingMachine Reading ComprehensionNatural Language Inference+5Probing CLIP's Comprehension of 360-Degree Textual and Visual Semantics
The dream of instantly creating rich 360-degree panoramic worlds from text is rapidly becoming a reality, yet a crucial gap exists in our ability to reliably evaluate their semantic alignment. Contrastive Language-Image …
Integrating Semantic Information into Sketchy Reading Module of Retro-Reader for Vietnamese Machine Reading Comprehension
Machine Reading Comprehension has become one of the most advanced and popular research topics in the fields of Natural Language Processing in recent years. The classification of answerability questions is a relatively si…
Machine Reading ComprehensionReading ComprehensionVietnamese Machine Reading ComprehensionXLM-RIncorporating Syntax and Frame Semantics in Neural Network for Machine Reading Comprehension
Machine reading comprehension (MRC) is one of the most critical yet challenging tasks in natural language understanding(NLU), where both syntax and semantics information of text are essential components for text understa…
Machine Reading ComprehensionNatural Language UnderstandingReading Comprehension