Exploring Semantic Incrementality with Dynamic Syntax and Vector Space Semantics
One of the fundamental requirements for models of semantic processing in dialogue is incrementality: a model must reflect how people interpret and generate language at least on a word-by-word basis, and handle phenomena such as fragments, incomplete and jointly-produced utterances. We show that the incremental word-by-word parsing process of Dynamic Syntax (DS) can be assigned a compositional distributional semantics, with the composition operator of DS corresponding to the general operation of tensor contraction from multilinear algebra. We provide abstract semantic decorations for the nodes of DS trees, in terms of vectors, tensors, and sums thereof; using the latter to model the underspecified elements crucial to assigning partial representations during incremental processing. As a working example, we give an instantiation of this theory using plausibility tensors of compositional distributional semantics, and show how our framework can incrementally assign a semantic plausibility measure as it parses phrases and sentences.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Bypass Network for Semantics Driven Image Paragraph Captioning
Image paragraph captioning aims to describe a given image with a sequence of coherent sentences. Most existing methods model the coherence through the topic transition that dynamically infers a topic vector from precedin…
Image Paragraph CaptioningSentenceContext-Aware Smoothing for Neural Machine Translation
In Neural Machine Translation (NMT), each word is represented as a low-dimension, real-value vector for encoding its syntax and semantic information. This means that even if the word is in a different sentence context, i…
Machine TranslationNMTRepresentation LearningSentence+1A Unified Syntax-aware Framework for Semantic Role Labeling
Semantic role labeling (SRL) aims to recognize the predicate-argument structure of a sentence. Syntactic information has been paid a great attention over the role of enhancing SRL. However, the latest advance shows that …
Machine TranslationQuestion AnsweringSemantic Role LabelingSentenceIncrementality Bidding via Reinforcement Learning under Mixed and Delayed Rewards
Incrementality, which is used to measure the causal effect of showing an ad to a potential customer (e.g. a user in an internet platform) versus not, is a central object for advertisers in online advertising platforms. T…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Semantics- and Syntax-related Subvectors in the Skip-gram Embeddings
We show that the skip-gram embedding of any word can be decomposed into two subvectors which roughly correspond to semantic and syntactic roles of the word.