Skip-Thought Memory Networks
Question Answering (QA) is fundamental to natural language processing in that most nlp problems can be phrased as QA (Kumar et al., 2015). Current weakly supervised memory network models that have been proposed so far struggle at answering questions that involve relations among multiple entities (such as facebook's bAbi qa5-three-arg-relations in (Weston et al., 2015)). To address this problem of learning multi-argument multi-hop semantic relations for the purpose of QA, we propose a method that combines the jointly learned long-term read-write memory and attentive inference components of end-to-end memory networks (MemN2N) (Sukhbaatar et al., 2015) with distributed sentence vector representations encoded by a Skip-Thought model (Kiros et al., 2015). This choice to append Skip-Thought Vectors to the existing MemN2N framework is motivated by the fact that Skip-Thought Vectors have been shown to accurately model multi-argument semantic relations (Kiros et al., 2015).
Code (0)
등록된 구현이 없습니다.
Tasks
Question AnsweringSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Rethinking Skip-thought: A Neighborhood based Approach
We study the skip-thought model with neighborhood information as weak supervision. More specifically, we propose a skip-thought neighbor model to consider the adjacent sentences as a neighborhood. We train our skip-thoug…
General ClassificationTrimming and Improving Skip-thought Vectors
The skip-thought model has been proven to be effective at learning sentence representations and capturing sentence semantics. In this paper, we propose a suite of techniques to trim and improve it. First, we validate a h…
DecoderSentencetext-classificationText ClassificationTakeLab at SemEval-2018 Task12: Argument Reasoning Comprehension with Skip-Thought Vectors
This paper describes our system for the SemEval-2018 Task 12: Argument Reasoning Comprehension Task. We utilize skip-thought vectors, sentence-level distributional vectors inspired by the popular word embeddings and the …
Common Sense ReasoningNatural Language InferenceSentenceWord EmbeddingsSkip-Thought GAN: Generating Text through Adversarial Training using Skip-Thought Vectors
In the past few years, various advancements have been made in generative models owing to the formulation of Generative Adversarial Networks (GANs). GANs have been shown to perform exceedingly well on a wide variety of ta…
Image GenerationSentenceSentence EmbeddingsStyle Transfer+2Modeling performance differences on cognitive tests using LSTMs and skip-thought vectors trained on reported media consumption.
Cognitive tests have traditionally resorted to standardizing testing materials in the name of equality and because of the onerous nature of creating test items. This approach ignores participants{'} diverse language expe…
Semantic SimilaritySemantic Textual Similarity