A Simple and Effective Approach to the Story Cloze Test
In the Story Cloze Test, a system is presented with a 4-sentence prompt to a story, and must determine which one of two potential endings is the 'right' ending to the story. Previous work has shown that ignoring the training set and training a model on the validation set can achieve high accuracy on this task due to stylistic differences between the story endings in the training set and validation and test sets. Following this approach, we present a simpler fully-neural approach to the Story Cloze Test using skip-thought embeddings of the stories in a feed-forward network that achieves close to state-of-the-art performance on this task without any feature engineering. We also find that considering just the last sentence of the prompt instead of the whole prompt yields higher accuracy with our approach.
Code (0)
등록된 구현이 없습니다.
Tasks
Cloze TestFeature EngineeringQuestion AnsweringSentenceSimilar Papers 제목 키워드 기반
LSDSem 2017 Shared Task: The Story Cloze Test
The LSDSem{'}17 shared task is the Story Cloze Test, a new evaluation for story understanding and script learning. This test provides a system with a four-sentence story and two possible endings, and the system must choo…
Cloze TestReading ComprehensionSentenceThe Effect of Different Writing Tasks on Linguistic Style: A Case Study of the ROC Story Cloze Task
A writer's style depends not just on personal traits but also on her intent and mental state. In this paper, we show how variants of the same writing task can lead to measurable differences in writing style. We present a…
Language ModelingLanguage ModellingAn RNN-based Binary Classifier for the Story Cloze Test
The Story Cloze Test consists of choosing a sentence that best completes a story given two choices. In this paper we present a system that performs this task using a supervised binary classifier on top of a recurrent neu…
Cloze TestSentenceWord EmbeddingsLSDSem 2017: Exploring Data Generation Methods for the Story Cloze Test
The Story Cloze test is a recent effort in providing a common test scenario for text understanding systems. As part of the LSDSem 2017 shared task, we present a system based on a deep learning architecture combined with …
Cloze TestIIT (BHU): System Description for LSDSem'17 Shared Task
This paper describes an ensemble system submitted as part of the LSDSem Shared Task 2017 - the Story Cloze Test. The main conclusion from our results is that an approach based on semantic similarity alone may not be enou…
Cloze TestCommon Sense ReasoningregressionSemantic Similarity+1