Looking inside Noun Compounds: Unsupervised Prepositional and Free Paraphrasing
A noun compound is a sequence of contiguous nouns that acts as a single noun, although the predicate denoting the semantic relation between its components is dropped. Noun Compound Interpretation is the task of uncovering the relation, in the form of a preposition or a free paraphrase. Prepositional paraphrasing refers to the use of preposition to explain the semantic relation, whereas free paraphrasing refers to invoking an appropriate predicate denoting the semantic relation. In this paper, we propose an unsupervised methodology for these two types of paraphrasing. We use pre-trained contextualized language models to uncover the {`}missing{'} words (preposition or predicate). These language models are usually trained to uncover the missing word/words in a given input sentence. Our approach uses templates to prepare the input sequence for the language model. The template uses a special token to indicate the missing predicate. As the model has already been pre-trained to uncover a missing word (or a sequence of words), we exploit it to predict missing words for the input sequence. Our experiments using four datasets show that our unsupervised approach (a) performs comparably to supervised approaches for prepositional paraphrasing, and (b) outperforms supervised approaches for free paraphrasing. Paraphrasing (prepositional or free) using our unsupervised approach is potentially helpful for NLP tasks like machine translation and information extraction.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModellingMachine TranslationRelationSentenceSimilar Papers 제목 키워드 기반
Treat us like the sequences we are: Prepositional Paraphrasing of Noun Compounds using LSTM
Interpreting noun compounds is a challenging task. It involves uncovering the underlying predicate which is dropped in the formation of the compound. In most cases, this predicate is of the form VERB+PREP. It has been ob…
Machine TranslationQuestion AnsweringUsing the Web as an Implicit Training Set: Application to Noun Compound Syntax and Semantics
An important characteristic of English written text is the abundance of noun compounds - sequences of nouns acting as a single noun, e.g., colon cancer tumor suppressor protein. While eventually mastered by domain expert…
Information RetrievalMachine TranslationPrepositional Phrase AttachmentQuestion Answering+2How to Tell a Schneemann from a Milchmann: An Annotation Scheme for Compound-Internal Relations
This paper presents a language-independent annotation scheme for the semantic relations that link the constituents of noun-noun compounds, such as Schneemann {`}snow man{'} or Milchmann {`}milk man{'}. The annotation sch…
Information RetrievalMachine TranslationText GenerationParaphrasing Compound Nominalizations
A nominalization uses a deverbal noun to describe an event associated with its underlying verb. Commonly found in academic and formal texts, nominalizations can be difficult to interpret because of ambiguous semantic rel…
Language ModelingLanguage ModellingNatural Language InferenceVideo In Sentences Out
We present a system that produces sentential descriptions of video: who did what to whom, and where and how they did it. Action class is rendered as a verb, participant objects as noun phrases, properties of those object…