Annotating and analyzing the interactions between meaning relations
Pairs of sentences, phrases, or other text pieces can hold semantic relations such as paraphrasing, textual entailment, contradiction, specificity, and semantic similarity. These relations are usually studied in isolation and no dataset exists where they can be compared empirically. Here we present a corpus annotated with these relations and the analysis of these results. The corpus contains 520 sentence pairs, annotated with these relations. We measure the annotation reliability of each individual relation and we examine their interactions and correlations. Among the unexpected results revealed by our analysis is that the traditionally considered direct relationship between paraphrasing and bi-directional entailment does not hold in our data.
Code (1)
Tasks
Natural Language InferenceSemantic SimilaritySemantic Textual SimilaritySentenceSpecificitySimilar Papers 제목 키워드 기반
Annotation of anaphoric relations and topic continuity in Japanese conversation
This paper proposes a basic scheme for annotating anaphoric relations in Japanese conversations. More specifically, we propose methods of (i) dividing discourse segments into meaningful units, (ii) identifying zero prono…
Annotating and Analyzing Semantic Role of Elementary Units and Relations in Online Persuasive Arguments
For analyzing online persuasions, one of the important goals is to semantically understand how people construct comments to persuade others. However, analyzing the semantic role of arguments for online persuasion has bee…
The BECauSE Corpus 2.0: Annotating Causality and Overlapping Relations
Language of cause and effect captures an essential component of the semantics of a text. However, causal language is also intertwined with other semantic relations, such as temporal precedence and correlation. This makes…
Decision MakingJaMIE: A Pipeline Japanese Medical Information Extraction System with Novel Relation Annotation
In the field of Japanese medical information extraction, few analyzing tools are available and relation extraction is still an under-explored topic. In this paper, we first propose a novel relation annotation schema for …
RelationRelation ExtractionBuilding Dataset for Grounding of Formulae — Annotating Coreference Relations Among Math Identifiers
Grounding the meaning of each symbol in math formulae is important for automated understanding of scientific documents. Generally speaking, the meanings of math symbols are not necessarily constant, and the same symbol i…
Math