Specificity measures and reference
In this paper we study empirically the validity of measures of referential success for referring expressions involving gradual properties. More specifically, we study the ability of several measures of referential success to predict the success of a user in choosing the right object, given a referring expression. Experimental results indicate that certain fuzzy measures of success are able to predict human accuracy in reference resolution. Such measures are therefore suitable for the estimation of the success or otherwise of a referring expression produced by a generation algorithm, especially in case the properties in a domain cannot be assumed to have crisp denotations.
Code (0)
등록된 구현이 없습니다.
Tasks
Referring ExpressionSpecificitySimilar Papers 제목 키워드 기반
Limits on Inferring T-cell Specificity from Partial Information
A key challenge in molecular biology is to decipher the mapping of protein sequence to function. To perform this mapping requires the identification of sequence features most informative about function. Here, we quantify…
SpecificityGranuscore: A Reference-Free Measure of Granularity for Text Analysis and Question Answering
Natural language conveys information at varying levels of granularity, from fine-grained references to broad descriptions. While granularity is fundamental to human communication, existing measures mostly capture surface…
Question AnsweringConsistent Response Generation with Controlled Specificity
We propose a method to control the specificity of responses while maintaining the consistency with the utterances. We first design a metric based on pointwise mutual information, which measures the co-occurrence degree b…
Response GenerationSpecificityReasoning on Multi-Relational Contextual Hierarchies via Answer Set Programming with Algebraic Measures
Dealing with context dependent knowledge has led to different formalizations of the notion of context. Among them is the Contextualized Knowledge Repository (CKR) framework, which is rooted in description logics but link…
SpecificityLinguistically-Informed Specificity and Semantic Plausibility for Dialogue Generation
Sequence-to-sequence models for open-domain dialogue generation tend to favor generic, uninformative responses. Past work has focused on word frequency-based approaches to improving specificity, such as penalizing respon…
Dialogue GenerationInformativenessRerankingSpecificity