paper-with-me

홈 › Papers

The Role of Common Ground for Referential Expressions in Social Dialogues

2022-10-01 · COLING (CRAC) 2022 10 · Jaap Kruijt, Piek Vossen

In this paper, we frame the problem of co-reference resolution in dialogue as a dynamic social process in which mentions to people previously known and newly introduced are mixed when people know each other well. We restructured an existing data set for the Friends sitcom as a coreference task that evolves over time, where close friends make reference to other people either part of their common ground (inner circle) or not (outer circle). We expect that awareness of common ground is key in social dialogue in order to resolve references to the inner social circle, whereas local contextual information plays a more important role for outer circle mentions. Our analysis of these references confirms that there are differences in naming and introducing these people. We also experimented with the SpanBERT coreference system with and without fine-tuning to measure whether preceding discourse contexts matter for resolving inner and outer circle mentions. Our results show that more inner circle mentions lead to a decrease in model performance, and that fine-tuning on preceding contexts reduces false negatives for both inner and outer circle mentions but increases the false positives as well, showing that the models overfit on these contexts.

📄 PDF Abstract BibTeX

Code (1)

cltl/inner-outer-coreference 공식 구현

Similar Papers 제목 키워드 기반

Modeling Relationships in Referential Expressions with Compositional Modular Networks

2016-11-30 · CVPR 2017 7 · Ronghang Hu, Marcus Rohrbach, Jacob Andreas, Trevor Darrell 외

People often refer to entities in an image in terms of their relationships with other entities. For example, "the black cat sitting under the table" refers to both a "black cat" entity and its relationship with another "…

Visual Question Answering (VQA)

Deriving continous grounded meaning representations from referentially structured multimodal contexts

2017-09-01 · EMNLP 2017 9 · Sina Zarrie{\ss}, David Schlangen

Corpora of referring expressions paired with their visual referents are a good source for learning word meanings directly grounded in visual representations. Here, we explore additional ways of extracting from them word …

AttributeWord Embeddings

LVLMs and Humans Ground Differently in Referential Communication

2026-01-27 · Peter Zeng, Weiling Li, Amie J. Paige, Zhengxiang Wang 외 arxiv

For generative AI agents to partner effectively with human users, the ability to accurately predict human intent is critical. But this ability to collaborate remains limited by a critical deficit: an inability to model c…

Collecting Visually-Grounded Dialogue with A Game Of Sorts

2023-09-10 · LREC 2022 6 · Bram Willemsen, Dmytro Kalpakchi, Gabriel Skantze

An idealized, though simplistic, view of the referring expression production and grounding process in (situated) dialogue assumes that a speaker must merely appropriately specify their expression so that the target refer…

Coreference ResolutionImage RetrievalReferring ExpressionReferring Expression Comprehension+4

Where Norms and References Collide: Evaluating LLMs on Normative Reasoning

2026-02-03 · Mitchell Abrams, Kaveh Eskandari Miandoab, Felix Gervits, Vasanth Sarathy 외 arxiv

Embodied agents, such as robots, will need to interact in situated environments where successful communication often depends on reasoning over social norms: shared expectations that constrain what actions are appropriate…