Talking about the world with a distributed model
We use language to talk about the world, and so reference is a crucial property of language. However, modeling reference is particularly difficult, as it involves both continuous and discrete as-pects of language. For instance, referring expressions like {`}the big mug{''} or {}it{''} typically contain content words ({}big{''}, {}mug{''}), which are notoriously fuzzy or vague in their meaning, and also fun-ction words ({}the{''}, {`}it{''}) that largely serve as discrete pointers. Data-driven, distributed models based on distributional semantics or deep learning excel at the former, but struggle with the latter, and the reverse is true for symbolic models. I present ongoing work on modeling reference with a distribu-ted model aimed at capturing both aspects, and learns to refer directly from reference acts.
Code (0)
등록된 구현이 없습니다.
Tasks
modelText GenerationSimilar Papers 제목 키워드 기반
Talking about other people: an endless range of possibilities
Image description datasets, such as Flickr30K and MS COCO, show a high degree of variation in the ways that crowd-workers talk about the world. Although this gives us a rich and diverse collection of data to work with, i…
Image DescriptionText GenerationAudio-driven Talking Face Video Generation with Learning-based Personalized Head Pose
Real-world talking faces often accompany with natural head movement. However, most existing talking face video generation methods only consider facial animation with fixed head pose. In this paper, we address this proble…
3D Face AnimationVideo GenerationConstructive Interaction for Talking about Interesting Topics
The paper discusses mechanisms for topic management in conversations, concentrating on interactions where the interlocutors react to each other's presentation of new information and construct a shared context in which to…
ManagementSpeech RecognitionSpeech SynthesisWorld KnowledgeStill "Talking About Large Language Models": Some Clarifications
My paper "Talking About Large Language Models" has more than once been interpreted as advocating a reductionist stance towards large language models. But the paper was not intended that way, and I do not endorse such pos…