paper-with-me

Papers

Asking the Right Question: Inferring Advice-Seeking Intentions from Personal Narratives

2019-04-02 · NAACL 2019 6 · Liye Fu, Jonathan P. Chang, Cristian Danescu-Niculescu-Mizil

People often share personal narratives in order to seek advice from others. To properly infer the narrator's intention, one needs to apply a certain degree of common sense and social intuition. To test the capabilities of NLP systems to recover such intuition, we introduce the new task of inferring what is the advice-seeking goal behind a personal narrative. We formulate this as a cloze test, where the goal is to identify which of two advice-seeking questions was removed from a given narrative. The main challenge in constructing this task is finding pairs of semantically plausible advice-seeking questions for given narratives. To address this challenge, we devise a method that exploits commonalities in experiences people share online to automatically extract pairs of questions that are appropriate candidates for the cloze task. This results in a dataset of over 20,000 personal narratives, each matched with a pair of related advice-seeking questions: one actually intended by the narrator, and the other one not. The dataset covers a very broad array of human experiences, from dating, to career options, to stolen iPads. We use human annotation to determine the degree to which the task relies on common sense and social intuition in addition to a semantic understanding of the narrative. By introducing several baselines for this new task we demonstrate its feasibility and identify avenues for better modeling the intention of the narrator.

📄 PDF Abstract BibTeX arXiv:1904.01587

Code (1)

CornellNLP/ASQ 공식 구현

Tasks

Cloze TestCommon Sense Reasoning

Similar Papers 제목 키워드 기반

Help! Need Advice on Identifying Advice

2020-10-06 · EMNLP 2020 11 · Venkata Subrahmanyan Govindarajan, Benjamin T Chen, Rebecca Warholic, Katrin Erk 외

Humans use language to accomplish a wide variety of tasks - asking for and giving advice being one of them. In online advice forums, advice is mixed in with non-advice, like emotional support, and is sometimes stated exp…

Text Generation

AdvisorQA: Towards Helpful and Harmless Advice-seeking Question Answering with Collective Intelligence

2024-04-18 · Minbeom Kim, Hwanhee Lee, Joonsuk Park, Hwaran Lee 외

As the integration of large language models into daily life is on the rise, there is a clear gap in benchmarks for advising on subjective and personal dilemmas. To address this, we introduce AdvisorQA, the first benchmar…

Question Answering

Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification Questions

2024-02-09 · Alberto Testoni, Raquel Fernández

Clarification questions are an essential dialogue tool to signal misunderstanding, ambiguities, and under-specification in language use. While humans are able to resolve uncertainty by asking questions since childhood, m…

What's to know? Uncertainty as a Guide to Asking Goal-oriented Questions

2018-12-16 · CVPR 2019 6 · Ehsan Abbasnejad, Qi Wu, Javen Shi, Anton Van Den Hengel

One of the core challenges in Visual Dialogue problems is asking the question that will provide the most useful information towards achieving the required objective. Encouraging an agent to ask the right questions is dif…

Visual Dialog

When AI Gives Advice: Evaluating AI and Human Responses to Online Advice-Seeking for Well-Being

2025-10-24 · Harsh Kumar, Jasmine Chahal, Yinuo Zhao, Zeling Zhang 외 arxiv

Seeking advice is a core human behavior that the internet has reinvented twice: first through forums and Q&A communities that crowdsource public guidance, and now through large language models (LLMs). Yet the quality of …