paper-with-me

Papers

Learning Household Task Knowledge from WikiHow Descriptions

2019-09-13 · WS 2019 8 · Yilun Zhou, Julie A. Shah, Steven Schockaert

Commonsense procedural knowledge is important for AI agents and robots that operate in a human environment. While previous attempts at constructing procedural knowledge are mostly rule- and template-based, recent advances in deep learning provide the possibility of acquiring such knowledge directly from natural language sources. As a first step in this direction, we propose a model to learn embeddings for tasks, as well as the individual steps that need to be taken to solve them, based on WikiHow articles. We learn these embeddings such that they are predictive of both step relevance and step ordering. We also experiment with the use of integer programming for inferring consistent global step orderings from noisy pairwise predictions.

📄 PDF Abstract BibTeX arXiv:1909.06414

Code (1)

YilunZhou/wikihow-embedding 공식 구현 pytorch

Tasks

Articles

Similar Papers 제목 키워드 기반

Learning to Ground Instructional Articles in Videos through Narrations

2023-06-06 · ICCV 2023 1 · Effrosyni Mavroudi, Triantafyllos Afouras, Lorenzo Torresani

In this paper we present an approach for localizing steps of procedural activities in narrated how-to videos. To deal with the scarcity of labeled data at scale, we source the step descriptions from a language knowledge …

ArticlesVideo Alignment

Show Me More Details: Discovering Hierarchies of Procedures from Semi-structured Web Data

2022-03-14 · ACL 2022 5 · Shuyan Zhou, Li Zhang, Yue Yang, Qing Lyu 외

Procedures are inherently hierarchical. To "make videos", one may need to "purchase a camera", which in turn may require one to "set a budget". While such hierarchical knowledge is critical for reasoning about complex pr…

ArticlesRetrievalVideo Retrieval

MULTISCRIPT: Multimodal Script Learning for Supporting Open Domain Everyday Tasks

2023-10-08 · Jingyuan Qi, Minqian Liu, Ying Shen, Zhiyang Xu 외

Automatically generating scripts (i.e. sequences of key steps described in text) from video demonstrations and reasoning about the subsequent steps are crucial to the modern AI virtual assistants to guide humans to compl…

Script Generation

wikiHowToImprove: A Resource and Analyses on Edits in Instructional Texts

2020-05-01 · LREC 2020 5 · Talita Anthonio, Irshad Bhat, Michael Roth

Instructional texts, such as articles in wikiHow, describe the actions necessary to accomplish a certain goal. In wikiHow and other resources, such instructions are subject to revision edits on a regular basis. Do these …

ArticlesSentence

WikiHow: A Large Scale Text Summarization Dataset

2018-10-18 · Mahnaz Koupaee, William Yang Wang

Sequence-to-sequence models have recently gained the state of the art performance in summarization. However, not too many large-scale high-quality datasets are available and almost all the available ones are mainly news …

ArticlesDiversityText Summarization