paper-with-me

Papers

Commonsense Reasoning for Natural Language Processing

2020-07-01 · ACL 2020 6 · Maarten Sap, Vered Shwartz, Antoine Bosselut, Yejin Choi, Dan Roth

Commonsense knowledge, such as knowing that {`}bumping into people annoys them{''} or {`}rain makes the road slippery{''}, helps humans navigate everyday situations seamlessly. Yet, endowing machines with such human-like commonsense reasoning capabilities has remained an elusive goal of artificial intelligence research for decades. In recent years, commonsense knowledge and reasoning have received renewed attention from the natural language processing (NLP) community, yielding exploratory studies in automated commonsense understanding. We organize this tutorial to provide researchers with the critical foundations and recent advances in commonsense representation and reasoning, in the hopes of casting a brighter light on this promising area of future research. In our tutorial, we will (1) outline the various types of commonsense (e.g., physical, social), and (2) discuss techniques to gather and represent commonsense knowledge, while highlighting the challenges specific to this type of knowledge (e.g., reporting bias). We will then (3) discuss the types of commonsense knowledge captured by modern NLP systems (e.g., large pretrained language models), and (4) present ways to measure systems{'} commonsense reasoning abilities. We will finish with (5) a discussion of various ways in which commonsense reasoning can be used to improve performance on NLP tasks, exemplified by an (6) interactive session on integrating commonsense into a downstream task.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Navigate

Similar Papers 제목 키워드 기반

Natural Language Processing with Commonsense Knowledge: A Survey

2021-08-10 · Yubo Xie, Zonghui Liu, Zongyang Ma, Fanyuan Meng 외

Commonsense knowledge is essential for advancing natural language processing (NLP) by enabling models to engage in human-like reasoning, which requires a deeper understanding of context and often involves making inferenc…

Survey

Commonsense Knowledge Reasoning and Generation with Pre-trained Language Models: A Survey

2022-01-28 · Prajjwal Bhargava, Vincent Ng

While commonsense knowledge acquisition and reasoning has traditionally been a core research topic in the knowledge representation and reasoning community, recent years have seen a surge of interest in the natural langua…

Evaluate Confidence Instead of Perplexity for Zero-shot Commonsense Reasoning

2022-08-23 · Letian Peng, Zuchao Li, Hai Zhao

Commonsense reasoning is an appealing topic in natural language processing (NLP) as it plays a fundamental role in supporting the human-like actions of NLP systems. With large-scale language models as the backbone, unsup…

Language ModelingLanguage ModellingQuestion AnsweringUnsupervised Pre-training

It's All in the Heads: Using Attention Heads as a Baseline for Cross-Lingual Transfer in Commonsense Reasoning

2021-06-22 · Alexey Tikhonov, Max Ryabinin

Commonsense reasoning is one of the key problems in natural language processing, but the relative scarcity of labeled data holds back the progress for languages other than English. Pretrained cross-lingual models are a s…

AllCross-Lingual Transfer

Physical Commonsense Reasoning for Lower-Resourced Languages and Dialects: a Study on Basque

2026-02-16 · Jaione Bengoetxea, Itziar Gonzalez-Dios, Rodrigo Agerri arxiv

Physical commonsense reasoning represents a fundamental capability of human intelligence, enabling individuals to understand their environment, predict future events, and navigate physical spaces. Recent years have witne…

Physical Commonsense Reasoning