paper-with-me

홈 › Papers

ANA at SemEval-2020 Task 4: mUlti-task learNIng for cOmmonsense reasoNing (UNION)

2020-06-29 · SEMEVAL 2020 · Anandh Perumal, Chenyang Huang, Amine Trabelsi, Osmar R. Zaïane

In this paper, we describe our mUlti-task learNIng for cOmmonsense reasoNing (UNION) system submitted for Task C of the SemEval2020 Task 4, which is to generate a reason explaining why a given false statement is non-sensical. However, we found in the early experiments that simple adaptations such as fine-tuning GPT2 often yield dull and non-informative generations (e.g. simple negations). In order to generate more meaningful explanations, we propose UNION, a unified end-to-end framework, to utilize several existing commonsense datasets so that it allows a model to learn more dynamics under the scope of commonsense reasoning. In order to perform model selection efficiently, accurately and promptly, we also propose a couple of auxiliary automatic evaluation metrics so that we can extensively compare the models from different perspectives. Our submitted system not only results in a good performance in the proposed metrics but also outperforms its competitors with the highest achieved score of 2.10 for human evaluation while remaining a BLEU score of 15.7. Our code is made publicly available at GitHub.

📄 PDF Abstract BibTeX arXiv:2006.16403

Code (1)

anandhperumal/ANA-at-SemEval-2020-Task-4-UNION 공식 구현 pytorch

Tasks

Model SelectionMulti-Task Learning

Similar Papers 제목 키워드 기반

SWAGex at SemEval-2020 Task 4: Commonsense Explanation as Next Event Prediction

2020-12-01 · SEMEVAL 2020 · Wiem Ben Rim, Naoaki Okazaki

We describe the system submitted by the SWAGex team to the SemEval-2020 Commonsense Validation and Explanation Task. We use multiple methods on the pre-trained language model BERT (Devlin et al., 2018) for tasks that req…

Language ModelingLanguage Modelling

Zero-Shot Commonsense Validation and Reasoning with Large Language Models: An Evaluation on SemEval-2020 Task 4 Dataset

2025-02-19 · Rawand Alfugaha, Mohammad AL-Smadi

This study evaluates the performance of Large Language Models (LLMs) on SemEval-2020 Task 4 dataset, focusing on commonsense validation and explanation. Our methodology involves evaluating multiple LLMs, including LLaMA3…

CUHK at SemEval-2020 Task 4: CommonSense Explanation, Reasoning and Prediction with Multi-task Learning

2020-06-12 · SEMEVAL 2020 · Hongru Wang, Xiangru Tang, Sunny Lai, Kwong Sak Leung 외

This paper describes our system submitted to task 4 of SemEval 2020: Commonsense Validation and Explanation (ComVE) which consists of three sub-tasks. The task is to directly validate the given sentence whether or not it…

Common Sense ReasoningERPMulti-Task LearningSentence

MITRE at SemEval-2018 Task 11: Commonsense Reasoning without Commonsense Knowledge

2018-06-01 · SEMEVAL 2018 6 · Elizabeth Merkhofer, John Henderson, David Bloom, Laura Strickhart 외

This paper describes MITRE{'}s participation in SemEval-2018 Task 11: Machine Comprehension using Commonsense Knowledge. The techniques explored range from simple bag-of-ngrams classifiers to neural architectures with va…

Common Sense ReasoningInformation RetrievalReading Comprehensionregression

ECNU-SenseMaker at SemEval-2020 Task 4: Leveraging Heterogeneous Knowledge Resources for Commonsense Validation and Explanation

2020-07-28 · SEMEVAL 2020 · Qian Zhao, Siyu Tao, Jie zhou, LinLin Wang 외

This paper describes our system for SemEval-2020 Task 4: Commonsense Validation and Explanation (Wang et al., 2020). We propose a novel Knowledge-enhanced Graph Attention Network (KEGAT) architecture for this task, lever…

Data AugmentationGraph Attention