홈 › Papers

SemEval-2016 Task 3: Community Question Answering

2019-12-03 · SEMEVAL 2016 6 · Preslav Nakov, Lluís Màrquez, Alessandro Moschitti, Walid Magdy, Hamdy Mubarak, Abed Alhakim Freihat, James Glass, Bilal Randeree

This paper describes the SemEval--2016 Task 3 on Community Question Answering, which we offered in English and Arabic. For English, we had three subtasks: Question--Comment Similarity (subtask A), Question--Question Similarity (B), and Question--External Comment Similarity (C). For Arabic, we had another subtask: Rerank the correct answers for a new question (D). Eighteen teams participated in the task, submitting a total of 95 runs (38 primary and 57 contrastive) for the four subtasks. A variety of approaches and features were used by the participating systems to address the different subtasks, which are summarized in this paper. The best systems achieved an official score (MAP) of 79.19, 76.70, 55.41, and 45.83 in subtasks A, B, C, and D, respectively. These scores are significantly better than those for the baselines that we provided. For subtask A, the best system improved over the 2015 winner by 3 points absolute in terms of Accuracy.

📄 PDF Abstract BibTeX arXiv:1912.01972

Code (0)

등록된 구현이 없습니다.

Tasks

Community Question Answering Question Answering Question Similarity

SwissAlps at SemEval-2017 Task 3: Attention-based Convolutional Neural Network for Community Question Answering

2017-08-01 · SEMEVAL 2017 8 · Jan Milan Deriu, Mark Cieliebak

In this paper we propose a system for reranking answers for a given question. Our method builds on a siamese CNN architecture which is extended by two attention mechanisms. The approach was evaluated on the datasets of t…

Community Question Answering Question Answering Question Similarity Reranking

TueFact at SemEval 2019 Task 8: Fact checking in community question answering forums: context matters

2019-06-01 · SEMEVAL 2019 6 · R{\'e}ka Juh{\'a}sz, Franziska Barbara Linnenschmidt, Teslin Roys

The SemEval 2019 Task 8 on Fact-Checking in community question answering forums aimed to classify questions into categories and verify the correctness of answers given on the QatarLiving public forum. The task was divide…

Community Question Answering Fact Checking Question Answering

SemanticZ at SemEval-2016 Task 3: Ranking Relevant Answers in Community Question Answering Using Semantic Similarity Based on Fine-tuned Word Embeddings

2019-11-20 · SEMEVAL 2016 6 · Todor Mihaylov, Preslav Nakov

We describe our system for finding good answers in a community forum, as defined in SemEval-2016, Task 3 on Community Question Answering. Our approach relies on several semantic similarity features based on fine-tuned wo…

Community Question Answering Question Answering Semantic Similarity Semantic Textual Similarity+1

SUper Team at SemEval-2016 Task 3: Building a feature-rich system for community question answering

2021-09-26 · SemEval (ACL) 2016 6 · Tsvetomila Mihaylova, Pepa Gencheva, Martin Boyanov, Ivana Yovcheva 외

We present the system we built for participating in SemEval-2016 Task 3 on Community Question Answering. We achieved the best results on subtask C, and strong results on subtasks A and B, by combining a rich set of vario…

Community Question Answering Question Answering

EICA Team at SemEval-2017 Task 3: Semantic and Metadata-based Features for Community Question Answering

2017-08-01 · SEMEVAL 2017 8 · Yufei Xie, Maoquan Wang, Jing Ma, Jian Jiang 외

We describe our system for participating in SemEval-2017 Task 3 on Community Question Answering. Our approach relies on combining a rich set of various types of features: semantic and metadata. The most important group t…

Community Question Answering Feature Engineering Question Answering Question Similarity