SemEval-2017 Task 3: Community Question Answering
We describe SemEval-2017 Task 3 on Community Question Answering. This year, we reran the four subtasks from SemEval-2016:(A) Question-Comment Similarity,(B) Question-Question Similarity,(C) Question-External Comment Similarity, and (D) Rerank the correct answers for a new question in Arabic, providing all the data from 2015 and 2016 for training, and fresh data for testing. Additionally, we added a new subtask E in order to enable experimentation with Multi-domain Question Duplicate Detection in a larger-scale scenario, using StackExchange subforums. A total of 23 teams participated in the task, and submitted a total of 85 runs (36 primary and 49 contrastive) for subtasks A-D. Unfortunately, no teams participated in subtask E. A variety of approaches and features were used by the participating systems to address the different subtasks. The best systems achieved an official score (MAP) of 88.43, 47.22, 15.46, and 61.16 in subtasks A, B, C, and D, respectively. These scores are better than the baselines, especially for subtasks A-C.
Code (1)
Tasks
Community Question AnsweringQuestion AnsweringQuestion SimilaritySimilar Papers 제목 키워드 기반
SwissAlps at SemEval-2017 Task 3: Attention-based Convolutional Neural Network for Community Question Answering
In this paper we propose a system for reranking answers for a given question. Our method builds on a siamese CNN architecture which is extended by two attention mechanisms. The approach was evaluated on the datasets of t…
Community Question AnsweringQuestion AnsweringQuestion SimilarityRerankingTueFact at SemEval 2019 Task 8: Fact checking in community question answering forums: context matters
The SemEval 2019 Task 8 on Fact-Checking in community question answering forums aimed to classify questions into categories and verify the correctness of answers given on the QatarLiving public forum. The task was divide…
Community Question AnsweringFact CheckingQuestion AnsweringSemanticZ at SemEval-2016 Task 3: Ranking Relevant Answers in Community Question Answering Using Semantic Similarity Based on Fine-tuned Word Embeddings
We describe our system for finding good answers in a community forum, as defined in SemEval-2016, Task 3 on Community Question Answering. Our approach relies on several semantic similarity features based on fine-tuned wo…
Community Question AnsweringQuestion AnsweringSemantic SimilaritySemantic Textual Similarity+1SUper Team at SemEval-2016 Task 3: Building a feature-rich system for community question answering
We present the system we built for participating in SemEval-2016 Task 3 on Community Question Answering. We achieved the best results on subtask C, and strong results on subtasks A and B, by combining a rich set of vario…
Community Question AnsweringQuestion AnsweringEICA Team at SemEval-2017 Task 3: Semantic and Metadata-based Features for Community Question Answering
We describe our system for participating in SemEval-2017 Task 3 on Community Question Answering. Our approach relies on combining a rich set of various types of features: semantic and metadata. The most important group t…
Community Question AnsweringFeature EngineeringQuestion AnsweringQuestion Similarity