Benchmarking Aggression Identification in Social Media
In this paper, we present the report and findings of the Shared Task on Aggression Identification organised as part of the First Workshop on Trolling, Aggression and Cyberbullying (TRAC - 1) at COLING 2018. The task was to develop a classifier that could discriminate between Overtly Aggressive, Covertly Aggressive, and Non-aggressive texts. For this task, the participants were provided with a dataset of 15,000 aggression-annotated Facebook Posts and Comments each in Hindi (in both Roman and Devanagari script) and English for training and validation. For testing, two different sets - one from Facebook and another from a different social media - were provided. A total of 130 teams registered to participate in the task, 30 teams submitted their test runs, and finally 20 teams also sent their system description paper which are included in the TRAC workshop proceedings. The best system obtained a weighted F-score of 0.64 for both Hindi and English on the Facebook test sets, while the best scores on the surprise set were 0.60 and 0.50 for English and Hindi respectively. The results presented in this report depict how challenging the task is. The positive response from the community and the great levels of participation in the first edition of this shared task also highlights the interest in this topic.
Code (0)
등록된 구현이 없습니다.
Tasks
Aggression IdentificationBenchmarkingSimilar Papers 제목 키워드 기반
RiTUAL-UH at TRAC 2018 Shared Task: Aggression Identification
This paper presents our system for "TRAC 2018 Shared Task on Aggression Identification". Our best systems for the English dataset use a combination of lexical and semantic features. However, for Hindi data using only lex…
Aggression IdentificationTRAC-1 Shared Task on Aggression Identification: IIT(ISM)@COLING'18
This paper describes the work that our team bhanodaig did at Indian Institute of Technology (ISM) towards TRAC-1 Shared Task on Aggression Identification in Social Media for COLING 2018. In this paper we label aggression…
Aggression IdentificationTransfer LearningWord EmbeddingsAn Ensemble Approach for Aggression Identification in English and Hindi Text
This paper describes our system submitted in the shared task at COLING 2018 TRAC-1: Aggression Identification. The objective of this task was to predict online aggression spread through online textual post or comment. Th…
Aggression IdentificationFully Connected Neural Network with Advance Preprocessor to Identify Aggression over Facebook and Twitter
Paper presents the different methodologies developed {\&} tested and discusses their results, with the goal of identifying the best possible method for the aggression identification problem in social media.
Aggression IdentificationHate Speech DetectionLanguage IdentificationText ClassificationEvaluating Aggression Identification in Social Media
In this paper, we present the report and findings of the Shared Task on Aggression and Gendered Aggression Identification organised as part of the Second Workshop on Trolling, Aggression and Cyberbullying (TRAC - 2) at L…
Aggression Identification