A Case Study of In-House Competition for Ranking Constructive Comments in a News Service
Ranking the user comments posted on a news article is important for online news services because comment visibility directly affects the user experience. Research on ranking comments with different metrics to measure the comment quality has shown “constructiveness” used in argument analysis is promising from a practical standpoint. In this paper, we report a case study in which this constructiveness is examined in the real world. Specifically, we examine an in-house competition to improve the performance of ranking constructive comments and demonstrate the effectiveness of the best obtained model for a commercial service.
Code (0)
등록된 구현이 없습니다.
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Ranking Robustness Under Adversarial Document Manipulations
For many queries in the Web retrieval setting there is an on-going ranking competition: authors manipulate their documents so as to promote them in rankings. Such competitions can have unwarranted effects not only in ter…
Learning-To-RankRetrievalConstructive Conflict-Driven Multi-Agent Reinforcement Learning for Strategic Diversity
In recent years, diversity has emerged as a useful mechanism to enhance the efficiency of multi-agent reinforcement learning (MARL). However, existing methods predominantly focus on designing policies based on individual…
Multi-agent Reinforcement LearningBilevel OptimizationReligious Competition, Culture and Domestic Violence: Evidence from Colombia
This paper studies how religious competition, as measured by the emergence of religious organizations with innovative worship styles and cultural practices, impacts domestic violence. Using data from Colombia, the study …
Dataset Creation for Ranking Constructive News Comments
Ranking comments on an online news service is a practically important task for the service provider, and thus there have been many studies on this task. However, most of them considered users{'} positive feedback, such a…
ArticlesA Meta-Analysis of Overfitting in Machine Learning
We conduct the first large meta-analysis of overfitting due to test set reuse in the machine learning community. Our analysis is based on over one hundred machine learning competitions hosted on the Kaggle platform over …
BIG-bench Machine LearningHoldout Set