Rethinking News Text Classification from a Timeliness Perspective under the Pre-training and Fine-tuning Paradigm
Pre-trained language models (PLMs) have made significant progress in NLP. News text classification is one of the most fundamental tasks in NLP, and various existing works have shown that fine-tuned on PLMs could score up to the accuracy of 98% on the target task. It seems that this task has been well-addressed. However, we discover that news timeliness can cause a massive impact on the news text classification, which drops nearly 20% points from the initial results. In this paper, we define timeliness issues in news classification and design the experiment to measure the influence. Moreover, we investigate several methods to recognize and replace obsolete vocabularies. However, the results show that it is difficult to eliminate the impact of news timeliness from the words' perspective. In addition, we propose a set of large-scale, time-sensitive news datasets to facilitate the study of this problem.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationNews Classificationtext-classificationText ClassificationSimilar Papers 제목 키워드 기반
Exploiting User Comments for Early Detection of Fake News Prior to Users' Commenting
Both accuracy and timeliness are key factors in detecting fake news on social media. However, most existing methods encounter an accuracy-timeliness dilemma: Content-only methods guarantee timeliness but perform moderate…
Fake News DetectionOptimizing News Text Classification with Bi-LSTM and Attention Mechanism for Efficient Data Processing
The development of Internet technology has led to a rapid increase in news information. Filtering out valuable content from complex information has become an urgentproblem that needs to be solved. In view of the shortcom…
Classificationtext-classificationText ClassificationNewswire versus Social Media for Disaster Response and Recovery
In a disaster situation, first responders need to quickly acquire situational awareness and prioritize response based on the need, resources available and impact. Can they do this based on digital media such as Twitter a…
ArticlesDisaster ResponseKGAP: Knowledge Graph Augmented Political Perspective Detection in News Media
Identifying political perspectives in news media has become an important task due to the rapid growth of political commentary and the increasingly polarized political ideologies. Previous approaches focus on textual cont…
Argument MiningKnowledge GraphsHong Kong: Longitudinal and Synchronic Characterisations of Protest News between 1998 and 2020
This paper showcases the utility and timeliness of the Hong Kong Protest News Dataset, a highly curated collection of news articles from diverse news sources, to investigate longitudinal and synchronic news characterisat…
Articles