Is preprocessing of text really worth your time for online comment classification?
A large proportion of online comments present on public domains are constructive, however a significant proportion are toxic in nature. The comments contain lot of typos which increases the number of features manifold, making the ML model difficult to train. Considering the fact that the data scientists spend approximately 80% of their time in collecting, cleaning and organizing their data [1], we explored how much effort should we invest in the preprocessing (transformation) of raw comments before feeding it to the state-of-the-art classification models. With the help of four models on Jigsaw toxic comment classification data, we demonstrated that the training of model without any transformation produce relatively decent model. Applying even basic transformations, in some cases, lead to worse performance and should be applied with caution.
Code (1)
Tasks
General ClassificationToxic Comment ClassificationSimilar Papers 제목 키워드 기반
We Built a Fake News / Click Bait Filter: What Happened Next Will Blow Your Mind!
It is completely amazing! Fake news and {``}click baits{''} have totally invaded the cyberspace. Let us face it: everybody hates them for three simple reasons. Reason {\#}2 will absolutely amaze you. What these can achie…
Author ProfilingClickbait DetectionWord EmbeddingsWe Built a Fake News & Click-bait Filter: What Happened Next Will Blow Your Mind!
It is completely amazing! Fake news and click-baits have totally invaded the cyber space. Let us face it: everybody hates them for three simple reasons. Reason #2 will absolutely amaze you. What these can achieve at the …
Author ProfilingThe Milieu, Science & Logic of Feedback Control
'The cardinal sin in control is to believe that the plant is given' Karl Astrom. Astrom, a towering figure of control theory and practice and awardee of the 1993 IEEE Medal of Honor for his work on adaptive control, prov…
Omni-R1: Do You Really Need Audio to Fine-Tune Your Audio LLM?
We propose Omni-R1 which fine-tunes a recent multi-modal LLM, Qwen2.5-Omni, on an audio question answering dataset with the reinforcement learning method GRPO. This leads to new State-of-the-Art performance on the recent…
Audio Question AnsweringQuestion AnsweringIs syntax structure modeling worth? Leveraging pattern-driven modeling to enable affordable sentiment dependency learning
Is structure information modeling really worth in Aspect-based sentiment classification (ABSC)? Recent popular works tend to exploit syntactic information guiding sentiment dependency parsing, i.e., structure-based senti…
Dependency ParsingSentiment AnalysisSentiment ClassificationSentiment Dependency Learning