TOCP: A Dataset for Chinese Profanity Processing
This paper introduced TOCP, a larger dataset of Chinese profanity. This dataset contains natural sentences collected from social media sites, the profane expressions appearing in the sentences, and their rephrasing suggestions which preserve their meanings in a less offensive way. We proposed several baseline systems using neural network models to test this benchmark. We trained embedding models on a profanity-related dataset and proposed several profanity-related features. Our baseline systems achieved an F1-score of 86.37{\%} in profanity detection and an accuracy of 77.32{\%} in profanity rephrasing.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Rephrasing Profanity in Chinese Text
This paper proposes a system that can detect and rephrase profanity in Chinese text. Rather than just masking detected profanity, we want to revise the input sentence by using inoffensive words while keeping their origin…
SentenceAutoCP: Automated Pipelines for Accurate Prediction Intervals
Successful application of machine learning models to real-world prediction problems, e.g. financial forecasting and personalized medicine, has proved to be challenging, because such settings require limiting and quantify…
AutoMLBIG-bench Machine LearningConformal PredictionPrediction+3Slice Sampling for Probabilistic Programming
We introduce the first, general purpose, slice sampling inference engine for probabilistic programs. This engine is released as part of StocPy, a new Turing-Complete probabilistic programming language, available as a Pyt…
Probabilistic ProgrammingregressionA Comparison of Machine Learning Techniques for Turkish Profanity Detection
Profanity detection became an important task with the increase of social media usage. Most of the users prefer a clean and profanity free environment to communicate with others. In order to provide a such environment for…
Facilitating Fine-grained Detection of Chinese Toxic Language: Hierarchical Taxonomy, Resources, and Benchmarks
The widespread dissemination of toxic online posts is increasingly damaging to society. However, research on detecting toxic language in Chinese has lagged significantly. Existing datasets lack fine-grained annotation of…
Hate Speech Detection