Contextual Similarity is More Valuable than Character Similarity: An Empirical Study for Chinese Spell Checking
Chinese Spell Checking (CSC) task aims to detect and correct Chinese spelling errors. Recently, related researches focus on introducing character similarity from confusion set to enhance the CSC models, ignoring the context of characters that contain richer information. To make better use of contextual information, we propose a simple yet effective Curriculum Learning (CL) framework for the CSC task. With the help of our model-agnostic CL framework, existing CSC models will be trained from easy to difficult as humans learn Chinese characters and achieve further performance improvements. Extensive experiments and detailed analyses on widely used SIGHAN datasets show that our method outperforms previous state-of-the-art methods. More instructively, our study empirically suggests that contextual similarity is more valuable than character similarity for the CSC task.
Code (0)
등록된 구현이 없습니다.
Tasks
Chinese Spell CheckingSimilar Papers 제목 키워드 기반
CAST: Corpus-Aware Self-similarity Enhanced Topic modelling
Topic modelling is a pivotal unsupervised machine learning technique for extracting valuable insights from large document collections. Existing neural topic modelling methods often encode contextual information of docume…
Contrastive LearningDiversityWord EmbeddingsFrequency-based Distortions in Contextualized Word Embeddings
How does word frequency in pre-training data affect the behavior of similarity metrics in contextualized BERT embeddings? Are there systematic ways in which some word relationships are exaggerated or understated? In this…
Semantic SimilaritySemantic Textual SimilarityWord EmbeddingsExploiting Semantic Role Contextualized Video Features for Multi-Instance Text-Video Retrieval EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge 2022
In this report, we present our approach for EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge 2022. We first parse sentences into semantic roles corresponding to verbs and nouns; then utilize self-attentions to exploi…
Multi-Instance RetrievalRetrievalSemantic SimilaritySemantic Textual Similarity+2Contextual Visual Similarity
Measuring visual similarity is critical for image understanding. But what makes two images similar? Most existing work on visual similarity assumes that images are similar because they contain the same object instance or…
AttributeImage RetrievalImage Similarity SearchEpiSAM: Character Segmentation in Challenging Stone Inscriptions
Stone inscriptions are invaluable sources of historical and linguistic knowledge, yet their automated analysis remains a major challenge due to surface irregularities, erosion, and low visual contrast. Conventional docum…
Zero-shot Generalization