Correcting the Autocorrect: Context-Aware Typographical Error Correction via Training Data Augmentation
In this paper, we explore the artificial generation of typographical errors based on real-world statistics. We first draw on a small set of annotated data to compute spelling error statistics. These are then invoked to introduce errors into substantially larger corpora. The generation methodology allows us to generate particularly challenging errors that require context-aware error detection. We use it to create a set of English language error detection and correction datasets. Finally, we examine the effectiveness of machine learning models for detecting and correcting errors based on this data. The datasets are available at http://typo.nlproc.org
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningData AugmentationSimilar Papers 제목 키워드 기반
Toward autocorrection of chemical process flowsheets using large language models
The process engineering domain widely uses Process Flow Diagrams (PFDs) and Process and Instrumentation Diagrams (P&IDs) to represent process flows and equipment configurations. However, the P&IDs and PFDs, hereafter cal…
Chemical ProcessMedAutoCorrect: Image-Conditioned Autocorrection in Medical Reporting
In medical reporting, the accuracy of radiological reports, whether generated by humans or machine learning algorithms, is critical. We tackle a new task in this paper: image-conditioned autocorrection of inaccuracies wi…
Similarity-Based Unsupervised Spelling Correction Using BioWordVec: Development and Usability Study of Bacterial Culture and Antimicrobial Susceptibility Reports
Background: Existing bacterial culture test results for infectious diseases are written in unrefined text, resulting in many problems, including typographical errors and stop words. Effective spelling correction process…
Cultural Vocal Bursts Intensity PredictionSpelling CorrectionAutocorrection of arabic common errors for large text corpus
Rule-based autocorrection of Piping and Instrumentation Diagrams (P&IDs) on graphs
A piping and instrumentation diagram (P&ID) is a central reference document in chemical process engineering. Currently, chemical engineers manually review P&IDs through visual inspection to find and rectify errors. Howev…
Chemical Process