indic-punct: An automatic punctuation restoration and inverse text normalization framework for Indic languages
Automatic Speech Recognition (ASR) generates text which is most of the times devoid of any punctuation. Absence of punctuation is text can affect readability. Also, down stream NLP tasks such as sentiment analysis, machine translation, greatly benefit by having punctuation and sentence boundary information. We present an approach for automatic punctuation of text using a pretrained IndicBERT model. Inverse text normalization is done by hand writing weighted finite state transducer (WFST) grammars. We have developed this tool for 11 Indic languages namely Hindi, Tamil, Telugu, Kannada, Gujarati, Marathi, Odia, Bengali, Assamese, Malayalam and Punjabi. All code and data is publicly. available
Code (1)
Tasks
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Machine TranslationPunctuation RestorationSentenceSentiment Analysisspeech-recognitionSpeech RecognitionText NormalizationTranslationSimilar Papers 제목 키워드 기반
Resolving Transcription Ambiguity in Spanish: A Hybrid Acoustic-Lexical System for Punctuation Restoration
Punctuation restoration is a crucial step after Automatic Speech Recognition (ASR) systems to enhance transcript readability and facilitate subsequent NLP tasks. Nevertheless, conventional lexical-based approaches are in…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modelling+4A Small and Fast BERT for Chinese Medical Punctuation Restoration
In clinical dictation, utterances after automatic speech recognition (ASR) without explicit punctuation marks may lead to the misunderstanding of dictated reports. To give a precise and understandable clinical report wit…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Contrastive LearningPunctuation Restoration+2Automatic punctuation restoration with BERT models
We present an approach for automatic punctuation restoration with BERT models for English and Hungarian. For English, we conduct our experiments on Ted Talks, a commonly used benchmark for punctuation restoration, while …
Punctuation RestorationToken-Level Supervised Contrastive Learning for Punctuation Restoration
Punctuation is critical in understanding natural language text. Currently, most automatic speech recognition (ASR) systems do not generate punctuation, which affects the performance of downstream tasks, such as intent de…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Contrastive LearningIntent Detection+5Transformer Based Punctuation Restoration for Turkish
Mobile devices and social media platforms make communication faster than humans have had before, thanks to the technologies such as automatic speech recognition(ASR). However, the speed in text-based communication method…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Punctuation Restorationspeech-recognition+1