paper-with-me

Papers

Automatic punctuation restoration with BERT models

2021-01-18 · Attila Nagy, Bence Bial, Judit Ács

We present an approach for automatic punctuation restoration with BERT models for English and Hungarian. For English, we conduct our experiments on Ted Talks, a commonly used benchmark for punctuation restoration, while for Hungarian we evaluate our models on the Szeged Treebank dataset. Our best models achieve a macro-averaged $F_1$-score of 79.8 in English and 82.2 in Hungarian. Our code is publicly available.

📄 PDF Abstract BibTeX arXiv:2101.07343

Code (1)

attilanagy234/neural-punctuator 공식 구현 pytorch

Tasks

Punctuation Restoration

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
WordPiece 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

A Small and Fast BERT for Chinese Medical Punctuation Restoration

2023-08-24 · Tongtao Ling, Yutao Lai, Lei Chen, Shilei Huang 외

In clinical dictation, utterances after automatic speech recognition (ASR) without explicit punctuation marks may lead to the misunderstanding of dictated reports. To give a precise and understandable clinical report wit…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Contrastive LearningPunctuation Restoration+2

PersianPunc: A Large-Scale Dataset and BERT-Based Approach for Persian Punctuation Restoration

2026-03-05 · Mohammad Javad Ranjbar Kalahroodi, Heshaam Faili, Azadeh Shakery arxiv

Punctuation restoration is essential for improving the readability and downstream utility of automatic speech recognition (ASR) outputs, yet remains underexplored for Persian despite its importance. We introduce PersianP…

Speech Recognition

Transformer Based Punctuation Restoration for Turkish

2023-09-15 · 8th International Conference on Computer Science and Engineering (UBMK) 2023 9 · Uygar Kurt, Aykut Çayır

Mobile devices and social media platforms make communication faster than humans have had before, thanks to the technologies such as automatic speech recognition(ASR). However, the speed in text-based communication method…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Punctuation Restorationspeech-recognition+1

indic-punct: An automatic punctuation restoration and inverse text normalization framework for Indic languages

2022-03-31 · Anirudh Gupta, Neeraj Chhimwal, Ankur Dhuriya, Rishabh Gaur 외

Automatic Speech Recognition (ASR) generates text which is most of the times devoid of any punctuation. Absence of punctuation is text can affect readability. Also, down stream NLP tasks such as sentiment analysis, machi…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Machine TranslationPunctuation Restoration+6

Restoring Rhythm: Punctuation Restoration Using Transformer Models for Bangla, A Low-Resource Language

2025-07-24 · Md Obyedullahil Mamun, Md Adyelullahil Mamun, Arif Ahmad, Md. Imran Hossain Emu arxiv

Punctuation restoration enhances the readability of text and is critical for post-processing tasks in Automatic Speech Recognition (ASR), especially for low-resource languages like Bangla. In this study, we explore the a…

Speech RecognitionData Augmentation