paper-with-me

홈 › Papers

Simplified Abugidas

2018-07-01 · ACL 2018 7 · Chenchen Ding, Masao Utiyama, Eiichiro Sumita

An abugida is a writing system where the consonant letters represent syllables with a default vowel and other vowels are denoted by diacritics. We investigate the feasibility of recovering the original text written in an abugida after omitting subordinate diacritics and merging consonant letters with similar phonetic values. This is crucial for developing more efficient input methods by reducing the complexity in abugidas. Four abugidas in the southern Brahmic family, i.e., Thai, Burmese, Khmer, and Lao, were studied using a newswire 20,000-sentence dataset. We compared the recovery performance of a support vector machine and an LSTM-based recurrent neural network, finding that the abugida graphemes could be recovered with 94{\%} - 97{\%} accuracy at the top-1 level and 98{\%} - 99{\%} at the top-4 level, even after omitting most diacritics (10 - 30 types) and merging the remaining 30 - 50 characters into 21 graphemes.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Sentence

Similar Papers 제목 키워드 기반

TSCheater: Generating High-Quality Tibetan Adversarial Texts via Visual Similarity

2024-12-03 · Xi Cao, Quzong Gesang, Yuan Sun, Nuo Qun 외

Language models based on deep neural networks are vulnerable to textual adversarial attacks. While rich-resource languages like English are receiving focused attention, Tibetan, a cross-border language, is gradually bein…

Adversarial RobustnessAdversarial TextSemantic SimilaritySemantic Textual Similarity+1

An Attempt to Develop a Neural Parser based on Simplified Head-Driven Phrase Structure Grammar on Vietnamese

2024-11-26 · Duc-Vu Nguyen, Thang Chau Phan, Quoc-Nam Nguyen, Kiet Van Nguyen 외

In this paper, we aimed to develop a neural parser for Vietnamese based on simplified Head-Driven Phrase Structure Grammar (HPSG). The existing corpora, VietTreebank and VnDT, had around 15% of constituency and dependenc…

ARCConstituency ParsingDependency ParsingPOS

A Multilingual Simplified Language News Corpus

2022-06-01 · READI (LREC) 2022 6 · Renate Hauser, Jannis Vamvas, Sarah Ebling, Martin Volk

Simplified language news articles are being offered by specialized web portals in several countries. The thousands of articles that have been published over the years are a valuable resource for natural language processi…

ArticlesText Simplification

Simplified Analysis on Filtering Sensitivity Trade-offs in Continuous- and Discrete-Time Systems

2022-04-08 · Neng Wan, Dapeng Li, Lin Song, Naira Hovakimyan

A simplified analysis is performed on the Bode-type filtering sensitivity trade-off integrals, which capture the sensitivity characteristics of the estimate and estimation error with respect to the process input and esti…

Sensitivity

Interpretability Illusions in the Generalization of Simplified Models

2023-12-06 · Dan Friedman, Andrew Lampinen, Lucas Dixon, Danqi Chen 외

A common method to study deep learning systems is to use simplified model representations--for example, using singular value decomposition to visualize the model's hidden states in a lower dimensional space. This approac…

Code CompletionDimensionality ReductionSystematic Generalization