paper-with-me

Papers

FASPell: A Fast, Adaptable, Simple, Powerful Chinese Spell Checker Based On DAE-Decoder Paradigm

2019-11-01 · WS 2019 11 · Yuzhong Hong, Xianguo Yu, Neng He, Nan Liu, Junhui Liu

We propose a Chinese spell checker {--} FASPell based on a new paradigm which consists of a denoising autoencoder (DAE) and a decoder. In comparison with previous state-of-the-art models, the new paradigm allows our spell checker to be Faster in computation, readily Adaptable to both simplified and traditional Chinese texts produced by either humans or machines, and to require much Simpler structure to be as much Powerful in both error detection and correction. These four achievements are made possible because the new paradigm circumvents two bottlenecks. First, the DAE curtails the amount of Chinese spell checking data needed for supervised learning (to {\textless}10k sentences) by leveraging the power of unsupervisedly pre-trained masked language model as in BERT, XLNet, MASS etc. Second, the decoder helps to eliminate the use of confusion set that is deficient in flexibility and sufficiency of utilizing the salient feature of Chinese character similarity.

📄 PDF Abstract BibTeX

Code (1)

iqiyi/FASPell 공식 구현 tf

Tasks

Chinese Spell CheckingDecoderDenoisingLanguage ModelingLanguage Modelling

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Weight Decay 설명 없음
Residual Connection 설명 없음
Denoising Autoencoder A Denoising Autoencoder is a modification on the autoencoder to prevent the network learning the identity function.…
Adam 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Domain-shift Conditioning using Adaptable Filtering via Hierarchical Embeddings for Robust Chinese Spell Check

2020-08-27 · Minh Nguyen, Gia H. Ngo, Nancy F. Chen

Spell check is a useful application which processes noisy human-generated text. Spell check for Chinese poses unresolved problems due to the large number of characters, the sparse distribution of errors, and the dearth o…

Spelling Correction

The Chinese Remainder Theorem for Compact, Task-Precise, Efficient and Secure Word Embeddings

2021-04-01 · EACL 2021 2 · Patricia Thaine, Gerald Penn

The growing availability of powerful mobile devices and other edge devices, together with increasing regulatory and security concerns about the exchange of personal information across networks of these devices has challe…

Sentiment AnalysisSentiment ClassificationWord Embeddings

HFH-Font: Few-shot Chinese Font Synthesis with Higher Quality, Faster Speed, and Higher Resolution

2024-10-09 · Hua Li, Zhouhui Lian

The challenge of automatically synthesizing high-quality vector fonts, particularly for writing systems (e.g., Chinese) consisting of huge amounts of complex glyphs, remains unsolved. Existing font synthesis techniques f…

Super-Resolution

Fast Neural Chinese Word Segmentation for Long Sentences

2018-11-06 · Sufeng Duan, Jiangtong Li, Hai Zhao

Rapidly developed neural models have achieved competitive performance in Chinese word segmentation (CWS) as their traditional counterparts. However, most of methods encounter the computational inefficiency especially for…

Chinese Word SegmentationSegmentationTAG

SimpleDepthPose: Fast and Reliable Human Pose Estimation with RGBD-Images

2025-01-30 · Daniel Bermuth, Alexander Poeppel, Wolfgang Reif

In the rapidly advancing domain of computer vision, accurately estimating the poses of multiple individuals from various viewpoints remains a significant challenge, especially when reliability is a key requirement. This …

Multi-Person Pose EstimationPose Estimation