paper-with-me

Papers

Maximum Entropy Regularization and Chinese Text Recognition

2020-07-09 · Changxu Cheng, Wuheng Xu, Xiang Bai, Bin Feng, Wenyu Liu

Chinese text recognition is more challenging than Latin text due to the large amount of fine-grained Chinese characters and the great imbalance over classes, which causes a serious overfitting problem. We propose to apply Maximum Entropy Regularization to regularize the training process, which is to simply add a negative entropy term to the canonical cross-entropy loss without any additional parameters and modification of a model. We theoretically give the convergence probability distribution and analyze how the regularization influence the learning process. Experiments on Chinese character recognition, Chinese text line recognition and fine-grained image classification achieve consistent improvement, proving that the regularization is beneficial to generalization and robustness of a recognition model.

📄 PDF Abstract BibTeX arXiv:2007.04651

Code (0)

등록된 구현이 없습니다.

Tasks

Fine-Grained Image Classificationimage-classificationImage Classification

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음

Similar Papers 제목 키워드 기반

Connectionist Temporal Classification with Maximum Entropy Regularization

2018-12-01 · NeurIPS 2018 12 · Hu Liu, Sheng Jin, Chang-Shui Zhang

Connectionist Temporal Classification (CTC) is an objective function for end-to-end sequence learning, which adopts dynamic programming algorithms to directly learn the mapping between sequences. CTC has shown promising …

ClassificationGeneral ClassificationScene Text Recognitionspeech-recognition+1

AdaMER-CTC: Connectionist Temporal Classification with Adaptive Maximum Entropy Regularization for Automatic Speech Recognition

2024-03-18 · SooHwan Eom, Eunseop Yoon, Hee Suk Yoon, Chanwoo Kim 외

In Automatic Speech Recognition (ASR) systems, a recurring obstacle is the generation of narrowly focused output distributions. This phenomenon emerges as a side effect of Connectionist Temporal Classification (CTC), a r…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Maximum Entropy, Word-Frequency, Chinese Characters, and Multiple Meanings

2014-02-09 · Xiao-Yong Yan, Petter Minnhagen

The word-frequency distribution of a text written by an author is well accounted for by a maximum entropy distribution, the RGF (random group formation)-prediction. The RGF-distribution is completely determined by the a …

Prediction

A Maximum Entropy Approach to Chinese Spelling Check

2013-10-01 · WS 2013 10 · Dongxu Han, Baobao Chang
Optical Character Recognition (OCR)

Towards Reliable WMH Segmentation under Domain Shift: An Application Study using Maximum Entropy Regularization to Improve Uncertainty Estimation

2025-06-17 · Franco Matzkin, Agostina Larrazabal, Diego H Milone, Jose Dolz 외

Accurate segmentation of white matter hyperintensities (WMH) is crucial for clinical decision-making, particularly in the context of multiple sclerosis. However, domain shifts, such as variations in MRI machine types or …

Decision MakingSegmentation