paper-with-me

홈 › Papers

OOVs in the Spotlight: How to Inflect them?

2024-04-13 · Tomáš Sourada, Jana Straková, Rudolf Rosa

We focus on morphological inflection in out-of-vocabulary (OOV) conditions, an under-researched subtask in which state-of-the-art systems usually are less effective. We developed three systems: a retrograde model and two sequence-to-sequence (seq2seq) models based on LSTM and Transformer. For testing in OOV conditions, we automatically extracted a large dataset of nouns in the morphologically rich Czech language, with lemma-disjoint data splits, and we further manually annotated a real-world OOV dataset of neologisms. In the standard OOV conditions, Transformer achieves the best results, with increasing performance in ensemble with LSTM, the retrograde model and SIGMORPHON baselines. On the real-world OOV dataset of neologisms, the retrograde model outperforms all neural models. Finally, our seq2seq models achieve state-of-the-art results in 9 out of 16 languages from SIGMORPHON 2022 shared task data in the OOV evaluation (feature overlap) in the large data condition. We release the Czech OOV Inflection Dataset for rigorous evaluation in OOV conditions. Further, we release the inflection system with the seq2seq models as a ready-to-use Python library.

📄 PDF Abstract BibTeX arXiv:2404.08974

Code (1)

tomsouri/cz-inflect 공식 구현

Tasks

LEMMAMorphological Inflection

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Sigmoid Activation 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Adam 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Tanh Activation 설명 없음

Similar Papers 제목 키워드 기반

Better OOV Translation with Bilingual Terminology Mining

2019-07-01 · ACL 2019 7 · Matthias Huck, Viktor Hangya, Alex Fraser, er

Unseen words, also called out-of-vocabulary words (OOVs), are difficult for machine translation. In neural machine translation, byte-pair encoding can be used to represent OOVs, but they are still often incorrectly trans…

Machine TranslationNMTTranslationWord Embeddings

Evaluating a Joint Training Approach for Learning Cross-lingual Embeddings with Sub-word Information without Parallel Corpora on Lower-resource Languages

2021-08-01 · Joint Conference on Lexical and Computational Semantics 2021 · Ali Hakimi Parizi, Paul Cook

Cross-lingual word embeddings provide a way for information to be transferred between languages. In this paper we evaluate an extension of a joint training approach to learning cross-lingual embeddings that incorporates …

Bilingual Lexicon InductionCross-Lingual Word EmbeddingsWord Embeddings

Evaluating Tokenizers Impact on OOVs Representation with Transformers Models

2022-06-01 · LREC 2022 6 · Alexandra Benamar, Cyril Grouin, Meryl Bothua, Anne Vilnat

Transformer models have achieved significant improvements in multiple downstream tasks in recent years. One of the main contributions of Transformers is their ability to create new representations for out-of-vocabulary (…

AnatomyDomain Adaptation

Using BabelNet to Improve OOV Coverage in SMT

2016-05-01 · LREC 2016 5 · Jinhua Du, Andy Way, Andrzej Zydron

Out-of-vocabulary words (OOVs) are a ubiquitous and difficult problem in statistical machine translation (SMT). This paper studies different strategies of using BabelNet to alleviate the negative impact brought about by …

Domain AdaptationMachine TranslationTranslation

Spotlight Text Detector: Spotlight on Candidate Regions Like a Camera

2024-09-25 · Xu Han, Junyu Gao, Chuang Yang, Yuan Yuan 외

The irregular contour representation is one of the tough challenges in scene text detection. Although segmentation-based methods have achieved significant progress with the help of flexible pixel prediction, the overlap …

Scene Text DetectionText Detection