A Characterwise Windowed Approach to Hebrew Morphological Segmentation
This paper presents a novel approach to the segmentation of orthographic word forms in contemporary Hebrew, focusing purely on splitting without carrying out morphological analysis or disambiguation. Casting the analysis task as character-wise binary classification and using adjacent character and word-based lexicon-lookup features, this approach achieves over 98% accuracy on the benchmark SPMRL shared task data for Hebrew, and 97% accuracy on a new out of domain Wikipedia dataset, an improvement of ~4% and 5% over previous state of the art performance.
Code (1)
Tasks
Binary ClassificationGeneral ClassificationMorphological AnalysisText SegmentationSimilar Papers 제목 키워드 기반
A Graph-based Lattice Dependency Parser for Joint Morphological Segmentation and Syntactic Analysis
Space-delimited words in Turkish and Hebrew text can be further segmented into meaningful units, but syntactic and semantic context is necessary to predict segmentation. At the same time, predicting correct syntactic str…
Dependency ParsingMorphological AnalysisMorphological TaggingSegmentation+1DictaBERT: A State-of-the-Art BERT Suite for Modern Hebrew
We present DictaBERT, a new state-of-the-art pre-trained BERT model for modern Hebrew, outperforming existing models on most benchmarks. Additionally, we release three fine-tuned versions of the model, designed to perfor…
Morphological TaggingQuestion AnsweringSegmentationWord Segmentation, Unknown-word Resolution, and Morphological Agreement in a Hebrew Parsing System
A Pointer Network Architecture for Joint Morphological Segmentation and Tagging
Morphologically Rich Languages (MRLs) such as Arabic, Hebrew and Turkish often require Morphological Disambiguation (MD), i.e., the prediction of morphological decomposition of tokens into morphemes, early in the pipelin…
Morphological DisambiguationLarge Pre-Trained Models with Extra-Large Vocabularies: A Contrastive Analysis of Hebrew BERT Models and a New One to Outperform Them All
We present a new pre-trained language model (PLM) for modern Hebrew, termed AlephBERTGimmel, which employs a much larger vocabulary (128K items) than standard Hebrew PLMs before. We perform a contrastive analysis of this…
AllLanguage ModelingLanguage ModellingMorphological Analysis+5