Word Segmentation in Sanskrit Using Path Constrained Random Walks
In Sanskrit, the phonemes at the word boundaries undergo changes to form new phonemes through a process called as sandhi. A fused sentence can be segmented into multiple possible segmentations. We propose a word segmentation approach that predicts the most semantically valid segmentation for a given sentence. We treat the problem as a query expansion problem and use the path-constrained random walks framework to predict the correct segments.
Code (0)
등록된 구현이 없습니다.
Tasks
SegmentationSentencevalidSimilar Papers 제목 키워드 기반
A Dataset for Sanskrit Word Segmentation
The last decade saw a surge in digitisation efforts for ancient manuscripts in Sanskrit. Due to various linguistic peculiarities inherent to the language, even the preliminary tasks such as word segmentation are non-triv…
SegmentationSentenceTransfer LearningSanskrit Segmentation Revisited
Computationally analyzing Sanskrit texts requires proper segmentation in the initial stages. There have been various tools developed for Sanskrit text segmentation. Of these, G\'erard Huet's Reader in the Sanskrit Herita…
SegmentationText SegmentationvalidSHR++: An Interface for Morpho-syntactic Annotation of Sanskrit Corpora
We propose a web-based annotation framework, SHR++, for morpho-syntactic annotation of corpora in Sanskrit. SHR++ is designed to generate annotations for the word-segmentation, morphological parsing and dependency analys…
Decision MakingSegmentationvalidFree as in Free Word Order: An Energy Based Model for Word Segmentation and Morphological Tagging in Sanskrit
The configurational information in sentences of a free word order language such as Sanskrit is of limited use. Thus, the context of the entire sentence will be desirable even for basic processing tasks such as word segme…
Morphological TaggingSegmentationSentenceStructured PredictionCharSS: Character-Level Transformer Model for Sanskrit Word Segmentation
Subword tokens in Indian languages inherently carry meaning, and isolating them can enhance NLP tasks, making sub-word segmentation a crucial process. Segmenting Sanskrit and other Indian languages into subtokens is not …