paper-with-me

홈 › Papers

Sanskrit Word Segmentation Using Character-level Recurrent and Convolutional Neural Networks

2018-10-01 · EMNLP 2018 10 · Oliver Hellwig, Sebastian Nehrdich

The paper introduces end-to-end neural network models that tokenize Sanskrit by jointly splitting compounds and resolving phonetic merges (Sandhi). Tokenization of Sanskrit depends on local phonetic and distant semantic features that are incorporated using convolutional and recurrent elements. Contrary to most previous systems, our models do not require feature engineering or extern linguistic resources, but operate solely on parallel versions of raw and segmented text. The models discussed in this paper clearly improve over previous approaches to Sanskrit word segmentation. As they are language agnostic, we will demonstrate that they also outperform the state of the art for the related task of German compound splitting.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Feature Engineering

Similar Papers 제목 키워드 기반

CharSS: Character-Level Transformer Model for Sanskrit Word Segmentation

2024-07-08 · Krishnakant Bhatt, Karthika N J, Ganesh Ramakrishnan, Preethi Jyothi

Subword tokens in Indian languages inherently carry meaning, and isolating them can enhance NLP tasks, making sub-word segmentation a crucial process. Segmenting Sanskrit and other Indian languages into subtokens is not …

A Dataset for Sanskrit Word Segmentation

2017-08-01 · WS 2017 8 · Amrith Krishna, Pavan Kumar Satuluri, Pawan Goyal

The last decade saw a surge in digitisation efforts for ancient manuscripts in Sanskrit. Due to various linguistic peculiarities inherent to the language, even the preliminary tasks such as word segmentation are non-triv…

SegmentationSentenceTransfer Learning

Linguistically-Informed Neural Architectures for Lexical, Syntactic and Semantic Tasks in Sanskrit

2023-08-17 · Jivnesh Sandhan

The primary focus of this thesis is to make Sanskrit manuscripts more accessible to the end-users through natural language technologies. The morphological richness, compounding, free word orderliness, and low-resource na…

Dependency ParsingMachine TranslationQuestion Answering

One Model is All You Need: ByT5-Sanskrit, a Unified Model for Sanskrit NLP Tasks

2024-09-20 · Sebastian Nehrdich, Oliver Hellwig, Kurt Keutzer

Morphologically rich languages are notoriously challenging to process for downstream NLP applications. This paper presents a new pretrained language model, ByT5-Sanskrit, designed for NLP applications involving the morph…

AllDependency ParsingInformation RetrievalLanguage Modelling+4

Automatic Speech Recognition in Sanskrit: A New Speech Corpus and Modelling Insights

2021-06-02 · Findings (ACL) 2021 8 · Devaraja Adiga, Rishabh Kumar, Amrith Krishna, Preethi Jyothi 외

Automatic speech recognition (ASR) in Sanskrit is interesting, owing to the various linguistic peculiarities present in the language. The Sanskrit language is lexically productive, undergoes euphonic assimilation of phon…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language Modellingspeech-recognition+1