Parsivar: A Language Processing Toolkit for Persian
Code (1)
Tasks
Morphological AnalysisSimilar Papers 제목 키워드 기반
ParsiNorm: A Persian Toolkit for Speech Processing Normalization
In general, speech processing models consist of a language model along with an acoustic model. Regardless of the language model's complexity and variants, three critical pre-processing steps are needed in language models…
Language ModellingSentenceDadmaTools: Natural Language Processing Toolkit for Persian Language
We introduce DadmaTools, an open-source Python Natural Language Processing toolkit for the Persian language. The toolkit is a neural pipeline based on spaCy for several text processing tasks, including normalization, tok…
ChunkingConstituency ParsingDependency ParsingLemmatizationParsiPy: NLP Toolkit for Historical Persian Texts in Python
The study of historical languages presents unique challenges due to their complex orthographic systems, fragmentary textual evidence, and the absence of standardized digital representations of text in those languages. Ta…
LemmatizationPart-Of-Speech TaggingTransliterationA Knowledge-based Approach for Answering Complex Questions in Persian
Research on open-domain question answering (QA) has a long tradition. A challenge in this domain is answering complex questions (CQA) that require complex inference methods and large amounts of knowledge. In low resource…
Open-Domain Question AnsweringQuestion AnsweringPersianLLaMA: Towards Building First Persian Large Language Model
Despite the widespread use of the Persian language by millions globally, limited efforts have been made in natural language processing for this language. The use of large language models as effective tools in various nat…
Language ModelingLanguage ModellingLarge Language ModelMachine Translation+5