Persian Pronoun Resolution: Leveraging Neural Networks and Language Models
Coreference resolution, critical for identifying textual entities referencing the same entity, faces challenges in pronoun resolution, particularly identifying pronoun antecedents. Existing methods often treat pronoun resolution as a separate task from mention detection, potentially missing valuable information. This study proposes the first end-to-end neural network system for Persian pronoun resolution, leveraging pre-trained Transformer models like ParsBERT. Our system jointly optimizes both mention detection and antecedent linking, achieving a 3.37 F1 score improvement over the previous state-of-the-art system (which relied on rule-based and statistical methods) on the Mehr corpus. This significant improvement demonstrates the effectiveness of combining neural networks with linguistic models, potentially marking a significant advancement in Persian pronoun resolution and paving the way for further research in this under-explored area.
Code (0)
등록된 구현이 없습니다.
Tasks
coreference-resolutionCoreference ResolutionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A hybrid entity-centric approach to Persian pronoun resolution
Pronoun resolution is a challenging subset of an essential field in natural language processing called coreference resolution. Coreference resolution is about finding all entities in the text that refers to the same real…
coreference-resolutionCoreference ResolutionPersian Vowel recognition with MFCC and ANN on PCVC speech dataset
In this paper a new method for recognition of consonant-vowel phonemes combination on a new Persian speech dataset titled as PCVC (Persian Consonant-Vowel Combination) is proposed which is used to recognize Persian phone…
Phoneme RecognitionThe Challenges of Persian User-generated Textual Content: A Machine Learning-Based Approach
Over recent years a lot of research papers and studies have been published on the development of effective approaches that benefit from a large amount of user-generated content and build intelligent predictive models on …
BIG-bench Machine LearningFeature EngineeringSentiment AnalysisReview of coreference resolution in English and Persian
Coreference resolution (CR), identifying expressions referring to the same real-world entity, is a fundamental challenge in natural language processing (NLP). This paper explores the latest advancements in CR, spanning c…
coreference-resolutionCoreference ResolutionDocument SummarizationGraph Neural Network+2ParsiNorm: A Persian Toolkit for Speech Processing Normalization
In general, speech processing models consist of a language model along with an acoustic model. Regardless of the language model's complexity and variants, three critical pre-processing steps are needed in language models…
Language ModellingSentence