Linguistic change and historical periodization of Old Literary Finnish
In this study, we have normalized and lemmatized an Old Literary Finnish corpus using a lemmatization model trained on texts from Agricola. We analyse the error types that occur and appear in different decades, and use word error rate (WER) and different error types as a proxy for measuring linguistic innovation and change. We show that the proposed approach works, and the errors are connected to accumulating changes and innovations, which also results in a continuous decrease in the accuracy of the model. The described error types also guide further work in improving these models, and document the currently observed issues. We also have trained word embeddings for four centuries of lemmatized Old Literary Finnish, which are available on Zenodo.
Code (0)
등록된 구현이 없습니다.
Tasks
LemmatizationWord EmbeddingsSimilar Papers 제목 키워드 기반
Lemmatization of Historical Old Literary Finnish Texts in Modern Orthography
Texts written in Old Literary Finnish represent the first literary work ever written in Finnish starting from the 16th century. There have been several projects in Finland that have digitized old publications and made th…
LemmatizationA Probabilistic Approach in Historical Linguistics Word Order Change in Infinitival Clauses: from Latin to Old French
This research offers a new interdisciplinary approach to the field of Linguistics by using Computational Linguistics, NLP, Bayesian Statistics and Sociolinguistics methods. This thesis investigates word order change in i…
DiaHClust: an Iterative Hierarchical Clustering Approach for Identifying Stages in Language Change
Language change is often assessed against a set of pre-determined time periods in order to be able to trace its diachronic trajectory. This is problematic, since a pre-determined periodization might obscure significant d…
ClusteringCombining Qualitative and Computational Approaches for Literary Analysis of Finnish Novels
What can we learn from the classics of Finnish literature by using computational emotion analysis? This article tries to answer this question by examining how computational methods of sentiment analysis can be used in th…
Emotion RecognitionSentiment AnalysisWord EmbeddingsStudying the History of the Arabic Language: Language Technology and a Large-Scale Historical Corpus
Arabic is a widely-spoken language with a long and rich history, but existing corpora and language technology focus mostly on modern Arabic and its varieties. Therefore, studying the history of the language has so far be…