Evaluating and Adapting Large Language Models to Represent Folktales in Low-Resource Languages
Folktales are a rich resource of knowledge about the society and culture of a civilisation. Digital folklore research aims to use automated techniques to better understand these folktales, and it relies on abstract representations of the textual data. Although a number of large language models (LLMs) claim to be able to represent low-resource langauges such as Irish and Gaelic, we present two classification tasks to explore how useful these representations are, and three adaptations to improve the performance of these models. We find that adapting the models to work with longer sequences, and continuing pre-training on the domain of folktales improves classification performance, although these findings are tempered by the impressive performance of a baseline SVM with non-contextual features.
Code (0)
등록된 구현이 없습니다.
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Do Large Language Models Know Folktales? A Case Study of Yokai in Japanese Folktales
Although Large Language Models (LLMs) have demonstrated strong language understanding and generation abilities across various languages, their cultural knowledge is often limited to English-speaking communities, which ca…
Multiple-choiceMultilingual Ontologies for the Representation and Processing of Folktales
We describe work done in the field of folkloristics and consisting in creating ontologies based on well-established studies proposed by {``}classical{''} folklorists. This work is supporting the availability of a huge am…
General ClassificationText GenerationTalking to Extraordinary Objects: Folktales Offer Analogies for Interacting with Technology
Speech and language are valuable for interacting with technology. It would be ideal to be able to decouple their use from anthropomorphization, which has recently met an important moment of reckoning. In the world of fol…
Analyzing Folktales of Different Regions Using Topic Modeling and Clustering
This paper employs two major natural language processing techniques, topic modeling and clustering, to find patterns in folktales and reveal cultural relationships between regions. In particular, we used Latent Dirichlet…
ClusteringCultural Vocal Bursts Intensity PredictionTowards a WordNet based Classification of Actors in Folktales
In the context of a student software project we are investigating the use of WordNet for improving the automatic detection and classification of actors (or characters) mentioned in folktales. Our starting point is the bo…
ClassificationTranslation