How Well Do Large Language Models Disambiguate Swedish Words?
We evaluate a battery of recent large language models on two benchmarks for word sense disambiguation in Swedish. At present, all current models are less accurate than the best supervised disambiguators in cases where a training set is available, but most models outperform graph-based unsupervised systems. Different prompting approaches are compared, with a focus on how to express the set of possible senses in a given context. The best accuracies are achieved when human-written definitions of the senses are included in the prompts.
Code (0)
등록된 구현이 없습니다.
Tasks
Word Sense DisambiguationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Towards a Swedish Roget-Style Thesaurus for NLP
Bring{'}s thesaurus (Bring) is a Swedish counterpart of Roget, and its digitized version could make a valuable language resource for use in many and diverse natural language processing (NLP) applications. From the litera…
LEMMAPOSAn exploratory study of L1-specific non-words
In this paper, we explore L1-specific non-words, i.e. non-words in a target language (in this case Swedish) that are re-ranked by a different-language language model. We surmise that speakers of a certain L1 will react d…
Language ModelingLanguage ModellingRe-RankingNyLLex: A Novel Resource of Swedish Words Annotated with Reading Proficiency Level
What makes a text easy to read or not, depends on a variety of factors. One of the most prominent is, however, if the text contains easy, and avoids difficult, words. Deciding if a word is easy or difficult is not a triv…
Word Sense Disambiguation using WSD specific Wordnet of Polysemy Words
This paper presents a new model of WordNet that is used to disambiguate the correct sense of polysemy word based on the clue words. The related words for each sense of a polysemy word as well as single sense word are ref…
Word Sense DisambiguationSynonym Replacement based on a Study of Basic-level Nouns in Swedish Texts of Different Complexity
Basic-level terms have been described as the most important to human categorisation. They are the earliest emerging words in children’s language acquisition, and seem to be more frequently occurring in language in genera…
Language AcquisitionLexical Simplification