paper-with-me

Papers

GlossGPT: GPT for Word Sense Disambiguation using Few-shot Chain-of-Thought Prompting

2025-03-01 · Procedia Computer Science 2025 3 · Deshan Sumanathilaka, Nicholas Micallef, Julian Hough

Lexical ambiguity is a major challenge in computational linguistic tasks, as limitations in proper sense identification lead to inefficient translation and question answering. General-purpose Large Language Models (LLMs) are commonly utilized for Natural Language Processing (NLP) tasks. However, utilizing general-purpose LLMs for specific tasks has been challenging, and fine-tuning has become a critical requirement for task specification. In this work, we craft advanced prompts with different contextual parameters to guide the model’s inference towards accurate sense prediction to handle Word Sense Disambiguation (WSD). We present a few-shot Chain of Thought (COT) prompt-based technique using GPT-4-Turbo with knowledgebase as a retriever that does not require fine-tuning the model for WSD tasks and sense definitions are supported by synonyms to broaden the lexical meaning. Our approach achieves comparable performance on the SemEval and Senseval datasets. More importantly, we set a new state-of-the-art performance with the few-shot FEWS dataset, breaking through the 90% F1 score barrier.

📄 PDF Abstract BibTeX

Code (1)

Sumanathilaka/GlossGPT-GPT-4-WSD-with-COT

Tasks

Question AnsweringWord Sense Disambiguation

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Prompt Balance Matters: Understanding How Imbalanced Few-Shot Learning Affects Multilingual Sense Disambiguation in LLMs

2025-10-04 · Deshan Sumanathilaka, Nicholas Micallef, Julian Hough arxiv

Recent advances in Large Language Models (LLMs) have significantly reshaped the landscape of Natural Language Processing (NLP). Among the various prompting techniques, few-shot prompting has gained considerable attention…

Word Sense DisambiguationFew-Shot Learning

Can LLMs assist with Ambiguity? A Quantitative Evaluation of various Large Language Models on Word Sense Disambiguation

2024-11-27 · T. G. D. K. Sumanathilaka, Nicholas Micallef, Julian Hough

Ambiguous words are often found in modern digital communications. Lexical ambiguity challenges traditional Word Sense Disambiguation (WSD) methods, due to limited data. Consequently, the efficiency of translation, inform…

Information RetrievalPart-Of-Speech TaggingPOSPOS Tagging+2

Language Models as Knowledge Bases for Visual Word Sense Disambiguation

2023-10-03 · Anastasia Kritharoula, Maria Lymperaiou, Giorgos Stamou

Visual Word Sense Disambiguation (VWSD) is a novel challenging task that lies between linguistic sense disambiguation and fine-grained multimodal retrieval. The recent advancements in the development of visiolinguistic (…

Image CaptioningMultiple-choiceQuestion AnsweringRetrieval+1

Word Sense Disambiguation: Towards Interactive Context Exploitation from Both Word and Sense Perspectives

2021-08-01 · ACL 2021 5 · Ming Wang, Yinglin Wang

Lately proposed Word Sense Disambiguation (WSD) systems have approached the estimated upper bound of the task on standard evaluation benchmarks. However, these systems typically implement the disambiguation of words in a…

SentenceWord Sense Disambiguation

Rare and Zero-shot Word Sense Disambiguation using Z-Reweighting

2022-05-01 · ACL 2022 5 · Ying Su, Hongming Zhang, Yangqiu Song, Tong Zhang

Word sense disambiguation (WSD) is a crucial problem in the natural language processing (NLP) community. Current methods achieve decent performance by utilizing supervised learning and large pre-trained language models. …

RelationWord Sense Disambiguation