paper-with-me

홈 › Papers

SLANG: New Concept Comprehension of Large Language Models

2024-01-23 · Lingrui Mei, Shenghua Liu, Yiwei Wang, Baolong Bi, Xueqi Cheng

The dynamic nature of language, particularly evident in the realm of slang and memes on the Internet, poses serious challenges to the adaptability of large language models (LLMs). Traditionally anchored to static datasets, these models often struggle to keep up with the rapid linguistic evolution characteristic of online communities. This research aims to bridge this gap by enhancing LLMs' comprehension of the evolving new concepts on the Internet, without the high cost of continual retraining. In pursuit of this goal, we introduce $\textbf{SLANG}$, a benchmark designed to autonomously integrate novel data and assess LLMs' ability to comprehend emerging concepts, alongside $\textbf{FOCUS}$, an approach uses causal inference to enhance LLMs to understand new phrases and their colloquial context. Our benchmark and approach involves understanding real-world instances of linguistic shifts, serving as contextual beacons, to form more precise and contextually relevant connections between newly emerging expressions and their meanings. The empirical analysis shows that our causal inference-based approach outperforms the baseline methods in terms of precision and relevance in the comprehension of Internet slang and memes.

📄 PDF Abstract BibTeX arXiv:2401.12585

Code (1)

meirtz/focusonslang-toolbox 공식 구현 pytorch

Tasks

Causal Inference

Methods 이 논문이 사용한 방법론

Causal inference Causal inference is the process of drawing a conclusion about a causal connection based on the conditions of the occurrence of an effect. The main difference between causal…

Similar Papers 제목 키워드 기반

DuanzAI: Slang-Enhanced LLM with Prompt for Humor Understanding

2024-05-23 · Yesian Rohn

Language's complexity is evident in the rich tapestry of slang expressions, often laden with humor and cultural nuances. This linguistic phenomenon has become increasingly prevalent, especially in digital communication. …

Chatbot

Slang Context-based Inference Enhancement via Greedy Search-Guided Chain-of-Thought Prompting

2026-01-15 · Jinghan Cao, Qingyang Ren, Xiangyun Chen, Xinjin Li 외 arxiv

Slang interpretation has been a challenging downstream task for Large Language Models (LLMs) as the expressions are inherently embedded in contextual, cultural, and linguistic frameworks. In the absence of domain-specifi…

Towards Augmenting Lexical Resources for Slang and African American English

2020-12-01 · VarDial (COLING) 2020 12 · Alyssa Hwang, William R. Frey, Kathleen McKeown

Researchers in natural language processing have developed large, robust resources for understanding formal Standard American English (SAE), but we lack similar resources for variations of English, such as slang and Afric…

ClusteringWord Embeddings

How do Language Models Generate Slang: A Systematic Comparison between Human and Machine-Generated Slang Usages

2025-09-19 · Siyang Wu, Zhewei Sun arxiv

Slang is a commonly used type of informal language that poses a daunting challenge to NLP systems. Recent advances in large language models (LLMs), however, have made the problem more approachable. While LLM agents are b…

Semantically Informed Slang Interpretation

2022-05-02 · NAACL 2022 7 · Zhewei Sun, Richard Zemel, Yang Xu

Slang is a predominant form of informal language making flexible and extended use of words that is notoriously hard for natural language processing systems to interpret. Existing approaches to slang interpretation tend t…

Machine TranslationTranslation