paper-with-me

홈 › Papers

Toward Cultural Interpretability: A Linguistic Anthropological Framework for Describing and Evaluating Large Language Models (LLMs)

2024-11-07 · Graham M. Jones, Shai Satran, Arvind Satyanarayan

This article proposes a new integration of linguistic anthropology and machine learning (ML) around convergent interests in both the underpinnings of language and making language technologies more socially responsible. While linguistic anthropology focuses on interpreting the cultural basis for human language use, the ML field of interpretability is concerned with uncovering the patterns that Large Language Models (LLMs) learn from human verbal behavior. Through the analysis of a conversation between a human user and an LLM-powered chatbot, we demonstrate the theoretical feasibility of a new, conjoint field of inquiry, cultural interpretability (CI). By focusing attention on the communicative competence involved in the way human users and AI chatbots co-produce meaning in the articulatory interface of human-computer interaction, CI emphasizes how the dynamic relationship between language and culture makes contextually sensitive, open-ended conversation possible. We suggest that, by examining how LLMs internally "represent" relationships between language and culture, CI can: (1) provide insight into long-standing linguistic anthropological questions about the patterning of those relationships; and (2) aid model developers and interface designers in improving value alignment between language models and stylistically diverse speakers and culturally diverse speech communities. Our discussion proposes three critical research axes: relativity, variation, and indexicality.

📄 PDF Abstract BibTeX arXiv:2411.05200

Code (0)

등록된 구현이 없습니다.

Tasks

Chatbot

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Cardiometabolic Risk Factors in South Asians: An Epidemiological and Anthropological Study in an Urban Populace of Eastern India

2024-12-08 · Karishma Yasmin

Background: This study examines cardiometabolic (CM) risk factors in an urban South Asian population, integrating medical and Anthropological perspectives to explore the effects of socio-economic, lifestyle, gender-speci…

Descriptive

Hire Your Anthropologist! Rethinking Culture Benchmarks Through an Anthropological Lens

2025-10-07 · Mai AlKhamissi, Yunze Xiao, Badr AlKhamissi, Mona Diab arxiv

Cultural evaluation of large language models has become increasingly important, yet current benchmarks often reduce culture to static facts or homogeneous values. This view conflicts with anthropological accounts that em…

Investigating Cultural Alignment of Large Language Models

2024-02-20 · Badr AlKhamissi, Muhammad ElNokrashy, Mai AlKhamissi, Mona Diab

The intricate relationship between language and culture has long been a subject of exploration within the realm of linguistic anthropology. Large Language Models (LLMs), promoted as repositories of collective human knowl…

Cross-Lingual TransferSurvey

A Resource for Computational Experiments on Mapudungun

2019-12-04 · LREC 2020 5 · Mingjun Duan, Carlos Fasola, Sai Krishna Rallabandi, Rodolfo M. Vega 외

We present a resource for computational experiments on Mapudungun, a polysynthetic indigenous language spoken in Chile with upwards of 200 thousand speakers. We provide 142 hours of culturally significant conversations i…

Machine Translationspeech-recognitionSpeech RecognitionSpeech Synthesis+1

Disentangling Language and Culture for Evaluating Multilingual Large Language Models

2025-05-30 · Jiahao Ying, Wei Tang, Yiran Zhao, Yixin Cao 외

This paper introduces a Dual Evaluation Framework to comprehensively assess the multilingual capabilities of LLMs. By decomposing the evaluation along the dimensions of linguistic medium and cultural context, this framew…