paper-with-me

홈 › Papers

Counterfactual Cultural Cues Reduce Medical QA Accuracy in LLMs: Identifier vs Context Effects

2026-01-27 · Amirhossein Haji Mohammad Rezaei, Zahra Shakeri arxiv

Engineering sustainable and equitable healthcare requires medical language models that do not change clinically correct diagnoses when presented with non-decisive cultural information. We introduce a counterfactual benchmark that expands 150 MedQA test items into 1650 variants by inserting culture-related (i) identifier tokens, (ii) contextual cues, or (iii) their combination for three groups (Indigenous Canadian, Middle-Eastern Muslim, Southeast Asian), plus a length-matched neutral control, where a clinician verified that the gold answer remains invariant in all variants. We evaluate GPT-5.2, Llama-3.1-8B, DeepSeek-R1, and MedGemma (4B/27B) under option-only and brief-explanation prompting. Across models, cultural cues significantly affect accuracy (Cochran's Q, $p<10^-14$), with the largest degradation when identifier and context co-occur (up to 3-7 percentage points under option-only prompting), while neutral edits produce smaller, non-systematic changes. A human-validated rubric ($κ=0.76$) applied via an LLM-as-judge shows that more than half of culturally grounded explanations end in an incorrect answer, linking culture-referential reasoning to diagnostic failure. We release prompts and augmentations to support evaluation and mitigation of culturally induced diagnostic errors.

📄 PDF Abstract BibTeX arXiv:2601.20102

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Cultural Counterfactuals: Evaluating Cultural Biases in Large Vision-Language Models with Counterfactual Examples

2026-03-02 · Phillip Howard, Xin Su, Kathleen C. Fraser arxiv

Large Vision-Language Models (LVLMs) have grown increasingly powerful in recent years, but can also exhibit harmful biases. Prior studies investigating such biases have primarily focused on demographic traits related to …

Once Correct, Still Wrong: Counterfactual Hallucination in Multilingual Vision-Language Models

2026-02-05 · Basel Mousi, Fahim Dalvi, Shammur Chowdhury, Firoj Alam 외 arxiv

Vision-language models (VLMs) can achieve high accuracy while still accepting culturally plausible but visually incorrect interpretations. Existing hallucination benchmarks rarely test this failure mode, particularly out…

Beyond Surface Cues: Disentangling Sociocultural Signals in Multilingual LLMs

2026-08-24 · Yuanjun Feng, Tanzhou Liu, Stefan Feuerriegel, Yash Raj Shrestha arxiv

Multilingual LLM outputs can vary across sociocultural contexts. However, evidence of cultural grounding can be misleading: identity labels may be inferred from explicit or indirect textual cues, while names and wording …

Vision Language Models are Confused Tourists

2025-11-21 · Patrick Amadeus Irawan, Ikhlasul Akmal Hanif, Muhammad Dehan Al Kautsar, Genta Indra Winata 외 arxiv

Although the cultural dimension has been one of the key aspects in evaluating Vision-Language Models (VLMs), their ability to remain stable across diverse cultural inputs remains largely untested, despite being crucial t…

Adversarial Robustness

TRACE-Seg3D: Counterfactual Context Auditing For Robust 3D Glioma Segmentation Under Institutional Shift

2026-07-08 · Nguyen Linh Dan Le, Nguyen Pham Hoang Le, Tran Dang Khoi arxiv

Medical image segmentation models can achieve strong benchmark performance while remaining sensitive to scanner, protocol, and institutional variation. These context shifts alter image appearance without changing the und…

Medical Image Segmentation