paper-with-me

홈 › Papers

Are LLMs Truly Multilingual? Exploring Zero-Shot Multilingual Capability of LLMs for Information Retrieval: An Italian Healthcare Use Case

2025-12-04 · Vignesh Kumar Kembu, Pierandrea Morandini, Marta Bianca Maria Ranzini, Antonino Nocera arxiv

Large Language Models (LLMs) have become a key topic in AI and NLP, transforming sectors like healthcare, finance, education, and marketing by improving customer service, automating tasks, providing insights, improving diagnostics, and personalizing learning experiences. Information extraction from clinical records is a crucial task in digital healthcare. Although traditional NLP techniques have been used for this in the past, they often fall short due to the complexity, variability of clinical language, and high inner semantics in the free clinical text. Recently, Large Language Models (LLMs) have become a powerful tool for better understanding and generating human-like text, making them highly effective in this area. In this paper, we explore the ability of open-source multilingual LLMs to understand EHRs (Electronic Health Records) in Italian and help extract information from them in real-time. Our detailed experimental campaign on comorbidity extraction from EHR reveals that some LLMs struggle in zero-shot, on-premises settings, and others show significant variation in performance, struggling to generalize across various diseases when compared to native pattern matching and manual annotations.

📄 PDF Abstract BibTeX arXiv:2512.04834

Code (0)

등록된 구현이 없습니다.

Tasks

Information ExtractionInformation Retrieval

Similar Papers 제목 키워드 기반

A Weakly-Supervised Streaming Multilingual Speech Model with Truly Zero-Shot Capability

2022-11-04 · Jian Xue, Peidong Wang, Jinyu Li, Eric Sun

In this paper, we introduce our work of building a Streaming Multilingual Speech Model (SM2), which can transcribe or translate multiple spoken languages into texts of the target language. The backbone of SM2 is Transfor…

Machine Translationspeech-recognitionSpeech RecognitionTranslation

Zero-shot Dependency Parsing with Pre-trained Multilingual Sentence Representations

2019-10-12 · WS 2019 11 · Ke Tran, Arianna Bisazza

We investigate whether off-the-shelf deep bidirectional sentence representations trained on a massively multilingual corpus (multilingual BERT) enable the development of an unsupervised universal dependency parser. This …

Dependency ParsingSentenceTranslation

AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource Languages

2021-04-18 · ACL 2022 5 · Abteen Ebrahimi, Manuel Mager, Arturo Oncevay, Vishrav Chaudhary 외

Pretrained multilingual models are able to perform cross-lingual transfer in a zero-shot setting, even for languages unseen during pretraining. However, prior work evaluating performance on unseen languages has largely b…

Cross-Lingual TransferNatural Language UnderstandingTranslationXLM-R+1

UDapter: Language Adaptation for Truly Universal Dependency Parsing

2020-04-29 · EMNLP 2020 11 · Ahmet Üstün, Arianna Bisazza, Gosse Bouma, Gertjan van Noord

Recent advances in multilingual dependency parsing have brought the idea of a truly universal parser closer to reality. However, cross-language interference and restrained model capacity remain major obstacles. To addres…

Dependency ParsingTransfer Learning

Exploring Data and Parameter Efficient Strategies for Arabic Dialect Identifications

2025-09-17 · Vani Kanjirangat, Ljiljana Dolamic, Fabio Rinaldi arxiv

This paper discusses our exploration of different data-efficient and parameter-efficient approaches to Arabic Dialect Identification (ADI). In particular, we investigate various soft-prompting strategies, including prefi…