paper-with-me

홈 › Papers

FMI@SU ToxHabits: Evaluating LLMs Performance on Toxic Habit Extraction in Spanish Clinical Texts

2026-04-07 · Sylvia Vassileva, Ivan Koychev, Svetla Boytcheva arxiv

The paper presents an approach for the recognition of toxic habits named entities in Spanish clinical texts. The approach was developed for the ToxHabits Shared Task. Our team participated in subtask 1, which aims to detect substance use and abuse mentions in clinical case reports and classify them in four categories (Tobacco, Alcohol, Cannabis, and Drug). We explored various methods of utilizing LLMs for the task, including zero-shot, few-shot, and prompt optimization, and found that GPT-4.1's few-shot prompting performed the best in our experiments. Our method achieved an F1 score of 0.65 on the test set, demonstrating a promising result for recognizing named entities in languages other than English.

📄 PDF Abstract BibTeX arXiv:2604.06403

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

NOWJ @BioCreative IX ToxHabits: An Ensemble Deep Learning Approach for Detecting Substance Use and Contextual Information in Clinical Texts

2026-02-10 · Huu-Huy-Hoang Tran, Gia-Bao Duong, Quoc-Viet-Anh Tran, Thi-Hai-Yen Vuong 외 arxiv

Extracting drug use information from unstructured Electronic Health Records remains a major challenge in clinical Natural Language Processing. While Large Language Models demonstrate advancements, their use in clinical N…

FrenchToxicityPrompts: a Large Benchmark for Evaluating and Mitigating Toxicity in French Texts

2024-06-25 · Caroline Brun, Vassilina Nikoulina

Large language models (LLMs) are increasingly popular but are also prone to generating bias, toxic or harmful language, which can have detrimental effects on individuals and communities. Although most efforts is put to a…

Dialectal Toxicity Detection: Evaluating LLM-as-a-Judge Consistency Across Language Varieties

2024-11-17 · Fahim Faisal, Md Mushfiqur Rahman, Antonios Anastasopoulos

There has been little systematic study on how dialectal differences affect toxicity detection by modern LLMs. Furthermore, although using LLMs as evaluators ("LLM-as-a-judge") is a growing research area, their sensitivit…

Understanding BLOOM: An empirical study on diverse NLP tasks

2022-11-27 · Parag Pravin Dakle, SaiKrishna Rallabandi, Preethi Raghavan

We view the landscape of large language models (LLMs) through the lens of the recently released BLOOM model to understand the performance of BLOOM and other decoder-only LLMs compared to BERT-style encoder-only models. W…

DecoderFew-Shot Text ClassificationQuestion Answeringtext-classification+3

Can Large Language Models Design Biological Weapons? Evaluating Moremi Bio

2025-05-22 · Gertrude Hattoh, Jeremiah Ayensu, Nyarko Prince Ofori, Solomon Eshun 외

Advances in AI, particularly LLMs, have dramatically shortened drug discovery cycles by up to 40% and improved molecular target identification. However, these innovations also raise dual-use concerns by enabling the desi…

Drug Discovery