AMU-EURANOVA at CASE 2021 Task 1: Assessing the stability of multilingual BERT
This paper explains our participation in task 1 of the CASE 2021 shared task. This task is about multilingual event extraction from news. We focused on sub-task 4, event information extraction. This sub-task has a small training dataset and we fine-tuned a multilingual BERT to solve this sub-task. We studied the instability problem on the dataset and tried to mitigate it.
Code (1)
Tasks
Event ExtractionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Frequency Domain Stability Method for Reset Systems
Today, linear PID controllers cannot satisfy requirements of high-precision industry due to the development of technology. According to the literature, reset controllers can overcome this important barrier. However, simi…
LCTG Bench: LLM Controlled Text Generation Benchmark
The rise of large language models (LLMs) has led to more diverse and higher-quality machine-generated text. However, their high expressive power makes it difficult to control outputs based on specific business instructio…
Text GenerationXLQA: A Benchmark for Locale-Aware Multilingual Open-Domain Question Answering
Large Language Models (LLMs) have shown significant progress in Open-domain question answering (ODQA), yet most evaluations focus on English and assume locale-invariant answers across languages. This assumption neglects …
Open-Domain Question AnsweringAssessing the Political Fairness of Multilingual LLMs: A Case Study based on a 21-way Multiparallel EuroParl Dataset
The political biases of Large Language Models (LLMs) are usually assessed by simulating their answers to English surveys. In this work, we propose an alternative framing of political biases, relying on principles of fair…
Towards Multilingual LLM Evaluation for European Languages
The rise of Large Language Models (LLMs) has revolutionized natural language processing across numerous languages and tasks. However, evaluating LLM performance in a consistent and meaningful way across multiple European…
ARCGSM8KHellaSwagMMLU+1