paper-with-me

홈 › Papers

DKE-Research at SemEval-2024 Task 2: Incorporating Data Augmentation with Generative Models and Biomedical Knowledge to Enhance Inference Robustness

2024-04-14 · Yuqi Wang, Zeqiang Wang, Wei Wang, Qi Chen, Kaizhu Huang, Anh Nguyen, Suparna De

Safe and reliable natural language inference is critical for extracting insights from clinical trial reports but poses challenges due to biases in large pre-trained language models. This paper presents a novel data augmentation technique to improve model robustness for biomedical natural language inference in clinical trials. By generating synthetic examples through semantic perturbations and domain-specific vocabulary replacement and adding a new task for numerical and quantitative reasoning, we introduce greater diversity and reduce shortcut learning. Our approach, combined with multi-task learning and the DeBERTa architecture, achieved significant performance gains on the NLI4CT 2024 benchmark compared to the original language models. Ablation studies validate the contribution of each augmentation method in improving robustness. Our best-performing model ranked 12th in terms of faithfulness and 8th in terms of consistency, respectively, out of the 32 participants.

📄 PDF Abstract BibTeX arXiv:2404.09206

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationDiversityMulti-Task LearningNatural Language InferenceTask 2

Methods 이 논문이 사용한 방법론

How do I file a dispute with Expedia?*DisputeFastService How do I file a dispute with Expedia? To file a dispute with Expedia, call +1(888) (829) (0881) OR +1(805) (330) (4056), or use their Help Center to submit your case with…
DeBERTa DeBERTa is a Transformer-based neural language model that aims to improve the…

Similar Papers 제목 키워드 기반

ZJUKLAB at SemEval-2021 Task 4: Negative Augmentation with Language Model for Reading Comprehension of Abstract Meaning

2021-02-25 · SEMEVAL 2021 · Xin Xie, Xiangnan Chen, Xiang Chen, Yong Wang 외

This paper presents our systems for the three Subtasks of SemEval Task4: Reading Comprehension of Abstract Meaning (ReCAM). We explain the algorithms used to learn our models and the process of tuning the algorithms and …

Language Model EvaluationLanguage ModelingLanguage ModellingReading Comprehension

MultiMind at SemEval-2025 Task 7: Crosslingual Fact-Checked Claim Retrieval via Multi-Source Alignment

2025-12-24 · Mohammad Mahdi Abootorabi, Alireza Ghahramani Kure, Mohammadali Mohammadkhani, Sina Elahimanesh 외 arxiv

This paper presents our system for SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrieval. In an era where misinformation spreads rapidly, effective fact-checking is increasingly critical. We int…

Representation LearningContrastive Learning

MT-Speech at SemEval-2022 Task 10: Incorporating Data Augmentation and Auxiliary Task with Cross-Lingual Pretrained Language Model for Structured Sentiment Analysis

2022-07-01 · SemEval (NAACL) 2022 7 · Cong Chen, Jiansong Chen, Cao Liu, Fan Yang 외

Sentiment analysis is a fundamental task, and structure sentiment analysis (SSA) is an important component of sentiment analysis. However, traditional SSA is suffering from some important issues: (1) lack of interactive …

Data AugmentationLanguage ModelingLanguage ModellingSentiment Analysis

UA-KO at SemEval-2022 Task 11: Data Augmentation and Ensembles for Korean Named Entity Recognition

2022-07-01 · SemEval (NAACL) 2022 7 · Hyunju Song, Steven Bethard

This paper presents the approaches and systems of the UA-KO team for the Korean portion of SemEval-2022 Task 11 on Multilingual Complex Named Entity Recognition.We fine-tuned Korean and multilingual BERT and RoBERTA mode…

Data Augmentationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)

MALTO at SemEval-2024 Task 6: Leveraging Synthetic Data for LLM Hallucination Detection

2024-03-01 · Federico Borra, Claudio Savelli, Giacomo Rosso, Alkis Koudounas 외

In Natural Language Generation (NLG), contemporary Large Language Models (LLMs) face several challenges, such as generating fluent yet inaccurate outputs and reliance on fluency-centric metrics. This often leads to neura…

Data AugmentationHallucinationNatural Language InferenceSentence+1