Uncertainty-Aware Natural Language Inference with Stochastic Weight Averaging
This paper introduces Bayesian uncertainty modeling using Stochastic Weight Averaging-Gaussian (SWAG) in Natural Language Understanding (NLU) tasks. We apply the approach to standard tasks in natural language inference (NLI) and demonstrate the effectiveness of the method in terms of prediction accuracy and correlation with human annotation disagreements. We argue that the uncertainty representations in SWAG better reflect subjective interpretation and the natural variation that is also present in human language understanding. The results reveal the importance of uncertainty modeling, an often neglected aspect of neural language modeling, in NLU tasks.
Code (1)
Tasks
Language ModelingNatural Language InferenceNatural Language UnderstandingSimilar Papers 제목 키워드 기반
SafeGround: Know When to Trust GUI Grounding Models via Uncertainty Calibration
Graphical User Interface (GUI) grounding aims to translate natural language instructions into executable screen coordinates, enabling automated GUI interaction. Nevertheless, incorrect grounding can result in costly, har…
Efficient Nearest Neighbor based Uncertainty Estimation for Natural Language Processing Tasks
Trustworthy prediction in Deep Neural Networks (DNNs), including Pre-trained Language Models (PLMs) is important for safety-critical applications in the real world. However, DNNs often suffer from uncertainty estimation,…
Dimensionality Reductionnamed-entity-recognitionNamed Entity RecognitionNatural Language Inference+2Dropout Robustness and Cognitive Profiling of Transformer Models via Stochastic Inference
Transformer-based language models are widely deployed for reasoning, yet their behavior under inference-time stochasticity remains underexplored. While dropout is common during training, its inference-time effects via Mo…
Uncertainty-Aware Decision Transformer for Stochastic Driving Environments
Offline Reinforcement Learning (RL) enables policy learning without active interactions, making it especially appealing for self-driving tasks. Recent successes of Transformers inspire casting offline RL as sequence mode…
Autonomous DrivingOffline RLReinforcement Learning (RL)Cross-Modal Bayesian Low-Rank Adaptation for Uncertainty-Aware Multimodal Learning
Large pre-trained language models are increasingly adapted to downstream tasks using parameter-efficient fine-tuning (PEFT), but existing PEFT methods are typically deterministic and unimodal, making them poorly suited f…
parameter-efficient fine-tuningComputational Efficiency