Securing Reliability: A Brief Overview on Enhancing In-Context Learning for Foundation Models
As foundation models (FMs) continue to shape the landscape of AI, the in-context learning (ICL) paradigm thrives but also encounters issues such as toxicity, hallucination, disparity, adversarial vulnerability, and inconsistency. Ensuring the reliability and responsibility of FMs is crucial for the sustainable development of the AI ecosystem. In this concise overview, we investigate recent advancements in enhancing the reliability and trustworthiness of FMs within ICL frameworks, focusing on four key methodologies, each with its corresponding subgoals. We sincerely hope this paper can provide valuable insights for researchers and practitioners endeavoring to build safe and dependable FMs and foster a stable and consistent ICL environment, thereby unlocking their vast potential.
Code (0)
등록된 구현이 없습니다.
Tasks
HallucinationIn-Context LearningSimilar Papers 제목 키워드 기반
A Brief Survey on Autonomous Vehicle Possible Attacks, Exploits and Vulnerabilities
Advanced driver assistance systems are advancing at a rapid pace and all major companies started investing in developing the autonomous vehicles. But the security and reliability is still uncertain and debatable. Imagine…
Autonomous VehiclesMy First Deep Learning System of 1991 + Deep Learning Timeline 1962-2013
Deep Learning has attracted significant attention in recent years. Here I present a brief overview of my first Deep Learner of 1991, and its historic context, with a timeline of Deep Learning highlights.
Deep LearningMining comorbidities: a brief survey
In this manuscript we will present a brief overview of the comorbidity concept. We will start by laying its foundations and its definitions and then describing the role that machine learning can hold in mining and defini…
SurveyA review on modelling, evaluation, and optimization of cyber-physical system reliability
The aim of this study is to present an overview of current research on modelling, evaluation, and optimization methods for improving the reliability of Cyber-Physical System (CPS). Three major modelling approaches, namel…
Improving VQA Reliability: A Dual-Assessment Approach with Self-Reflection and Cross-Model Verification
Vision-language models (VLMs) have demonstrated significant potential in Visual Question Answering (VQA). However, the susceptibility of VLMs to hallucinations can lead to overconfident yet incorrect answers, severely un…
Visual Question Answering