paper-with-me

Papers

Misinforming LLMs: vulnerabilities, challenges and opportunities

2024-08-02 · Bo Zhou, Daniel Geißler, Paul Lukowicz

Large Language Models (LLMs) have made significant advances in natural language processing, but their underlying mechanisms are often misunderstood. Despite exhibiting coherent answers and apparent reasoning behaviors, LLMs rely on statistical patterns in word embeddings rather than true cognitive processes. This leads to vulnerabilities such as "hallucination" and misinformation. The paper argues that current LLM architectures are inherently untrustworthy due to their reliance on correlations of sequential patterns of word embedding vectors. However, ongoing research into combining generative transformer-based models with fact bases and logic programming languages may lead to the development of trustworthy LLMs capable of generating statements based on given truth and explaining their self-reasoning process.

📄 PDF Abstract BibTeX arXiv:2408.01168

Code (0)

등록된 구현이 없습니다.

Tasks

HallucinationMisinformationWord Embeddings

Similar Papers 제목 키워드 기반

Security of Deep Learning Methodologies: Challenges and Opportunities

2019-12-08 · Shahbaz Rezaei, Xin Liu

Despite the plethora of studies about security vulnerabilities and defenses of deep learning models, security aspects of deep learning methodologies, such as transfer learning, have been rarely studied. In this article, …

Deep LearningTransfer Learning

An Outlook on the Opportunities and Challenges of Multi-Agent AI Systems

2025-05-23 · Fangqiao Tian, an Luo, Jin Du, Xun Xian 외

Multi-agent AI systems (MAS) offer a promising framework for distributed intelligence, enabling collaborative reasoning, planning, and decision-making across autonomous agents. This paper provides a systematic outlook on…

Decision Making

Analysis of Threat-Based Manipulation in Large Language Models: A Dual Perspective on Vulnerabilities and Performance Enhancement Opportunities

2025-07-22 · Atil Samancioglu arxiv

Large Language Models (LLMs) demonstrate complex responses to threat-based manipulations, revealing both vulnerabilities and unexpected performance enhancement opportunities. This study presents a comprehensive analysis …

Prompt Engineering

Combating Misinformation in the Arab World: Challenges & Opportunities

2025-06-05 · Azza Abouzied, Firoj Alam, Raian Ali, Paolo Papotti

Misinformation and disinformation pose significant risks globally, with the Arab region facing unique vulnerabilities due to geopolitical instabilities, linguistic diversity, and cultural nuances. We explore these challe…

DiversityFact CheckingMisinformation

A Comprehensive Survey on the Security of Smart Grid: Challenges, Mitigations, and Future Research Opportunities

2024-07-10 · Arastoo Zibaeirad, Farnoosh Koleini, Shengping Bi, Tao Hou 외

In this study, we conduct a comprehensive review of smart grid security, exploring system architectures, attack methodologies, defense strategies, and future research opportunities. We provide an in-depth analysis of var…