paper-with-me

홈 › Papers

Decomposed Trust: Privacy, Adversarial Robustness, Ethics, and Fairness in Low-Rank LLMs

2025-11-27 · Daniel Agyei Asante, Md Mokarram Chowdhury, Yang Li arxiv

Large language models (LLMs) have driven major advances across domains, yet their massive size hinders deployment in resource-constrained settings. Low-rank factorization addresses this challenge by compressing models to effectively reduce their computation and memory consumption while maintaining accuracy. While these compressed models boast benign performance and system-level advantages, their trustworthiness implications remain poorly understood. In this paper, we present the first comprehensive study of how low-rank factorization affects LLM trustworthiness across privacy, adversarial robustness, ethics, and fairness, complemented by an explainability-driven analysis of the internal mechanisms behind these trust-related changes. We evaluate multiple LLMs of different sizes and architectures compressed with various low-rank factorization algorithms, revealing key insights: (1) low-rank factorization preserves training data privacy but weakens the protection of personally identifiable information during conversations; (2) adversarial robustness is generally enhanced under compression; (3) ethics degrades in zero-shot prompting but partially recovers in few-shot prompting; (4) fairness declines under compression. Beyond compression, we investigate how model scale and fine-tuning affect trustworthiness. Additionally, to move beyond black-box analysis, we employ a gradient-based attribution to identify which layers of LLMs contribute most to adversarial robustness.

📄 PDF Abstract BibTeX arXiv:2511.22099

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial Robustness

Similar Papers 제목 키워드 기반

DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Models

2023-06-20 · NeurIPS 2023 11 · Boxin Wang, Weixin Chen, Hengzhi Pei, Chulin Xie 외

Generative Pre-trained Transformer (GPT) models have exhibited exciting progress in their capabilities, capturing the interest of practitioners and the public alike. Yet, while the literature on the trustworthiness of GP…

Adversarial RobustnessEthicsFairness

SciTrust 2.0: A Comprehensive Framework for Evaluating Trustworthiness of Large Language Models in Scientific Applications

2025-10-29 · Emily Herron, Junqi Yin, Feiyi Wang arxiv

Large language models (LLMs) have demonstrated transformative potential in scientific research, yet their deployment in high-stakes contexts raises significant trustworthiness concerns. Here, we introduce SciTrust 2.0, a…

Adversarial RobustnessSemantic Similarity

How Trustworthy are Open-Source LLMs? An Assessment under Malicious Demonstrations Shows their Vulnerabilities

2023-11-15 · Lingbo Mo, Boshi Wang, Muhao Chen, Huan Sun

The rapid progress in open-source Large Language Models (LLMs) is significantly driving AI development forward. However, there is still a limited understanding of their trustworthiness. Deploying these models at scale wi…

EthicsFairnessHallucinationInstruction Following+1

Fault Tolerance of Neural Networks in Adversarial Settings

2019-10-30 · Vasisht Duddu, N. Rajesh Pillai, D. Vijay Rao, Valentina E. Balas

Artificial Intelligence systems require a through assessment of different pillars of trust, namely, fairness, interpretability, data and model privacy, reliability (safety) and robustness against against adversarial atta…

Adversarial RobustnessFairness

A Study on the Framework for Evaluating the Ethics and Trustworthiness of Generative AI

2025-08-30 · Cheonsu Jeong, Seunghyun Lee, Seonhee Jeong, Sungsu Kim arxiv

This study provides an in_depth analysis of the ethical and trustworthiness challenges emerging alongside the rapid advancement of generative artificial intelligence (AI) technologies and proposes a comprehensive framewo…