paper-with-me

홈 › Papers

SoK: Security and Privacy of Foundation-Model-Powered Robots

2026-06-15 · Xueluan Gong, Chen Chen, Jinxin Liu, Qian Wang, Kwok-Yan Lam arxiv

Foundation models are reshaping robotics by enabling robots to interpret open-ended instructions, reason over multimodal contexts, and operate in complex, open-world environments. However, their integration also introduces security and privacy (S&P) risks that extend beyond the FMs themselves to embodied execution pipelines, supporting ecosystems, and broader governance impacts. Existing literature reviews provide valuable insights but often focus on specific FM types, risk categories, mitigation strategies, or trust boundaries. Consequently, the field lacks a unified structure for analyzing where risks originate, how they propagate across robotic systems, and where mitigations should intervene. To address this gap, we propose a progressive F-E-S-G structural boundary framework for analyzing the S&P of FM-powered robots. The framework comprises four layers: the Foundation model layer (F), Embodied system layer (E), Supporting ecosystem layer (S), and Governance impact layer (G). Building on this structure, we develop a multi-level taxonomy that organizes prior studies along three levels: F-E-S-G trust boundary, security-privacy concerns, and risk-mitigation perspectives. We further annotate each study using fine-grained coding attributes, including target, lifecycle stage, mechanism, system access, and effect. Guided by this framework and taxonomy, we systematize 96 papers. Our analysis uncovers multiple threat patterns, defense mismatches, and evaluation gaps that are difficult to identify from a single-boundary perspective. Based on these findings, we identify open challenges and future directions to provide a research agenda for developing secure, privacy-preserving, and responsibly governed FM-powered robotic systems.

📄 PDF Abstract BibTeX arXiv:2606.16788

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Assessing Trust in Construction AI-Powered Collaborative Robots using Structural Equation Modeling

2023-08-28 · Newsha Emaminejad, Lisa Kath, Reza Akhavian

This study aimed to investigate the key technical and psychological factors that impact the architecture, engineering, and construction (AEC) professionals' trust in collaborative robots (cobots) powered by artificial in…

"Is it always watching? Is it always listening?" Exploring Contextual Privacy and Security Concerns Toward Domestic Social Robots

2025-07-14 · Henry Bell, Jabari Kwesi, Hiba Laabadli, Pardis Emami-Naeini arxiv

Equipped with artificial intelligence (AI) and advanced sensing capabilities, social robots are gaining interest among consumers in the United States. These robots seem like a natural evolution of traditional smart home …

Reframing Human-Robot Interaction Through Extended Reality: Unlocking Safer, Smarter, and More Empathic Interactions with Virtual Robots and Foundation Models

2025-12-02 · Yuchong Zhang, Yong Ma, Danica Kragic arxiv

This perspective reframes human-robot interaction (HRI) through extended reality (XR), arguing that virtual robots powered by large foundation models (FMs) can serve as cognitively grounded, empathic agents. Unlike physi…

10 Security and Privacy Problems in Large Foundation Models

2021-10-28 · Jinyuan Jia, Hongbin Liu, Neil Zhenqiang Gong

Foundation models--such as GPT, CLIP, and DINO--have achieved revolutionary progress in the past several years and are commonly believed to be a promising approach for general-purpose AI. In particular, self-supervised l…

Anomaly Detection In Surveillance VideosSelf-Supervised Learning

Large Model Based Agents: State-of-the-Art, Cooperation Paradigms, Security and Privacy, and Future Trends

2024-09-22 · Yuntao Wang, Yanghe Pan, Zhou Su, Yi Deng 외

With the rapid advancement of large models (LMs), the development of general-purpose intelligent agents powered by LMs has become a reality. It is foreseeable that in the near future, LM-driven general AI agents will ser…

Mixed Reality