paper-with-me

Papers

Data-Driven and Stealthy Deactivation of Safety Filters

2024-12-02 · Daniel Arnström, André M. H. Teixeira

Safety filters ensure that control actions that are executed are always safe, no matter the controller in question. Previous work has proposed a simple and stealthy false-data injection attack for deactivating such safety filters. This attack injects false sensor measurements to bias state estimates toward the interior of a safety region, making the safety filter accept unsafe control actions. The attack does, however, require the adversary to know the dynamics of the system, the safety region used in the safety filter, and the observer gain. In this work we relax these requirements and show how a similar data-injection attack can be performed when the adversary only observes the input and output of the observer that is used by the safety filter, without any a priori knowledge about the system dynamics, safety region, or observer gain. In particular, the adversary uses the observed data to identify a state-space model that describes the observer dynamics, and then approximates a safety region in the identified embedding. We exemplify the data-driven attack on an inverted pendulum, where we show how the attack can make the system leave a safe set, even when a safety filter is supposed to stop this from happening.

📄 PDF Abstract BibTeX arXiv:2412.01346

Code (1)

darnstrom/ddsd-sf 공식 구현

Similar Papers 제목 키워드 기반

Jailbreaks on Vision Language Model via Multimodal Reasoning

2026-01-29 · Aarush Noheria, Yuguang Yao arxiv

Vision-language models (VLMs) have become central to tasks such as visual question answering, image captioning, and text-to-image generation. However, their outputs are highly sensitive to prompt variations, which can re…

Visual Question AnsweringText-to-Image GenerationMultimodal ReasoningImage Captioning

From Raw Data to Safety: Reducing Conservatism by Set Expansion

2024-03-23 · Mohammad Bajelani, Klaske van Heusden

In response to safety concerns associated with learning-based algorithms, safety filters have been proposed as a modular technique. Generally, these filters heavily rely on the system's model, which is contradictory if t…

LEMMA

Ensuring Resilience Against Stealthy Attacks on Cyber-Physical Systems

2022-05-01 · Paul Griffioen, Bruce H. Krogh, Bruno Sinopoli

This article provides a tool for analyzing mechanisms that aim to achieve resilience against stealthy, or undetectable, attacks on cyber-physical systems (CPSs). We consider attackers who are able to corrupt all of the i…

A new fMRI data analysis method using cross validation: Negative BOLD responses may be the deactivations of interneurons

2017-12-10

Although functional magnetic resonance imaging (fMRI) is widely used for the study of brain functions, the blood oxygenation level dependent (BOLD) effect is incompletely understood. Particularly, negative BOLD responses…

Beyond Max Tokens: Stealthy Resource Amplification via Tool Calling Chains in LLM Agents

2026-01-16 · Kaiyu Zhou, Yongsen Zheng, Yicheng He, Meng Xue 외 arxiv

The agent--tool interaction loop is a critical attack surface for modern Large Language Model (LLM) agents. Existing denial-of-service (DoS) attacks typically function at the user-prompt or retrieval-augmented generation…