paper-with-me

홈 › Papers

On Feasibility of Intent Obfuscating Attacks

2024-07-22 · ZhaoBin Li, Patrick Shafto

Intent obfuscation is a common tactic in adversarial situations, enabling the attacker to both manipulate the target system and avoid culpability. Surprisingly, it has rarely been implemented in adversarial attacks on machine learning systems. We are the first to propose using intent obfuscation to generate adversarial examples for object detectors: by perturbing another non-overlapping object to disrupt the target object, the attacker hides their intended target. We conduct a randomized experiment on 5 prominent detectors -- YOLOv3, SSD, RetinaNet, Faster R-CNN, and Cascade R-CNN -- using both targeted and untargeted attacks and achieve success on all models and attacks. We analyze the success factors characterizing intent obfuscating attacks, including target object confidence and perturb object sizes. We then demonstrate that the attacker can exploit these success factors to increase success rates for all models and attacks. Finally, we discuss main takeaways and legal repercussions.

📄 PDF Abstract BibTeX arXiv:2408.02674

Code (1)

zhaobin-li/intent-obfusc 공식 구현 pytorch

Tasks

Object

Methods 이 논문이 사용한 방법론

BNB Customer Service Number +1-833-534-1729 설명 없음
Average Pooling 설명 없음
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Batch Normalization 설명 없음
Residual Connection 설명 없음
RoIPool 설명 없음
Logistic Regression Logistic Regression, despite its name, is a linear model for classification rather than regression. Logistic regression is also known in the literature as logit regression,…
k-Means Clustering k-Means Clustering is a clustering algorithm that divides a training set into $k$ different clusters of examples that are near each other. It works by initializing $k$…

Similar Papers 제목 키워드 기반

Prompt Packer: Deceiving LLMs through Compositional Instruction with Hidden Attacks

2023-10-16 · Shuyu Jiang, Xingshu Chen, Rui Tang

Recently, Large language models (LLMs) with powerful general capabilities have been increasingly integrated into various Web applications, while undergoing alignment training to ensure that the generated content aligns w…

Ethics

Can LLMs Deeply Detect Complex Malicious Queries? A Framework for Jailbreaking via Obfuscating Intent

2024-05-06 · Shang Shang, Xinqiang Zhao, Zhongjiang Yao, Yepeng Yao 외

To demonstrate and address the underlying maliciousness, we propose a theoretical hypothesis and analytical approach, and introduce a new black-box jailbreak attack methodology named IntentObfuscator, exploiting this ide…

Intent Detection

Knowledge Return Oriented Prompting (KROP)

2024-06-11 · Jason Martin, Kenneth Yeung

Many Large Language Models (LLMs) and LLM-powered apps deployed today use some form of prompt filter or alignment to protect their integrity. However, these measures aren't foolproof. This paper introduces KROP, a prompt…

Investigating Detection and Obfuscation of Prompt Injection Attacks Against Software Reverse Engineering AI Agents

2026-05-29 · Brian Crawford, Patrick McClure arxiv

Agentic software reverse engineering systems are vulnerable to prompt injection attacks placed into the source code of executable binary files. This research demonstrates defensive tactics for detecting the presences of …

Review on the Feasibility of Adversarial Evasion Attacks and Defenses for Network Intrusion Detection Systems

2023-03-13 · Islam Debicha, Benjamin Cochez, Tayeb Kenaza, Thibault Debatty 외

Nowadays, numerous applications incorporate machine learning (ML) algorithms due to their prominent achievements. However, many studies in the field of computer vision have shown that ML can be fooled by intentionally cr…

Intrusion DetectionNetwork Intrusion Detection