DAMAGE: Detecting Adversarially Modified AI Generated Text
AI humanizers are a new class of online software tools meant to paraphrase and rewrite AI-generated text in a way that allows them to evade AI detection software. We study 19 AI humanizer and paraphrasing tools and qualitatively assess their effects and faithfulness in preserving the meaning of the original text. We show that many existing AI detectors fail to detect humanized text. Finally, we demonstrate a robust model that can detect humanized AI text while maintaining a low false positive rate using a data-centric augmentation approach. We attack our own detector, training our own fine-tuned model optimized against our detector's predictions, and show that our detector's cross-humanizer generalization is sufficient to remain robust to this attack.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
NCL-UoR at SemEval-2025 Task 3: Detecting Multilingual Hallucination and Related Observable Overgeneration Text Spans with Modified RefChecker and Modified SeflCheckGPT
SemEval-2025 Task 3 (Mu-SHROOM) focuses on detecting hallucinations in content generated by various large language models (LLMs) across multiple languages. This task involves not only identifying the presence of hallucin…
HallucinationSuperpixel-Based Building Damage Detection from Post-earthquake Imagery Using Deep Neural Networks
Building damage detection after natural disasters like earthquakes is crucial for initiating effective emergency response actions. Remotely sensed very high spatial resolution (VHR) imagery can provide vital information …
DenoisingRAGSemantic SimilaritySemantic Textual SimilarityFraudBench: A Multimodal Benchmark for Detecting AI-Generated Fraudulent Refund Evidence
Artificial Intelligence (AI)-generated images have become increasingly realistic and readily adaptable to concrete real-world claims, creating new challenges for verifying visual evidence. A concrete emerging risk is AI-…
Image EditingDetecting the Adversarially-Learned Injection Attacks via Knowledge Graphs
ABSTRACT: Over the past two decades, many studies have devoted a good deal of attention to detect injection attacks in recommender systems. However, most of the studies mainly focus on detecting the heuristically-generat…
Knowledge GraphsRecommendation SystemsImproving the Perturbation-Based Explanation of Deepfake Detectors Through the Use of Adversarially-Generated Samples
In this paper, we introduce the idea of using adversarially-generated samples of the input images that were classified as deepfakes by a detector, to form perturbation masks for inferring the importance of different inpu…
BenchmarkingDeepFake DetectionFace Swapping