paper-with-me

홈 › Papers

TriGuard: Testing Model Safety with Attribution Entropy, Verification, and Drift

2025-06-17 · Dipesh Tharu Mahato, Rohan Poudel, Pramod Dhungana

Deep neural networks often achieve high accuracy, but ensuring their reliability under adversarial and distributional shifts remains a pressing challenge. We propose TriGuard, a unified safety evaluation framework that combines (1) formal robustness verification, (2) attribution entropy to quantify saliency concentration, and (3) a novel Attribution Drift Score measuring explanation stability. TriGuard reveals critical mismatches between model accuracy and interpretability: verified models can still exhibit unstable reasoning, and attribution-based signals provide complementary safety insights beyond adversarial accuracy. Extensive experiments across three datasets and five architectures show how TriGuard uncovers subtle fragilities in neural reasoning. We further demonstrate that entropy-regularized training reduces explanation drift without sacrificing performance. TriGuard advances the frontier in robust, interpretable model evaluation.

📄 PDF Abstract BibTeX arXiv:2506.14217

Code (1)

dipeshbabu/triguard 공식 구현 pytorch

Similar Papers 제목 키워드 기반

AttriGuard: A Practical Defense Against Attribute Inference Attacks via Adversarial Machine Learning

2018-05-13 · Jinyuan Jia, Neil Zhenqiang Gong

Users in various web and mobile applications are vulnerable to attribute inference attacks, in which an attacker leverages a machine learning classifier to infer a target user's private attributes (e.g., location, sexual…

AttributeBIG-bench Machine Learning

Finite Model Theory of the Triguarded Fragment and Related Logics

2021-01-21 · Emanuel Kieroński, Sebastian Rudolph

The Triguarded Fragment (TGF) is among the most expressive decidable fragments of first-order logic, subsuming both its two-variable and guarded fragments without equality. We show that the TGF has the finite model prope…

A Review of Testing Object-Based Environment Perception for Safe Automated Driving

2021-02-16 · Michael Hoss, Maike Scholtes, Lutz Eckstein

Safety assurance of automated driving systems must consider uncertain environment perception. This paper reviews literature addressing how perception testing is realized as part of safety assurance. We focus on testing f…

BenchmarkingSensor Modeling

Simulation-based Safety Assurance for an AVP System incorporating Learning-Enabled Components

2023-09-28 · Hasan Esen, Brian Hsuan-Cheng Liao

There have been major developments in Automated Driving (AD) and Driving Assist Systems (ADAS) in recent years. However, their safety assurance, thus methodologies for testing, verification and validation AD/ADAS safety-…

object-detectionObject Detection

Safety Testing LLM Agents at Scale: From Risk Discovery to Evidence-Grounded Verification

2026-07-02 · Yunhao Feng, Ruixiao Lin, Ming Wen, Qinqin He 외 arxiv

LLM agents increasingly perform autonomous actions through external tools, leading to complex and evolving safety risks. However, existing safety testing targets expert-designed safety violations, and the corresponding o…