Context-Awareness and Interpretability of Rare Occurrences for Discovery and Formalization of Critical Failure Modes
Vision systems are increasingly deployed in critical domains such as surveillance, law enforcement, and transportation. However, their vulnerabilities to rare or unforeseen scenarios pose significant safety risks. To address these challenges, we introduce Context-Awareness and Interpretability of Rare Occurrences (CAIRO), an ontology-based human-assistive discovery framework for failure cases (or CP - Critical Phenomena) detection and formalization. CAIRO by design incentivizes human-in-the-loop for testing and evaluation of criticality that arises from misdetections, adversarial attacks, and hallucinations in AI black-box models. Our robust analysis of object detection model(s) failures in automated driving systems (ADS) showcases scalable and interpretable ways of formalizing the observed gaps between camera perception and real-world contexts, resulting in test cases stored as explicit knowledge graphs (in OWL/XML format) amenable for sharing, downstream analysis, logical reasoning, and accountability.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge GraphsLogical Reasoningobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
A Rare Topic Discovery Model for Short Texts Based on Co-occurrence word Network
We provide a simple and general solution for the discovery of scarce topics in unbalanced short-text datasets, namely, a word co-occurrence network-based model CWIBTD, which can simultaneously address the sparsity and un…
Extreme Risk Mitigation in Reinforcement Learning using Extreme Value Theory
Risk-sensitive reinforcement learning (RL) has garnered significant attention in recent years due to the growing interest in deploying RL agents in real-world scenarios. A critical aspect of risk awareness involves model…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)RPG-AE: Neuro-Symbolic Graph Autoencoders with Rare Pattern Mining for Provenance-Based Anomaly Detection
Advanced Persistent Threats (APTs) are sophisticated, long-term cyberattacks that are difficult to detect because they operate stealthily and often blend into normal system behavior. This paper presents a neuro-symbolic …
Representation LearningAnomaly DetectionGenerating customized prompts for Zero-Shot Rare Event Medical Image Classification using LLM
Rare events, due to their infrequent occurrences, do not have much data, and hence deep learning techniques fail in estimating the distribution for such data. Open-vocabulary models represent an innovative approach to im…
DescriptiveEvent Detectionimage-classificationImage Classification+2Discrete Subgraph Sampling for Interpretable Graph based Visual Question Answering
Explainable artificial intelligence (XAI) aims to make machine learning models more transparent. While many approaches focus on generating explanations post-hoc, interpretable approaches, which generate the explanations …
Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)Question AnsweringVisual Question Answering