paper-with-me

홈 › Papers

Interpretable pipelines with evolutionarily optimized modules for RL tasks with visual inputs

2022-02-10 · Leonardo Lucio Custode, Giovanni Iacca

The importance of explainability in AI has become a pressing concern, for which several explainable AI (XAI) approaches have been recently proposed. However, most of the available XAI techniques are post-hoc methods, which however may be only partially reliable, as they do not reflect exactly the state of the original models. Thus, a more direct way for achieving XAI is through interpretable (also called glass-box) models. These models have been shown to obtain comparable (and, in some cases, better) performance with respect to black-boxes models in various tasks such as classification and reinforcement learning. However, they struggle when working with raw data, especially when the input dimensionality increases and the raw inputs alone do not give valuable insights on the decision-making process. Here, we propose to use end-to-end pipelines composed of multiple interpretable models co-optimized by means of evolutionary algorithms, that allows us to decompose the decision-making process into two parts: computing high-level features from raw data, and reasoning on the extracted high-level features. We test our approach in reinforcement learning environments from the Atari benchmark, where we obtain comparable results (with respect to black-box approaches) in settings without stochastic frame-skipping, while performance degrades in frame-skipping settings.

📄 PDF Abstract BibTeX arXiv:2202.04943

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingEvolutionary AlgorithmsExplainable Artificial Intelligence (XAI)reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

PrismVAU: Prompt-Refined Inference System for Multimodal Video Anomaly Understanding

2026-01-06 · Iñaki Erregue, Kamal Nasrollahi, Sergio Escalera arxiv

Video Anomaly Understanding (VAU) extends traditional Video Anomaly Detection (VAD) by not only localizing anomalies but also describing and reasoning about their context. Existing VAU approaches often rely on fine-tuned…

Video Anomaly DetectionPrompt Engineering

Computing Evolutionarily Stable Strategies in Multiplayer Games

2025-11-25 · Sam Ganzfried arxiv

We present an algorithm for computing all evolutionarily stable strategies in nondegenerate normal-form games with three or more players.

Evolution imposes an inductive bias that alters and accelerates learning dynamics

2025-05-15 · Benjamin Midler, Alejandro Pan Vazquez

The learning dynamics of biological brains and artificial neural networks are of interest to both neuroscience and machine learning. A key difference between them is that neural networks are often trained from a randomly…

Few-Shot LearningInductive Bias

SmartRAG: Jointly Learn RAG-Related Tasks From the Environment Feedback

2024-10-22 · Jingsheng Gao, Linxu Li, Weiyuan Li, Yuzhuo Fu 외

RAG systems consist of multiple modules to work together. However, these modules are usually separately trained. We argue that a system like RAG that incorporates multiple modules should be jointly optimized to achieve o…

RAG

Lesson Learnt: Modularization of Deep Networks Allow Cross-Modality Reuse

2019-11-05 · Weilin Fu, Lennart Husvogt, Stefan Ploner James G. Fujimoto Andreas Maier

Fundus photography and Optical Coherence Tomography Angiography (OCT-A) are two commonly used modalities in ophthalmic imaging. With the development of deep learning algorithms, fundus image processing, especially retina…

DiagnosticRetinal Vessel SegmentationTransfer Learning