paper-with-me

홈 › Papers

Evaluating LLM-Based Process Explanations under Progressive Behavioral-Input Reduction

2025-10-10 · P. van Oerle, R. H. Bemthuis, F. A. Bukhsh arxiv

Large Language Models (LLMs) are increasingly used to generate textual explanations of process models discovered from event logs. Producing explanations from large behavioral abstractions (e.g., directly-follows graphs or Petri nets) can be computationally expensive. This paper reports an exploratory evaluation of explanation quality under progressive behavioral-input reduction, where models are discovered from progressively smaller prefixes of a fixed log. Our pipeline (i) discovers models at multiple input sizes, (ii) prompts an LLM to generate explanations, and (iii) uses a second LLM to assess completeness, bottleneck identification, and suggested improvements. On synthetic logs, explanation quality is largely preserved under moderate reduction, indicating a practical cost-quality trade-off. The study is exploratory, as the scores are LLM-based (comparative signals rather than ground truth) and the data are synthetic. The results suggest a path toward more computationally efficient, LLM-assisted process analysis in resource-constrained settings.

📄 PDF Abstract BibTeX arXiv:2510.09732

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Evaluating the Ability of Explanations to Disambiguate Models in a Rashomon Set

2026-01-13 · Kaivalya Rawal, Eoin Delaney, Zihao Fu, Sandra Wachter 외 arxiv

Explainable artificial intelligence (XAI) is concerned with producing explanations indicating the inner workings of models. For a Rashomon set of similarly performing models, explanations provide a way of disambiguating …

Order Matters: Generating Progressive Explanations for Planning Tasks in Human-Robot Teaming

2020-04-16 · Mehrdad Zakershahrak, Shashank Rao Marpally, Akshay Sharma, Ze Gong 외

Prior work on generating explanations in a planning and decision-making context has focused on providing the rationale behind an AI agent's decision making. While these methods provide the right explanations from the exp…

Decision MakingExplanation GenerationReinforcement Learning

Explaining the Black-box Smoothly- A Counterfactual Approach

2021-01-11 · Sumedha Singla, Motahhare Eslami, Brian Pollack, Stephen Wallace 외

We propose a BlackBox Counterfactual Explainer, designed to explain image classification models for medical applications. Classical approaches (e.g., saliency maps) that assess feature importance do not explain "how" ima…

counterfactualCounterfactual ExplanationDecision MakingDiagnostic+5

Progressive Explanation Generation for Human-robot Teaming

2019-02-02 · Yu Zhang, Mehrdad Zakershahrak

Generating explanation to explain its behavior is an essential capability for a robotic teammate. Explanations help human partners better understand the situation and maintain trust of their teammates. Prior work on robo…

Decision MakingExplanation Generation

Beware the Rationalization Trap! When Language Model Explainability Diverges from our Mental Models of Language

2022-07-14 · Rita Sevastjanova, Mennatallah El-Assady

Language models learn and represent language differently than humans; they learn the form and not the meaning. Thus, to assess the success of language model explainability, we need to consider the impact of its divergenc…

Language ModelingLanguage Modelling