o-MEGA: Optimized Methods for Explanation Generation and Analysis
The proliferation of transformer-based language models has revolutionized NLP domain while simultaneously introduced significant challenges regarding model transparency and trustworthiness. The complexity of achieving explainable systems in this domain is evidenced by the extensive array of explanation methods and evaluation metrics developed by researchers. To address the challenge of selecting optimal explainability approaches, we present \textbf{\texttt{o-mega}}, a hyperparameter optimization tool designed to automatically identify the most effective explainable AI methods and their configurations within the semantic matching domain. We evaluate o-mega on a post-claim matching pipeline using a curated dataset of social media posts paired with refuting claims. Our tool systematically explores different explainable methods and their hyperparameters, demonstrating improved transparency in automated fact-checking systems. As a result, such automated optimization of explanation methods can significantly enhance the interpretability of claim-matching models in critical applications such as misinformation detection, contributing to more trustworthy and transparent AI systems.
Code (0)
등록된 구현이 없습니다.
Tasks
Hyperparameter OptimizationExplanation GenerationSimilar Papers 제목 키워드 기반
MEGAN: Multi-Explanation Graph Attention Network
We propose a multi-explanation graph attention network (MEGAN). Unlike existing graph explainability methods, our network can produce node and edge attributional explanations along multiple channels, the number of which …
Explainable artificial intelligenceGraph AttentionGraph RegressionregressionAdaptive Group-Based Counterfactual Explanations for Time-Series Rehabilitation Data
Counterfactual explanations (CEs) for multivariate time-series classifiers are often difficult to interpret in domains where experts reason in terms of semantic feature groups rather than individual channels. In rehabili…
Balancing Explicability and Explanation in Human-Aware Planning
Human aware planning requires an agent to be aware of the intentions, capabilities and mental model of the human in the loop during its decision process. This can involve generating plans that are explicable to a human o…
Decision MakingExplanation GenerationTask PlanningSemi-supervised learning in unbalanced and heterogeneous networks
Community detection was a hot topic on network analysis, where the main aim is to perform unsupervised learning or clustering in networks. Recently, semi-supervised learning has received increasing attention among resear…
ClusteringCommunity DetectionFindings of MEGA: Maths Explanation with LLMs using the Socratic Method for Active Learning
This paper presents an intervention study on the effects of the combined methods of (1) the Socratic method, (2) Chain of Thought (CoT) reasoning, (3) simplified gamification and (4) formative feedback on university stud…
Active Learning