paper-with-me

Papers

In-Context Explainers: Harnessing LLMs for Explaining Black Box Models

2023-10-09 · Nicholas Kroeger, Dan Ley, Satyapriya Krishna, Chirag Agarwal, Himabindu Lakkaraju

Recent advancements in Large Language Models (LLMs) have demonstrated exceptional capabilities in complex tasks like machine translation, commonsense reasoning, and language understanding. One of the primary reasons for the adaptability of LLMs in such diverse tasks is their in-context learning (ICL) capability, which allows them to perform well on new tasks by simply using a few task samples in the prompt. Despite their effectiveness in enhancing the performance of LLMs on diverse language and tabular tasks, these methods have not been thoroughly explored for their potential to generate post hoc explanations. In this work, we carry out one of the first explorations to analyze the effectiveness of LLMs in explaining other complex predictive models using ICL. To this end, we propose a novel framework, In-Context Explainers, comprising of three novel approaches that exploit the ICL capabilities of LLMs to explain the predictions made by other predictive models. We conduct extensive analysis with these approaches on real-world tabular and text datasets and demonstrate that LLMs are capable of explaining other predictive models similar to state-of-the-art post hoc explainers, opening up promising avenues for future research into LLM-based post hoc explanations of complex predictive models.

📄 PDF Abstract BibTeX arXiv:2310.05797

Code (1)

AI4LIFE-GROUP/LLM_Explainer 공식 구현 pytorch

Tasks

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)In-Context LearningMachine Translation

Methods 이 논문이 사용한 방법론

HOC 설명 없음

Similar Papers 제목 키워드 기반

Axiomatic Characterisations of Sample-based Explainers

2024-08-09 · Leila Amgoud, Martin C. Cooper, Salim Debbaoui

Explaining decisions of black-box classifiers is both important and computationally challenging. In this paper, we scrutinize explainers that generate feature-based explanations from samples or datasets. We start by pres…

What's wrong with this video? Comparing Explainers for Deepfake Detection

2021-05-12 · Samuele Pino, Mark James Carman, Paolo Bestagini

Deepfakes are computer manipulated videos where the face of an individual has been replaced with that of another. Software for creating such forgeries is easy to use and ever more popular, causing serious threats to pers…

DeepFake DetectionFace Swapping

Analysis of Explainers of Black Box Deep Neural Networks for Computer Vision: A Survey

2019-11-27 · Vanessa Buhrmester, David Münch, Michael Arens

Deep Learning is a state-of-the-art technique to make inference on extensive or complex data. As a black box model due to their multilayer nonlinear structure, Deep Neural Networks are often criticized to be non-transpar…

Decision MakingSurvey

Evaluating the Explainers: Black-Box Explainable Machine Learning for Student Success Prediction in MOOCs

2022-07-01 · Vinitra Swamy, Bahar Radmehr, Natasa Krco, Mirko Marras 외

Neural networks are ubiquitous in applied machine learning for education. Their pervasive success in predictive performance comes alongside a severe weakness, the lack of explainability of their decisions, especially rel…

BIG-bench Machine LearningFeature Importance

From Model Explanation to Data Misinterpretation: Uncovering the Pitfalls of Post Hoc Explainers in Business Research

2024-08-30 · Ronilo Ragodos, Tong Wang, Lu Feng, Yu 외

Machine learning models have been increasingly used in business research. However, most state-of-the-art machine learning models, such as deep neural networks and XGBoost, are black boxes in nature. Therefore, post hoc e…