Interpretable Directed Diversity: Leveraging Model Explanations for Iterative Crowd Ideation
Feedback in creativity support tools can help crowdworkers to improve their ideations. However, current feedback methods require human assessment from facilitators or peers. This is not scalable to large crowds. We propose Interpretable Directed Diversity to automatically predict ideation quality and diversity scores, and provide AI explanations - Attribution, Contrastive Attribution, and Counterfactual Suggestions - to feedback on why ideations were scored (low), and how to get higher scores. These explanations provide multi-faceted feedback as users iteratively improve their ideations. We conducted formative and controlled user studies to understand the usage and usefulness of explanations to improve ideation diversity and quality. Users appreciated that explanation feedback helped focus their efforts and provided directions for improvement. This resulted in explanations improving diversity compared to no feedback or feedback with scores only. Hence, our approach opens opportunities for explainable AI towards scalable and rich feedback for iterative crowd ideation and creativity support tools.
Code (0)
등록된 구현이 없습니다.
Tasks
counterfactualDiversitySimilar Papers 제목 키워드 기반
Z-REx: Human-Interpretable GNN Explanations for Real Estate Recommendations
Transparency and interpretability are crucial for enhancing customer confidence and user engagement, especially when dealing with black-box Machine Learning (ML)-based recommendation systems. Modern recommendation system…
AttributeGraph Neural NetworkLink PredictionRecommendation SystemsCoGS: Model Agnostic Causality Constrained Counterfactual Explanations using goal-directed ASP
Machine learning models are increasingly used in critical areas such as loan approvals and hiring, yet they often function as black boxes, obscuring their decision-making processes. Transparency is crucial, as individual…
counterfactualDecision MakingExploring Energy Landscapes for Minimal Counterfactual Explanations: Applications in Cybersecurity and Beyond
Counterfactual explanations have emerged as a prominent method in Explainable Artificial Intelligence (XAI), providing intuitive and actionable insights into Machine Learning model decisions. In contrast to other traditi…
counterfactualExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)FairnessInterpretable3D: An Ad-Hoc Interpretable Classifier for 3D Point Clouds
3D decision-critical tasks urgently require research on explanations to ensure system reliability and transparency. Extensive explanatory research has been conducted on 2D images, but there is a lack in the 3D field. Fur…
3D Shape ClassificationTowards Interpretable Natural Language Understanding with Explanations as Latent Variables
Recently generating natural language explanations has shown very promising results in not only offering interpretable explanations but also providing additional information and supervision for prediction. However, existi…
Explanation GenerationNatural Language Understanding