paper-with-me

Papers

Understanding How Humans Inject Knowledge into Machine Learning Workflows through Visual Analytics

2026-07-01 · Yiwen Xing, Philip Beaucamp, Joyraj Chakraborty, Afrah Farea, Yuanzhe Jin, Saiful Khan, Gennady Andrienko, Natalia Andrienko, Min Chen arxiv

Visual analytics (VA) plays an increasingly important role in supporting machine learning (ML) workflows. In the field of visualization, such approaches and techniques are referred to as VIS4ML. While ML models are mostly learned automatically, the corresponding ML workflows receive a variety of human inputs, such as data labelling, feature engineering, model architecture designing, hyper-parameter tuning, and so on. In this work, we surveyed over 200 VIS4ML papers to gain an understanding of how humans inject their knowledge into ML workflows through interactive visualization. We collected a corpus of VIS4ML papers from the IEEE VIS conferences in the past decade. We developed a coding scheme to facilitate the literature research from four perspectives: characteristics of ML, visualization, interaction, and actions. The analysis of the coded dataset allows us to observe different pathways that transfer human knowledge to ML workflows via interactive visualization. Building on the analysis, we explain the phenomena of VIS4ML using the conceptual model that views VA as model building and the information-theoretic cost-benefit analysis that reasons VA as for optimizing ML workflows. This work provides unequivocal evidence showing the merits of using VA in ML workflows. The full list of surveyed papers, along with all analysis results and figures, is available at https://vis4ml4hd.github.io/ml-knowledge-inject-va/.

📄 PDF Abstract BibTeX arXiv:2607.00969

Code (0)

등록된 구현이 없습니다.

Tasks

Feature Engineering

Similar Papers 제목 키워드 기반

Causal Discovery and Knowledge Injection for Contestable Neural Networks (with Appendices)

2022-05-19 · Fabrizio Russo, Francesca Toni

Neural networks have proven to be effective at solving machine learning tasks but it is unclear whether they learn any relevant causal relationships, while their black-box nature makes it difficult for modellers to under…

Causal Discovery

Towards Versatile and Efficient Visual Knowledge Integration into Pre-trained Language Models with Cross-Modal Adapters

2023-05-12 · Xinyun Zhang, Haochen Tan, Han Wu, Bei Yu

Humans learn language via multi-modal knowledge. However, due to the text-only pre-training scheme, most existing pre-trained language models (PLMs) are hindered from the multi-modal information. To inject visual knowled…

Natural Language Understanding

Commonsense Reasoning in Computer Vision: Foundations, Recent Advancements, and Future Directions

2026-09-04 · Bahar Uddin Mahmud, Sumit Barua, Guan Yue Hong, Ajay Gupta 외 arxiv

Commonsense reasoning in computer vision encompasses integrating visual data and contextual knowledge, crucial for enhancing AI's understanding of everyday scenarios. This understanding not only improves machine learning…

Object RecognitionKnowledge Graphs

CausalBERT: Injecting Causal Knowledge Into Pre-trained Models with Minimal Supervision

2021-07-21 · Zhongyang Li, Xiao Ding, Kuo Liao, Bing Qin 외

Recent work has shown success in incorporating pre-trained models like BERT to improve NLP systems. However, existing pre-trained models lack of causal knowledge which prevents today's NLP systems from thinking like huma…

Causal Inference

Knowledge-enhanced Agents for Interactive Text Games

2023-05-08 · Prateek Chhikara, Jiarui Zhang, Filip Ilievski, Jonathan Francis 외

Communication via natural language is a key aspect of machine intelligence, and it requires computational models to learn and reason about world concepts, with varying levels of supervision. Significant progress has been…

Instruction FollowingKnowledge GraphsLanguage ModellingProcedural Text Understanding+3