paper-with-me

홈 › Papers

Generative AI for Visualization: State of the Art and Future Directions

2024-04-28 · Yilin Ye, Jianing Hao, Yihan Hou, Zhan Wang, Shishi Xiao, Yuyu Luo, Wei Zeng

Generative AI (GenAI) has witnessed remarkable progress in recent years and demonstrated impressive performance in various generation tasks in different domains such as computer vision and computational design. Many researchers have attempted to integrate GenAI into visualization framework, leveraging the superior generative capacity for different operations. Concurrently, recent major breakthroughs in GenAI like diffusion model and large language model have also drastically increase the potential of GenAI4VIS. From a technical perspective, this paper looks back on previous visualization studies leveraging GenAI and discusses the challenges and opportunities for future research. Specifically, we cover the applications of different types of GenAI methods including sequence, tabular, spatial and graph generation techniques for different tasks of visualization which we summarize into four major stages: data enhancement, visual mapping generation, stylization and interaction. For each specific visualization sub-task, we illustrate the typical data and concrete GenAI algorithms, aiming to provide in-depth understanding of the state-of-the-art GenAI4VIS techniques and their limitations. Furthermore, based on the survey, we discuss three major aspects of challenges and research opportunities including evaluation, dataset, and the gap between end-to-end GenAI and generative algorithms. By summarizing different generation algorithms, their current applications and limitations, this paper endeavors to provide useful insights for future GenAI4VIS research.

📄 PDF Abstract BibTeX arXiv:2404.18144

Code (0)

등록된 구현이 없습니다.

Tasks

Graph GenerationLanguage ModellingLarge Language Model

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Visual Knowledge Discovery with Artificial Intelligence: Challenges and Future Directions

2022-05-03 · Boris Kovalerchuk, Răzvan Andonie, Nuno Datia, Kawa Nazemi 외

This volume is devoted to the emerging field of Integrated Visual Knowledge Discovery that combines advances in Artificial Intelligence/Machine Learning (AI/ML) and Visualization/Visual Analytics. Chapters included are e…

Natural Language Generation for Visualizations: State of the Art, Challenges and Future Directions

2024-09-29 · Enamul Hoque, Mohammed Saidul Islam

Natural language and visualization are two complementary modalities of human communication that play a crucial role in conveying information effectively. While visualizations help people discover trends, patterns, and an…

Text Generation

Machine Learning and Visualization in Clinical Decision Support: Current State and Future Directions

2019-06-06 · Gal Levy-Fix, Gilad J. Kuperman, Noémie Elhadad

Deep learning, an area of machine learning, is set to revolutionize patient care. But it is not yet part of standard of care, especially when it comes to individual patient care. In fact, it is unclear to what extent dat…

BIG-bench Machine LearningDecision Making

Captioning Visualizations with Large Language Models (CVLLM): A Tutorial

2024-06-27 · Giuseppe Carenini, Jordon Johnson, Ali Salamatian

Automatically captioning visualizations is not new, but recent advances in large language models(LLMs) open exciting new possibilities. In this tutorial, after providing a brief review of Information Visualization (InfoV…

The State of the Art in Integrating Machine Learning into Visual Analytics

2018-02-22 · A. Endert, W. Ribarsky, C. Turkay, W Wong 외

Visual analytics systems combine machine learning or other analytic techniques with interactive data visualization to promote sensemaking and analytical reasoning. It is through such techniques that people can make sense…

BIG-bench Machine LearningData Visualization