paper-with-me

Papers

Interactive Visual Learning for Stable Diffusion

2024-04-22 · Seongmin Lee, Benjamin Hoover, Hendrik Strobelt, Zijie J. Wang, Shengyun Peng, Austin Wright, Kevin Li, Haekyu Park, Haoyang Yang, Polo Chau

Diffusion-based generative models' impressive ability to create convincing images has garnered global attention. However, their complex internal structures and operations often pose challenges for non-experts to grasp. We introduce Diffusion Explainer, the first interactive visualization tool designed to elucidate how Stable Diffusion transforms text prompts into images. It tightly integrates a visual overview of Stable Diffusion's complex components with detailed explanations of their underlying operations. This integration enables users to fluidly transition between multiple levels of abstraction through animations and interactive elements. Offering real-time hands-on experience, Diffusion Explainer allows users to adjust Stable Diffusion's hyperparameters and prompts without the need for installation or specialized hardware. Accessible via users' web browsers, Diffusion Explainer is making significant strides in democratizing AI education, fostering broader public access. More than 7,200 users spanning 113 countries have used our open-sourced tool at https://poloclub.github.io/diffusion-explainer/. A video demo is available at https://youtu.be/MbkIADZjPnA.

📄 PDF Abstract BibTeX arXiv:2404.16069

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Diffusion Explainer: Visual Explanation for Text-to-image Stable Diffusion

2023-05-04 · Seongmin Lee, Benjamin Hoover, Hendrik Strobelt, Zijie J. Wang 외

Diffusion-based generative models' impressive ability to create convincing images has garnered global attention. However, their complex structures and operations often pose challenges for non-experts to grasp. We present…

Image Generation

Beyond Inserting: Learning Identity Embedding for Semantic-Fidelity Personalized Diffusion Generation

2024-01-31 · Yang Li, Songlin Yang, Wei Wang, Jing Dong

Advanced diffusion-based Text-to-Image (T2I) models, such as the Stable Diffusion Model, have made significant progress in generating diverse and high-quality images using text prompts alone. However, when non-famous use…

Image GenerationPersonalized Image Generation

Attention Dynamics in Diffusion Models: A Visual Analytics Framework for Human-AI Collaboration

2026-06-28 · Yiran Xiao, George Legrady arxiv

Diffusion-based text-to-image models can synthesize complex and highly structured visual content, yet the emergence and evolution of semantic structure remain difficult to interpret. Many existing workflows rely on aggre…

ChannelExplorer: Exploring Class Separability Through Activation Channel Visualization

2025-05-06 · Md Rahat-uz- Zaman, Bei Wang, Paul Rosen

Deep neural networks (DNNs) achieve state-of-the-art performance in many vision tasks, yet understanding their internal behavior remains challenging, particularly how different layers and activation channels contribute t…

Human-AI Co-Creation: A Framework for Collaborative Design in Intelligent Systems

2025-07-22 · Zhangqi Liu arxiv

As artificial intelligence (AI) continues to evolve from a back-end computational tool into an interactive, generative collaborator, its integration into early-stage design processes demands a rethinking of traditional w…