paper-with-me

Papers

Network Bending: Expressive Manipulation of Deep Generative Models

2020-05-25 · Terence Broad, Frederic Fol Leymarie, Mick Grierson

We introduce a new framework for manipulating and interacting with deep generative models that we call network bending. We present a comprehensive set of deterministic transformations that can be inserted as distinct layers into the computational graph of a trained generative neural network and applied during inference. In addition, we present a novel algorithm for analysing the deep generative model and clustering features based on their spatial activation maps. This allows features to be grouped together based on spatial similarity in an unsupervised fashion. This results in the meaningful manipulation of sets of features that correspond to the generation of a broad array of semantically significant features of the generated images. We outline this framework, demonstrating our results on state-of-the-art deep generative models trained on several image datasets. We show how it allows for the direct manipulation of semantically meaningful aspects of the generative process as well as allowing for a broad range of expressive outcomes.

📄 PDF Abstract BibTeX arXiv:2005.12420

Code (1)

terrybroad/network-bending 공식 구현 pytorch

Tasks

Clustering

Methods 이 논문이 사용한 방법론

Path Length Regularization 설명 없음
Weight Demodulation 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
HuMan(Expedia)||How do I get a human at Expedia? How do I get a human at Expedia? How Do I Get a Human at Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Real-Time Help & Exclusive…
R1 Regularization R_INLINE_MATH_1 Regularization is a regularization technique and gradient penalty for training [generative adversarial…
StyleGAN2 StyleGAN2 is a generative adversarial network that builds on StyleGAN with several improvements. First, [adaptive instance…

Similar Papers 제목 키워드 기반

Explainability-in-Action: Enabling Expressive Manipulation and Tacit Understanding by Bending Diffusion Models in ComfyUI

2025-08-10 · Ahmed M. Abuzuraiq, Philippe Pasquier arxiv

Explainable AI (XAI) in creative contexts can go beyond transparency to support artistic engagement, modifiability, and sustained practice. While curated datasets and training human-scale models can offer artists greater…

Real-Time AttentionBender: Granular Interactive Network Bending of Video Diffusion Transformers

2026-04-24 · Adam Cole, Rebecca Fiebrink, Mick Grierson arxiv

Generative video models have achieved remarkable visual fidelity, yet their prompt-only interface offers thin creative agency and obscures the model's material process from the artists working with it. We present Real-Ti…

Network Bending of Diffusion Models for Audio-Visual Generation

2024-06-28 · Luke Dzwonczyk, Carmine Emanuele Cella, David Ban

In this paper we present the first steps towards the creation of a tool which enables artists to create music visualizations using pre-trained, generative, machine learning models. First, we investigate the application o…

Image Generation

Assessing Neural Network Robustness via Adversarial Pivotal Tuning

2022-11-17 · Peter Ebert Christensen, Vésteinn Snæbjarnarson, Andrea Dittadi, Serge Belongie 외

The robustness of image classifiers is essential to their deployment in the real world. The ability to assess this resilience to manipulations or deviations from the training data is thus crucial. These modifications hav…

Attribute

Synthesizing Human Faces using Latent Space Factorization and Local Weights (Extended Version)

2021-07-19 · Minyoung Kim, Young J. Kim

We propose a 3D face generative model with local weights to increase the model's variations and expressiveness. The proposed model allows partial manipulation of the face while still learning the whole face mesh. For thi…