Image Generation using Continuous Filter Atoms
In this paper, we model the subspace of convolutional filters with a neural ordinary differential equation (ODE) to enable gradual changes in generated images. Decomposing convolutional filters over a set of filter atoms allows efficiently modeling and sampling from a subspace of high-dimensional filters. By further modeling filters atoms with a neural ODE, we show both empirically and theoretically that such introduced continuity can be propagated to the generated images, and thus achieves gradually evolved image generation. We support the proposed framework of image generation with continuous filter atoms using various experiments, including image-to-image translation and image generation conditioned on continuous labels. Without auxiliary network components and heavy supervision, the proposed continuous filter atoms allow us to easily manipulate the gradual change of generated images by controlling integration intervals of neural ordinary differential equation. This research sheds the light on using the subspace of network parameters to navigate the diverse appearance of image generation.
Code (0)
등록된 구현이 없습니다.
Tasks
Image GenerationImage-to-Image TranslationNavigateTranslationSimilar Papers 제목 키워드 기반
Data-Driven Approach to Encoding and Decoding 3-D Crystal Structures
Generative models have achieved impressive results in many domains including image and text generation. In the natural sciences, generative models have led to rapid progress in automated drug discovery. Many of the curre…
DecoderDrug DiscoveryText GenerationDisentangling Latent Embeddings with Sparse Linear Concept Subspaces (SLiCS)
Vision-language co-embedding networks, such as CLIP, provide a latent embedding space with semantic information that is useful for downstream tasks. We hypothesize that the embedding space can be disentangled to separate…
Image RetrievalSpatiotemporal Joint Filter Decomposition in 3D Convolutional Neural Networks
In this paper, we introduce spatiotemporal joint filter decomposition to decouple spatial and temporal learning, while preserving spatiotemporal dependency in a video. A 3D convolutional filter is now jointly decomposed …
Action RecognitionLarge Convolutional Model Tuning via Filter Subspace
Efficient fine-tuning methods are critical to address the high computational and parameter complexity while adapting large pre-trained models to downstream tasks. Our study is inspired by prior research that represents e…
modelSpline Filters For End-to-End Deep Learning
We propose to tackle the problem of end-to-end learning for raw waveform signals by introducing learnable continuous time-frequency atoms. The derivation of these filters is achieved by defining a functional space w…
Deep Learning