Discovering Multiple and Diverse Directions for Cognitive Image Properties
Recent research has shown that it is possible to find interpretable directions in the latent spaces of pre-trained GANs. These directions enable controllable generation and support a variety of semantic editing operations. While previous work has focused on discovering a single direction that performs a desired editing operation such as zoom-in, limited work has been done on the discovery of multiple and diverse directions that can achieve the desired edit. In this work, we propose a novel framework that discovers multiple and diverse directions for a given property of interest. In particular, we focus on the manipulation of cognitive properties such as Memorability, Emotional Valence and Aesthetics. We show with extensive experiments that our method successfully manipulates these properties while producing diverse outputs. Our project page and source code can be found at http://catlab-team.github.io/latentcognitive.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Quality Diversity for Robot Learning: Limitations and Future Directions
Quality Diversity (QD) has shown great success in discovering high-performing, diverse policies for robot skill learning. While current benchmarks have led to the development of powerful QD methods, we argue that new par…
DiversityDiscovering Class-Specific GAN Controls for Semantic Image Synthesis
Prior work has extensively studied the latent space structure of GANs for unconditional image synthesis, enabling global editing of generated images by the unsupervised discovery of interpretable latent directions. Howev…
Image GenerationFantastic Style Channels and Where to Find Them: A Submodular Framework for Discovering Diverse Directions in GANs
The discovery of interpretable directions in the latent spaces of pre-trained GAN models has recently become a popular topic. In particular, StyleGAN2 has enabled various image generation and manipulation tasks due to it…
DiversityImage GenerationAdvances in Multiple Instance Learning for Whole Slide Image Analysis: Techniques, Challenges, and Future Directions
Whole slide images (WSIs) are gigapixel-scale digital images of H\&E-stained tissue samples widely used in pathology. The substantial size and complexity of WSIs pose unique analytical challenges. Multiple Instance Learn…
Cancer ClassificationInterpretable Machine LearningMultiple Instance LearningSurvey+1DebiasDiff: Debiasing Text-to-image Diffusion Models with Self-discovering Latent Attribute Directions
While Diffusion Models (DM) exhibit remarkable performance across various image generative tasks, they nonetheless reflect the inherent bias presented in the training set. As DMs are now widely used in real-world applica…
Attribute