CoralStyleCLIP: Co-optimized Region and Layer Selection for Image Editing
Edit fidelity is a significant issue in open-world controllable generative image editing. Recently, CLIP-based approaches have traded off simplicity to alleviate these problems by introducing spatial attention in a handpicked layer of a StyleGAN. In this paper, we propose CoralStyleCLIP, which incorporates a multi-layer attention-guided blending strategy in the feature space of StyleGAN2 for obtaining high-fidelity edits. We propose multiple forms of our co-optimized region and layer selection strategy to demonstrate the variation of time complexity with the quality of edits over different architectural intricacies while preserving simplicity. We conduct extensive experimental analysis and benchmark our method against state-of-the-art CLIP-based methods. Our findings suggest that CoralStyleCLIP results in high-quality edits while preserving the ease of use.
Code (0)
등록된 구현이 없습니다.
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Optimizing Region Selection for Weakly Supervised Object Detection
Training object detectors with only image-level annotations is very challenging because the target objects are often surrounded by a large number of background clutters. Many existing approaches tackle this problem throu…
DiversityObjectobject-detectionObject Detection+1End-to-end learning of keypoint detector and descriptor for pose invariant 3D matching
Finding correspondences between images or 3D scans is at the heart of many computer vision and image retrieval applications and is often enabled by matching local keypoint descriptors. Various learning approaches have be…
Image RetrievalKeypoint DetectionMetric LearningRetrievalDeep Learning Model with GA based Feature Selection and Context Integration
Deep learning models have been very successful in computer vision and image processing applications. Since its inception, Many top-performing methods for image segmentation are based on deep CNN models. However, deep CNN…
feature selectionImage SegmentationSemantic SegmentationLeveraging Spatial Attention and Edge Context for Optimized Feature Selection in Visual Localization
Visual localization determines an agent's precise position and orientation within an environment using visual data. It has become a critical task in the field of robotics, particularly in applications such as autonomous …
Autonomous NavigationEdge Detectionfeature selectionVisual LocalizationAutoPrivacy: Automated Layer-wise Parameter Selection for Secure Neural Network Inference
Hybrid Privacy-Preserving Neural Network (HPPNN) implementing linear layers by Homomorphic Encryption (HE) and nonlinear layers by Garbled Circuit (GC) is one of the most promising secure solutions to emerging Machine Le…
Deep Reinforcement LearningPrivacy Preserving