paper-with-me

홈 › Papers

Analyzing the Feature Extractor Networks for Face Image Synthesis

2024-06-04 · Erdi Sarıtaş, Hazim Kemal Ekenel

Advancements like Generative Adversarial Networks have attracted the attention of researchers toward face image synthesis to generate ever more realistic images. Thereby, the need for the evaluation criteria to assess the realism of the generated images has become apparent. While FID utilized with InceptionV3 is one of the primary choices for benchmarking, concerns about InceptionV3's limitations for face images have emerged. This study investigates the behavior of diverse feature extractors -- InceptionV3, CLIP, DINOv2, and ArcFace -- considering a variety of metrics -- FID, KID, Precision\&Recall. While the FFHQ dataset is used as the target domain, as the source domains, the CelebA-HQ dataset and the synthetic datasets generated using StyleGAN2 and Projected FastGAN are used. Experiments include deep-down analysis of the features: $L_2$ normalization, model attention during extraction, and domain distributions in the feature space. We aim to give valuable insights into the behavior of feature extractors for evaluating face image synthesis methodologies. The code is publicly available at https://github.com/ThEnded32/AnalyzingFeatureExtractors.

📄 PDF Abstract BibTeX arXiv:2406.02153

Code (1)

thended32/analyzingfeatureextractors 공식 구현 pytorch

Tasks

BenchmarkingImage Generation

Methods 이 논문이 사용한 방법론

Weight Demodulation 설명 없음
HuMan(Expedia)||How do I get a human at Expedia? How do I get a human at Expedia? How Do I Get a Human at Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Real-Time Help & Exclusive…
R1 Regularization R_INLINE_MATH_1 Regularization is a regularization technique and gradient penalty for training [generative adversarial…
Path Length Regularization 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
ArcFace ArcFace, or Additive Angular Margin Loss, is a loss function used in face recognition tasks. The softmax is traditionally used…
CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…

Similar Papers 제목 키워드 기반

DDPM-CD: Denoising Diffusion Probabilistic Models as Feature Extractors for Change Detection

2022-06-23 · Wele Gedara Chaminda Bandara, Nithin Gopalakrishnan Nair, Vishal M. Patel

Remote sensing change detection is crucial for understanding the dynamics of our planet's surface, facilitating the monitoring of environmental changes, evaluating human impact, predicting future trends, and supporting d…

Change DetectionDecision MakingDenoisingImage Generation

FlipNeRF: Flipped Reflection Rays for Few-shot Novel View Synthesis

2023-06-30 · ICCV 2023 1 · Seunghyeon Seo, Yeonjin Chang, Nojun Kwak

Neural Radiance Field (NeRF) has been a mainstream in novel view synthesis with its remarkable quality of rendered images and simple architecture. Although NeRF has been developed in various directions improving continuo…

3D geometryDepth EstimationNeRFNovel View Synthesis

UV R-CNN: Stable and Efficient Dense Human Pose Estimation

2022-11-04 · Wenhe Jia, Yilin Zhou, Xuhan Zhu, Mengjie Hu 외

Dense pose estimation is a dense 3D prediction task for instance-level human analysis, aiming to map human pixels from an RGB image to a 3D surface of the human body. Due to a large amount of surface point regression, th…

Pose Estimationregression

Veta-GS: View-dependent deformable 3D Gaussian Splatting for thermal infrared Novel-view Synthesis

2025-05-25 · Myeongseok Nam, Wongi Park, Minsol Kim, Hyejin Hur 외

Recently, 3D Gaussian Splatting (3D-GS) based on Thermal Infrared (TIR) imaging has gained attention in novel-view synthesis, showing real-time rendering. However, novel-view synthesis with thermal infrared images suffer…

Novel View Synthesis

Beyond Generation: A Diffusion-based Low-level Feature Extractor for Detecting AI-generated Images

2025-01-01 · CVPR 2025 1 · Nan Zhong, Haoyu Chen, Yiran Xu, Zhenxing Qian 외

The prevalence of AI-generated images has evoked concerns regarding the potential misuse of image generation technologies. In response, numerous detection methods aim to identify AI-generated images by analyzing gene…

DenoisingImage GenerationOne-Class Classification