Patch Knowledge Transfer for Efficient AI-Generated Image Quality Assessment
With the rapid advancement of image generation technologies, perceptual quality assessment of AI-generated images has emerged as a crucial research direction in computer vision. The core challenge of this task lies in achieving efficient quality assessment for massive generated images. Current mainstream approaches exhibit two key limitations: 1) Methods employing complex feature extraction strategies, while improving performance, incur prohibitive computational costs that hinder real-time inference; 2) Simple image scaling-based solutions, despite their computational efficiency, demonstrate significantly inferior assessment accuracy. To address this critical issue, we propose Patch Knowledge Transfer (PKT), a knowledge distillation-based optimization framework that achieves synergistic optimization of visual representation capability and inference efficiency through an innovative multi-level knowledge transfer mechanism. Specifically, we design a dual-model architecture: a teacher model with local-global hybrid processing provides high-quality supervision signals, while a student model relying solely on global processing efficiently inherits the teacher's representation capacity through multi-level supervision. Extensive experiments conducted on 4 AIGIQA databases demonstrate that the PKT framework enables the student model to maintain performance comparable to the teacher while reducing computational costs by 67.7\%. Furthermore, compared to existing methods, our approach achieves a superior balance between model efficiency and assessment accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
Image Quality AssessmentComputational EfficiencyKnowledge DistillationImage GenerationSimilar Papers 제목 키워드 기반
Face Transfer with Generative Adversarial Network
Face transfer animates the facial performances of the character in the target video by a source actor. Traditional methods are typically based on face modeling. We propose an end-to-end face transfer method based on Gene…
Face TransferGenerative Adversarial NetworkImproving the Transferability of Adversarial Examples with Restructure Embedded Patches
Vision transformers (ViTs) have demonstrated impressive performance in various computer vision tasks. However, the adversarial examples generated by ViTs are challenging to transfer to other networks with different struc…
SpecificityOne-shot Detail Retouching with Patch Space Neural Transformation Blending
Photo retouching is a difficult task for novice users as it requires expert knowledge and advanced tools. Photographers often spend a great deal of time generating high-quality retouched photos with intricate details. In…
One-Shot LearningPhoto RetouchingL2G: A Simple Local-to-Global Knowledge Transfer Framework for Weakly Supervised Semantic Segmentation
Mining precise class-aware attention maps, a.k.a, class activation maps, is essential for weakly supervised semantic segmentation. In this paper, we present L2G, a simple online local-to-global knowledge transfer framewo…
ObjectSemantic SegmentationTransfer LearningWeakly supervised Semantic Segmentation+1ELiTe: Efficient Image-to-LiDAR Knowledge Transfer for Semantic Segmentation
Cross-modal knowledge transfer enhances point cloud representation learning in LiDAR semantic segmentation. Despite its potential, the \textit{weak teacher challenge} arises due to repetitive and non-diverse car camera i…
Knowledge DistillationLIDAR Semantic Segmentationparameter-efficient fine-tuningPseudo Label+3