FedStyle: Style-Based Federated Learning Crowdsourcing Framework for Art Commissions
The unique artistic style is crucial to artists' occupational competitiveness, yet prevailing Art Commission Platforms rarely support style-based retrieval. Meanwhile, the fast-growing generative AI techniques aggravate artists' concerns about releasing personal artworks to public platforms. To achieve artistic style-based retrieval without exposing personal artworks, we propose FedStyle, a style-based federated learning crowdsourcing framework. It allows artists to train local style models and share model parameters rather than artworks for collaboration. However, most artists possess a unique artistic style, resulting in severe model drift among them. FedStyle addresses such extreme data heterogeneity by having artists learn their abstract style representations and align with the server, rather than merely aggregating model parameters lacking semantics. Besides, we introduce contrastive learning to meticulously construct the style representation space, pulling artworks with similar styles closer and keeping different ones apart in the embedding space. Extensive experiments on the proposed datasets demonstrate the superiority of FedStyle.
Code (1)
Tasks
Contrastive LearningFederated LearningRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Federated Unsupervised Visual Representation Learning via Exploiting General Content and Personal Style
Discriminative unsupervised learning methods such as contrastive learning have demonstrated the ability to learn generalized visual representations on centralized data. It is nonetheless challenging to adapt such methods…
Contrastive LearningFederated LearningRepresentation LearningTreeFedDG: Alleviating Global Drift in Federated Domain Generalization for Medical Image Segmentation
In medical image segmentation tasks, Domain Generalization (DG) under the Federated Learning (FL) framework is crucial for addressing challenges related to privacy protection and data heterogeneity. However, traditional …
Medical Image SegmentationDomain GeneralizationFederated LearningFederated Learning for Localization: A Privacy-Preserving Crowdsourcing Method
Received Signal Strength (RSS) fingerprint-based localization has attracted a lot of research effort and cultivated many commercial applications of location-based services due to its low cost and ease of implementation. …
Federated LearningPrivacy PreservingA Crowdsourcing Framework for On-Device Federated Learning
Federated learning (FL) rests on the notion of training a global model in a decentralized manner. Under this setting, mobile devices perform computations on their local data before uploading the required updates to impro…
Federated LearningFederated Cross-Modal Style-Aware Prompt Generation
Prompt learning has propelled vision-language models like CLIP to excel in diverse tasks, making them ideal for federated learning due to computational efficiency. However, conventional approaches that rely solely on fin…
Computational EfficiencyImage ClassificationFederated Learning