Diffusion Models and Representation Learning: A Survey
Diffusion Models are popular generative modeling methods in various vision tasks, attracting significant attention. They can be considered a unique instance of self-supervised learning methods due to their independence from label annotation. This survey explores the interplay between diffusion models and representation learning. It provides an overview of diffusion models' essential aspects, including mathematical foundations, popular denoising network architectures, and guidance methods. Various approaches related to diffusion models and representation learning are detailed. These include frameworks that leverage representations learned from pre-trained diffusion models for subsequent recognition tasks and methods that utilize advancements in representation and self-supervised learning to enhance diffusion models. This survey aims to offer a comprehensive overview of the taxonomy between diffusion models and representation learning, identifying key areas of existing concerns and potential exploration. Github link: https://github.com/dongzhuoyao/Diffusion-Representation-Learning-Survey-Taxonomy
Code (1)
Tasks
DenoisingRepresentation LearningSelf-Supervised LearningSurveyMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Survey of Video Diffusion Models: Foundations, Implementations, and Applications
Recent advances in diffusion models have revolutionized video generation, offering superior temporal consistency and visual quality compared to traditional generative adversarial networks-based approaches. While this eme…
Computational EfficiencyDenoisingQuestion AnsweringSuper-Resolution+2A Survey on Graph Diffusion Models: Generative AI in Science for Molecule, Protein and Material
Diffusion models have become a new SOTA generative modeling method in various fields, for which there are multiple survey works that provide an overall survey. With the number of articles on diffusion models increasing e…
ArticlesSurveyDiffusion Models for Reinforcement Learning: A Survey
Diffusion models surpass previous generative models in sample quality and training stability. Recent works have shown the advantages of diffusion models in improving reinforcement learning (RL) solutions. This survey aim…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)SurveyDiffusion Models for Time Series Forecasting: A Survey
Diffusion models, initially developed for image synthesis, demonstrate remarkable generative capabilities. Recently, their application has expanded to time series forecasting (TSF), yielding promising results. Existing s…
Time Series ForecastingDiffusion Models for Tabular Data: Challenges, Current Progress, and Future Directions
In recent years, generative models have achieved remarkable performance across diverse applications, including image generation, text synthesis, audio creation, video generation, and data augmentation. Diffusion models h…
Data AugmentationImage GenerationVideo Generation