paper-with-me

Papers

Exploiting Interpretable Capabilities with Concept-Enhanced Diffusion and Prototype Networks

2024-10-24 · Alba Carballo-Castro, Sonia Laguna, Moritz Vandenhirtz, Julia E. Vogt

Concept-based machine learning methods have increasingly gained importance due to the growing interest in making neural networks interpretable. However, concept annotations are generally challenging to obtain, making it crucial to leverage all their prior knowledge. By creating concept-enriched models that incorporate concept information into existing architectures, we exploit their interpretable capabilities to the fullest extent. In particular, we propose Concept-Guided Conditional Diffusion, which can generate visual representations of concepts, and Concept-Guided Prototype Networks, which can create a concept prototype dataset and leverage it to perform interpretable concept prediction. These results open up new lines of research by exploiting pre-existing information in the quest for rendering machine learning more human-understandable.

📄 PDF Abstract BibTeX arXiv:2410.18705

Code (1)

acarballocastro/ConceptEnhanced 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Self-Discovering Interpretable Diffusion Latent Directions for Responsible Text-to-Image Generation

2023-11-28 · CVPR 2024 1 · Hang Li, Chengzhi Shen, Philip Torr, Volker Tresp 외

Diffusion-based models have gained significant popularity for text-to-image generation due to their exceptional image-generation capabilities. A risk with these models is the potential generation of inappropriate content…

Image GenerationText to Image GenerationText-to-Image Generation

CURE: Concept Unlearning via Orthogonal Representation Editing in Diffusion Models

2025-05-19 · Shristi Das Biswas, Arani Roy, Kaushik Roy

As Text-to-Image models continue to evolve, so does the risk of generating unsafe, copyrighted, or privacy-violating content. Existing safety interventions - ranging from training data curation and model fine-tuning to i…

BenchmarkingRed Teaming

ProGress: Structured Music Generation via Graph Diffusion and Hierarchical Music Analysis

2025-10-11 · Stephen Ni-Hahn, Chao Péter Yang, Mingchen Ma, Cynthia Rudin 외 arxiv

Artificial Intelligence (AI) for music generation is undergoing rapid developments, with recent symbolic models leveraging sophisticated deep learning and diffusion model algorithms. One drawback with existing models is …

Music Generation

IntroVAC: Introspective Variational Classifiers for Learning Interpretable Latent Subspaces

2020-08-03 · Marco Maggipinto, Matteo Terzi, Gian Antonio Susto

Learning useful representations of complex data has been the subject of extensive research for many years. With the diffusion of Deep Neural Networks, Variational Autoencoders have gained lots of attention since they pro…

Decoder

SliderSpace: Decomposing the Visual Capabilities of Diffusion Models

2025-02-03 · Rohit Gandikota, Zongze Wu, Richard Zhang, David Bau 외

We present SliderSpace, a framework for automatically decomposing the visual capabilities of diffusion models into controllable and human-understandable directions. Unlike existing control methods that require a user to …

Diversity