paper-with-me

Papers

Concept-TRAK: Understanding how diffusion models learn concepts through concept-level attribution

2025-07-09 · Yonghyun Park, Chieh-Hsin Lai, Satoshi Hayakawa, Yuhta Takida, Naoki Murata, Wei-Hsiang Liao, Woosung Choi, Kin Wai Cheuk, Junghyun Koo, Yuki Mitsufuji arxiv

While diffusion models excel at image generation, their growing adoption raises critical concerns about copyright issues and model transparency. Existing attribution methods identify training examples influencing an entire image, but fall short in isolating contributions to specific elements, such as styles or objects, that are of primary concern to stakeholders. To address this gap, we introduce concept-level attribution through a novel method called Concept-TRAK, which extends influence functions with a key innovation: specialized training and utility loss functions designed to isolate concept-specific influences rather than overall reconstruction quality. We evaluate Concept-TRAK on novel concept attribution benchmarks using Synthetic and CelebA-HQ datasets, as well as the established AbC benchmark, showing substantial improvements over prior methods in concept-level attribution scenarios. We further demonstrate its versatility on real-world text-to-image generation with compositional and multi-concept prompts.

📄 PDF Abstract BibTeX arXiv:2507.06547

Code (0)

등록된 구현이 없습니다.

Tasks

Text-to-Image Generation

Similar Papers 제목 키워드 기반

Attributing Learned Concepts in Neural Networks to Training Data

2023-10-04 · Nicholas Konz, Charles Godfrey, Madelyn Shapiro, Jonathan Tu 외

By now there is substantial evidence that deep learning models learn certain human-interpretable features as part of their internal representations of data. As having the right (or wrong) concepts is critical to trustwor…

ConceptBed: Evaluating Concept Learning Abilities of Text-to-Image Diffusion Models

2023-06-07 · Maitreya Patel, Tejas Gokhale, Chitta Baral, Yezhou Yang

The ability to understand visual concepts and replicate and compose these concepts from images is a central goal for computer vision. Recent advances in text-to-image (T2I) models have lead to high definition and realist…

Concept Alignment

Emergence and Evolution of Interpretable Concepts in Diffusion Models

2025-04-21 · Berk Tınaz, Zalan Fabian, Mahdi Soltanolkotabi

Diffusion models have become the go-to method for text-to-image generation, producing high-quality images from noise through a process called reverse diffusion. Understanding the dynamics of the reverse diffusion process…

Image GenerationText to Image GenerationText-to-Image Generation

Prompt Optimizer of Text-to-Image Diffusion Models for Abstract Concept Understanding

2024-04-17 · Zezhong Fan, Xiaohan Li, Chenhao Fang, Topojoy Biswas 외

The rapid evolution of text-to-image diffusion models has opened the door of generative AI, enabling the translation of textual descriptions into visually compelling images with remarkable quality. However, a persistent …

Language ModelingLanguage ModellingReinforcement Learning (RL)

ForensicConcept: Transferable Forensic Concepts for AIGI Detection

2026-06-05 · Menyanshu Zhou, Ziyin Zhou, Ke Sun, Yunpeng Luo 외 arxiv

AI-generated image detectors achieve high accuracy on in-distribution data but often fail on unseen generators. A key obstacle to understanding this failure is the black-box nature of current detectors: they do not revea…