paper-with-me

Papers

TaxaDiffusion: Progressively Trained Diffusion Model for Fine-Grained Species Generation

2025-06-02 · Amin Karimi Monsefi, Mridul Khurana, Rajiv Ramnath, Anuj Karpatne, Wei-Lun Chao, Cheng Zhang

We propose TaxaDiffusion, a taxonomy-informed training framework for diffusion models to generate fine-grained animal images with high morphological and identity accuracy. Unlike standard approaches that treat each species as an independent category, TaxaDiffusion incorporates domain knowledge that many species exhibit strong visual similarities, with distinctions often residing in subtle variations of shape, pattern, and color. To exploit these relationships, TaxaDiffusion progressively trains conditioned diffusion models across different taxonomic levels -- starting from broad classifications such as Class and Order, refining through Family and Genus, and ultimately distinguishing at the Species level. This hierarchical learning strategy first captures coarse-grained morphological traits shared by species with common ancestors, facilitating knowledge transfer before refining fine-grained differences for species-level distinction. As a result, TaxaDiffusion enables accurate generation even with limited training samples per species. Extensive experiments on three fine-grained animal datasets demonstrate that outperforms existing approaches, achieving superior fidelity in fine-grained animal image generation. Project page: https://amink8.github.io/TaxaDiffusion/

📄 PDF Abstract BibTeX arXiv:2506.01923

Code (1)

aminK8/TaxaDiffusion 공식 구현 pytorch

Tasks

Image GenerationTransfer Learning

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

DiffusionFF: A Diffusion-based Framework for Joint Face Forgery Detection and Fine-Grained Artifact Localization

2025-08-03 · Siran Peng, Haoyuan Zhang, Li Gao, Tianshuo Zhang 외 arxiv

The rapid evolution of deepfake technologies demands robust and reliable face forgery detection algorithms. While determining whether an image has been manipulated remains essential, the ability to precisely localize for…

Coarse-to-Fine Latent Diffusion for Pose-Guided Person Image Synthesis

2024-02-28 · CVPR 2024 1 · Yanzuo Lu, Manlin Zhang, Andy J Ma, Xiaohua Xie 외

Diffusion model is a promising approach to image generation and has been employed for Pose-Guided Person Image Synthesis (PGPIS) with competitive performance. While existing methods simply align the person appearance to …

DecoderImage GenerationPose-Guided Image Generation

Progressive Prompt Detailing for Improved Alignment in Text-to-Image Generative Models

2025-03-22 · Ketan Suhaas Saichandran, Xavier Thomas, Prakhar Kaushik, Deepti Ghadiyaram

Text-to-image generative models often struggle with long prompts detailing complex scenes, diverse objects with distinct visual characteristics and spatial relationships. In this work, we propose SCoPE (Scheduled interpo…

Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)

ControlAudio: Tackling Text-Guided, Timing-Indicated and Intelligible Audio Generation via Progressive Diffusion Modeling

2025-10-10 · Yuxuan Jiang, Zehua Chen, Zeqian Ju, Yusheng Dai 외 arxiv

Text-to-audio (TTA) generation with fine-grained control signals, e.g., precise timing control or intelligible speech content, has been explored in recent works. However, constrained by data scarcity, their generation pe…

Multi-Task LearningAudio Generation

D2PO: Optimizing Diffusion Samplers via Dynamic Preference

2026-07-07 · Jinkyu Kim, Jinyoung Choi, Bohyung Han arxiv

We propose D2PO (Dynamic Direct Preference Optimization), a principled framework for optimizing diffusion sampling policies with respect to timestep schedules and classifier-free guidance (CFG) weights. Our work is motiv…