paper-with-me

홈 › Papers

Direct Ascent Synthesis: Revealing Hidden Generative Capabilities in Discriminative Models

2025-02-11 · Stanislav Fort, Jonathan Whitaker

We demonstrate that discriminative models inherently contain powerful generative capabilities, challenging the fundamental distinction between discriminative and generative architectures. Our method, Direct Ascent Synthesis (DAS), reveals these latent capabilities through multi-resolution optimization of CLIP model representations. While traditional inversion attempts produce adversarial patterns, DAS achieves high-quality image synthesis by decomposing optimization across multiple spatial scales (1x1 to 224x224), requiring no additional training. This approach not only enables diverse applications -- from text-to-image generation to style transfer -- but maintains natural image statistics ($1/f^2$ spectrum) and guides the generation away from non-robust adversarial patterns. Our results demonstrate that standard discriminative models encode substantially richer generative knowledge than previously recognized, providing new perspectives on model interpretability and the relationship between adversarial examples and natural image synthesis.

📄 PDF Abstract BibTeX arXiv:2502.07753

Code (1)

stanislavfort/Direct_Ascent_Synthesis

Tasks

Image GenerationStyle TransferText to Image GenerationText-to-Image Generation

Methods 이 논문이 사용한 방법론

CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…

Similar Papers 제목 키워드 기반

Solving Min-Max Optimization with Hidden Structure via Gradient Descent Ascent

2021-01-13 · NeurIPS 2021 12 · Lampros Flokas, Emmanouil-Vasileios Vlatakis-Gkaragkounis, Georgios Piliouras

Many recent AI architectures are inspired by zero-sum games, however, the behavior of their dynamics is still not well understood. Inspired by this, we study standard gradient descent ascent (GDA) dynamics in a specific …

Latent Pollution Model: The Hidden Carbon Footprint in 3D Image Synthesis

2024-07-20 · Marvin Seyfarth, Salman Ul Hassan Dar, Sandy Engelhardt

Contemporary developments in generative AI are rapidly transforming the field of medical AI. These developments have been predominantly driven by the availability of large datasets and high computing power, which have fa…

Image Generation

A Unified Anomaly Synthesis Strategy with Gradient Ascent for Industrial Anomaly Detection and Localization

2024-07-12 · Qiyu Chen, Huiyuan Luo, Chengkan Lv, Zhengtao Zhang

Anomaly synthesis strategies can effectively enhance unsupervised anomaly detection. However, existing strategies have limitations in the coverage and controllability of anomaly synthesis, particularly for weak defects t…

Anomaly DetectionDefect DetectionUnsupervised Anomaly Detection

Towards the Unification of Generative and Discriminative Visual Foundation Model: A Survey

2023-12-15 · Xu Liu, Tong Zhou, Yuanxin Wang, Yuping Wang 외

The advent of foundation models, which are pre-trained on vast datasets, has ushered in a new era of computer vision, characterized by their robustness and remarkable zero-shot generalization capabilities. Mirroring the …

Image GenerationImage SegmentationSemantic SegmentationZero-shot Generalization

HiddenSinger: High-Quality Singing Voice Synthesis via Neural Audio Codec and Latent Diffusion Models

2023-06-12 · Ji-Sang Hwang, Sang-Hoon Lee, Seong-Whan Lee

Recently, denoising diffusion models have demonstrated remarkable performance among generative models in various domains. However, in the speech domain, the application of diffusion models for synthesizing time-varying a…

DenoisingSinging Voice SynthesisSpeech Synthesis