paper-with-me

Papers

SAN: Inducing Metrizability of GAN with Discriminative Normalized Linear Layer

2023-01-30 · Yuhta Takida, Masaaki Imaizumi, Takashi Shibuya, Chieh-Hsin Lai, Toshimitsu Uesaka, Naoki Murata, Yuki Mitsufuji

Generative adversarial networks (GANs) learn a target probability distribution by optimizing a generator and a discriminator with minimax objectives. This paper addresses the question of whether such optimization actually provides the generator with gradients that make its distribution close to the target distribution. We derive metrizable conditions, sufficient conditions for the discriminator to serve as the distance between the distributions by connecting the GAN formulation with the concept of sliced optimal transport. Furthermore, by leveraging these theoretical results, we propose a novel GAN training scheme, called slicing adversarial network (SAN). With only simple modifications, a broad class of existing GANs can be converted to SANs. Experiments on synthetic and image datasets support our theoretical results and the SAN's effectiveness as compared to usual GANs. Furthermore, we also apply SAN to StyleGAN-XL, which leads to state-of-the-art FID score amongst GANs for class conditional generation on ImageNet 256$\times$256. Our implementation is available on https://ytakida.github.io/san.

📄 PDF Abstract BibTeX arXiv:2301.12811

Code (1)

sony/san 공식 구현 pytorch

Tasks

Image Generation

Methods 이 논문이 사용한 방법론

Dogecoin Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

Layer by layer, module by module: Choose both for optimal OOD probing of ViT

2026-03-05 · Ambroise Odonnat, Vasilii Feofanov, Laetitia Chapel, Romain Tavenard 외 arxiv

Recent studies have observed that intermediate layers of foundation models often yield more discriminative representations than the final layer. While initially attributed to autoregressive pretraining, this phenomenon h…

Image Classification

Discriminative Features via Generalized Eigenvectors

2013-10-07 · Nikos Karampatziakis, Paul Mineiro

Representing examples in a way that is compatible with the underlying classifier can greatly enhance the performance of a learning system. In this paper we investigate scalable techniques for inducing discriminative feat…

General Classification

Fast Convergence in Learning Two-Layer Neural Networks with Separable Data

2023-05-22 · Hossein Taheri, Christos Thrampoulidis

Normalized gradient descent has shown substantial success in speeding up the convergence of exponentially-tailed loss functions (which includes exponential and logistic losses) on linear classifiers with separable data. …

Generalization Bounds

A Note on Over-Smoothing for Graph Neural Networks

2020-06-23 · Chen Cai, Yusu Wang

Graph Neural Networks (GNNs) have achieved a lot of success on graph-structured data. However, it is observed that the performance of graph neural networks does not improve as the number of layers increases. This effect,…

Graph Neural Network

Structured Affinity for Unsupervised Visual Class-Incremental Memory in Deep Artificial Immune Networks

2026-08-20 · Siphesihle Sithungu arxiv

Artificial immune networks (AINs) are naturally memory-forming systems, but conventional visual AINs often rely on flattened vector affinity that ignores spatial structure. This paper studies whether structured, gradient…