paper-with-me

홈 › Papers

Pros and Cons of GAN Evaluation Measures

2018-02-09 · Ali Borji

Generative models, in particular generative adversarial networks (GANs), have received significant attention recently. A number of GAN variants have been proposed and have been utilized in many applications. Despite large strides in terms of theoretical progress, evaluating and comparing GANs remains a daunting task. While several measures have been introduced, as of yet, there is no consensus as to which measure best captures strengths and limitations of models and should be used for fair model comparison. As in other areas of computer vision and machine learning, it is critical to settle on one or few good measures to steer the progress in this field. In this paper, I review and critically discuss more than 24 quantitative and 5 qualitative measures for evaluating generative models with a particular emphasis on GAN-derived models. I also provide a set of 7 desiderata followed by an evaluation of whether a given measure or a family of measures is compatible with them.

📄 PDF Abstract BibTeX arXiv:1802.03446

Code (4)

Jeff-HOU/ML_Note tf
suhitd1729/Action-cameras-evaluating-image-quality-and-suitability-for-machine-learning pytorch
suhitd1729/actioncameraforml pytorch
taki0112/GAN_Metrics-Tensorflow tf

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dogecoin Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

Assessment of Non-native Prosody for Spanish as L2 using quantitative scores and perceptual evaluation

2014-05-01 · LREC 2014 5 · Valent{\'\i}n Carde{\~n}oso-Payo, C{\'e}sar Gonz{\'a}lez-Ferreras, David Escudero

In this work we present SAMPLE, a new pronunciation database of Spanish as L2, and first results on the automatic assessment of Non-native prosody. Listen and repeat and read tasks are carried out by native and foreign s…

Language AcquisitionSpeech Recognition

Objective Evaluation of Prosody and Intelligibility in Speech Synthesis via Conditional Prediction of Discrete Tokens

2025-09-24 · Ismail Rasim Ulgen, Zongyang Du, Junchen Lu, Philipp Koehn 외 arxiv

Objective evaluation of synthesized speech is critical for advancing speech generation systems, yet existing metrics for intelligibility and prosody remain limited in scope and weakly correlated with human perception. Wo…

Speech Synthesis

Pros and Cons of GAN Evaluation Measures: New Developments

2021-03-17 · Ali Borji

This work is an update of a previous paper on the same topic published a few years ago. With the dramatic progress in generative modeling, a suite of new quantitative and qualitative techniques to evaluate models has eme…

Fairness

Assessing the Prosody of Non-Native Speakers of English: Measures and Feature Sets

2016-05-01 · LREC 2016 5 · Eduardo Coutinho, Florian H{\"o}nig, Yue Zhang, Simone Hantke 외

In this paper, we describe a new database with audio recordings of non-native (L2) speakers of English, and the perceptual evaluation experiment conducted with native English speakers for assessing the prosody of each re…

regression

Segmentation evaluation metrics, a comparison grounded on prosodic and discourse units

2014-05-01 · LREC 2014 5 · Klim Peshkov, Laurent Pr{\'e}vot

Knowledge on evaluation metrics and best practices of using them have improved fast in the recent years Fort et al. (2012). However, the advances concern mostly evaluation of classification related tasks. Segmentation ta…

Discourse SegmentationInformation RetrievalSegmentation