Predicting Generalization in Deep Learning via Metric Learning -- PGDL Shared task
The competition "Predicting Generalization in Deep Learning (PGDL)" aims to provide a platform for rigorous study of generalization of deep learning models and offer insight into the progress of understanding and explaining these models. This report presents the solution that was submitted by the user \emph{smeznar} which achieved the eight place in the competition. In the proposed approach, we create simple metrics and find their best combination with automatic testing on the provided dataset, exploring how combinations of various properties of the input neural network architectures can be used for the prediction of their generalization.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningMetric LearningSimilar Papers 제목 키워드 기반
Predicting Deep Neural Network Generalization with Perturbation Response Curves
The field of Deep Learning is rich with empirical evidence of human-like performance on a variety of prediction tasks. However, despite these successes, the recent Predicting Generalization in Deep Learning (PGDL) NeurIP…
Ranking Deep Learning Generalization using Label Variation in Latent Geometry Graphs
Measuring the generalization performance of a Deep Neural Network (DNN) without relying on a validation set is a difficult task. In this work, we propose exploiting Latent Geometry Graphs (LGGs) to represent the latent s…
Deep LearningUsing noise resilience for ranking generalization of deep neural networks
Recent papers have shown that sufficiently overparameterized neural networks can perfectly fit even random labels. Thus, it is crucial to understand the underlying reason behind the generalization performance of a networ…
PositionPredicting Generalization in Deep Learning via Local Measures of Distortion
We study generalization in deep learning by appealing to complexity measures originally developed in approximation and information theory. While these concepts are challenged by the high-dimensional and data-defined natu…
Deep LearningQuantizationPredicting Water Temperature Dynamics of Unmonitored Lakes with Meta Transfer Learning
Most environmental data come from a minority of well-monitored sites. An ongoing challenge in the environmental sciences is transferring knowledge from monitored sites to unmonitored sites. Here, we demonstrate a novel t…
Meta-LearningTransfer Learning