Visual Domain Decathlon
홈페이지 · 논문 8편
The goal of this challenge is to solve simultaneously ten image classification problems representative of very different visual domains. The data for each domain is obtained from the following image classification benchmarks: ImageNet CIFAR-100 Aircraft Daimler pedestrian classification Describable textures German traffic signs Omniglot SVHN UCF101 Dynamic Images VGG-Flowers The union of the images from the ten datasets is split in training, validation, and test subsets. Different domains contain different image categories as well as a different number of images. The task is to train the best possible classifier to address all ten classification tasks using the training and validation subsets, apply the classifier to the test set, and send us the resulting annotation file for assessment. The winner will be determined based on a weighted average of the classification performance on each domain, using the scoring scheme described below. At test time, your model is allowed to know the ground-truth domain of each test image (ImageNet, CIFAR-100, ...) but, of course, not its category.