Information Bottleneck Learning Using Privileged Information for Visual Recognition
We explore the visual recognition problem from a main data view when an auxiliary data view is available during training. This is important because it allows improving the training of visual classifiers when paired additional data is cheaply available, and it improves the recognition from multi-view data when there is a missing view at testing time. The problem is challenging because of the intrinsic asymmetry caused by the missing auxiliary view during testing. We account for such view during training by extending the information bottleneck method, and by combining it with risk minimization. In this way, we establish an information theoretic principle for leaning any type of visual classifier under this particular setting. We use this principle to design a large-margin classifier with an efficient optimization in the primal space. We extensively compare our method with the state-of-the-art on different visual recognition datasets, and with different types of auxiliary data, and show that the proposed framework has a very promising potential.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Adaptive SVM+: Learning with Privileged Information for Domain Adaptation
Incorporating additional knowledge in the learning process can be beneficial for several computer vision and machine learning tasks. Whether privileged information originates from a source domain that is adapted to a tar…
Domain AdaptationThe Variational Bandwidth Bottleneck: Stochastic Evaluation on an Information Budget
In many applications, it is desirable to extract only the relevant information from complex input data, which involves making a decision about which input features are relevant. The information bottleneck method formaliz…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Variational InferenceBridging the Sim-to-Real Gap from the Information Bottleneck Perspective
Reinforcement Learning (RL) has recently achieved remarkable success in robotic control. However, most works in RL operate in simulated environments where privileged knowledge (e.g., dynamics, surroundings, terrains) is …
Knowledge DistillationReinforcement Learning (RL)Fine-grained Species Recognition with Privileged Pooling: Better Sample Efficiency Through Supervised Attention
We propose a scheme for supervised image classification that uses privileged information, in the form of keypoint annotations for the training data, to learn strong models from small and/or biased training sets. Our main…
image-classificationImage ClassificationLearning Using Privileged Information for Zero-Shot Action Recognition
Zero-Shot Action Recognition (ZSAR) aims to recognize video actions that have never been seen during training. Most existing methods assume a shared semantic space between seen and unseen actions and intend to directly l…
Action RecognitionHallucinationObjectZero-Shot Action Recognition