Attributes for Improved Attributes: A Multi-Task Network for Attribute Classification
Attributes, or semantic features, have gained popularity in the past few years in domains ranging from activity recognition in video to face verification. Improving the accuracy of attribute classifiers is an important first step in any application which uses these attributes. In most works to date, attributes have been considered to be independent. However, we know this not to be the case. Many attributes are very strongly related, such as heavy makeup and wearing lipstick. We propose to take advantage of attribute relationships in three ways: by using a multi-task deep convolutional neural network (MCNN) sharing the lowest layers amongst all attributes, sharing the higher layers for related attributes, and by building an auxiliary network on top of the MCNN which utilizes the scores from all attributes to improve the final classification of each attribute. We demonstrate the effectiveness of our method by producing results on two challenging publicly available datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Activity RecognitionAttributeFace VerificationFacial Attribute ClassificationGeneral ClassificationSimilar Papers 제목 키워드 기반
Predicting Multiple Attributes via Relative Multi-task Learning
Relative attributes learning aims to learn ranking functions describing the relative strength of attributes. Most of current learning approaches learn ranking functions for each attribute independently without considerin…
AttributeMulti-Task LearningZero-Shot LearningExploring Universal Speech Attributes for Speaker Verification with an Improved Cross-stitch Network
The universal speech attributes for x-vector based speaker verification (SV) are addressed in this paper. The manner and place of articulation form the fundamental speech attribute unit (SAU), and then new speech attribu…
AttributeSpeaker VerificationDecorrelating Semantic Visual Attributes by Resisting the Urge to Share
Existing methods to learn visual attributes are prone to learning the wrong thing---namely, properties that are correlated with the attribute of interest among training samples. Yet, many proposed applications of attrib…
AttributeMulti-Task LearningColor-based Emotion Representation for Speech Emotion Recognition
Speech emotion recognition (SER) has traditionally relied on categorical or dimensional labels. However, this technique is limited in representing both the diversity and interpretability of emotions. To overcome this lim…
Speech Emotion RecognitionEmotion ClassificationTweet Classification without the Tweet: An Empirical Examination of User versus Document Attributes
NLP naturally puts a primary focus on leveraging document language, occasionally considering user attributes as supplemental. However, as we tackle more social scientific tasks, it is possible user attributes might be of…
General ClassificationStance Detection