paper-with-me

홈 › Papers

Factorized Bilinear Models for Image Recognition

2016-11-17 · ICCV 2017 10 · Yanghao Li, Naiyan Wang, Jiaying Liu, Xiaodi Hou

Although Deep Convolutional Neural Networks (CNNs) have liberated their power in various computer vision tasks, the most important components of CNN, convolutional layers and fully connected layers, are still limited to linear transformations. In this paper, we propose a novel Factorized Bilinear (FB) layer to model the pairwise feature interactions by considering the quadratic terms in the transformations. Compared with existing methods that tried to incorporate complex non-linearity structures into CNNs, the factorized parameterization makes our FB layer only require a linear increase of parameters and affordable computational cost. To further reduce the risk of overfitting of the FB layer, a specific remedy called DropFactor is devised during the training process. We also analyze the connection between FB layer and some existing models, and show FB layer is a generalization to them. Finally, we validate the effectiveness of FB layer on several widely adopted datasets including CIFAR-10, CIFAR-100 and ImageNet, and demonstrate superior results compared with various state-of-the-art deep models.

📄 PDF Abstract BibTeX arXiv:1611.05709

Code (1)

lyttonhao/Factorized-Bilinear-Network 공식 구현 mxnet

Similar Papers 제목 키워드 기반

Deep Fusion: An Attention Guided Factorized Bilinear Pooling for Audio-video Emotion Recognition

2019-01-15 · Yuanyuan Zhang, Zi-Rui Wang, Jun Du

Automatic emotion recognition (AER) is a challenging task due to the abstract concept and multiple expressions of emotion. Although there is no consensus on a definition, human emotional states usually can be apperceived…

Emotion RecognitionVideo Emotion Recognition

3D Face Anti-spoofing with Factorized Bilinear Coding

2020-05-12 · Shan Jia, Xin Li, Chuanbo Hu, Guodong Guo 외

We have witnessed rapid advances in both face presentation attack models and presentation attack detection (PAD) in recent years. When compared with widely studied 2D face presentation attacks, 3D face spoofing attacks a…

Face Anti-SpoofingFace Presentation Attack DetectionFace Recognition

Temporal Bilinear Networks for Video Action Recognition

2018-11-25 · Yanghao Li, Sijie Song, Yuqi Li, Jiaying Liu

Temporal modeling in videos is a fundamental yet challenging problem in computer vision. In this paper, we propose a novel Temporal Bilinear (TB) model to capture the temporal pairwise feature interactions between adjace…

Action RecognitionTemporal Action Localization

Multi-modal Factorized Bilinear Pooling with Co-Attention Learning for Visual Question Answering

2017-08-04 · ICCV 2017 10 · Zhou Yu, Jun Yu, Jianping Fan, DaCheng Tao

Visual question answering (VQA) is challenging because it requires a simultaneous understanding of both the visual content of images and the textual content of questions. The approaches used to represent the images and q…

Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)

Feature-based factorized Bilinear Similarity Model for Cold-Start Top-n Item Recommendation

2019-04-22 · Mohit Sharma, Jiayu Zhou, Junling Hu, George Karypis

Recommending new items to existing users has remained a challenging problem due to absence of user's past preferences for these items. The user personalized non-collaborative methods based on item features can be used to…