Hadamard Product for Low-rank Bilinear Pooling
Bilinear models provide rich representations compared with linear models. They have been applied in various visual tasks, such as object recognition, segmentation, and visual question-answering, to get state-of-the-art performances taking advantage of the expanded representations. However, bilinear representations tend to be high-dimensional, limiting the applicability to computationally complex tasks. We propose low-rank bilinear pooling using Hadamard product for an efficient attention mechanism of multimodal learning. We show that our model outperforms compact bilinear pooling in visual question-answering tasks with the state-of-the-art results on the VQA dataset, having a better parsimonious property.
Code (11)
Tasks
Visual Question AnsweringVisual Question Answering (VQA)Similar Papers 제목 키워드 기반
Hadamard Extensions and the Identification of Mixtures of Product Distributions
The Hadamard Extension of a matrix is the matrix consisting of all Hadamard products of subsets of its rows. This construction arises in the context of identifying a mixture of product distributions on binary random vari…
FiBiNET: Combining Feature Importance and Bilinear feature Interaction for Click-Through Rate Prediction
Advertising and feed ranking are essential to many Internet companies such as Facebook and Sina Weibo. Among many real-world advertising and feed ranking systems, click through rate (CTR) prediction plays a central role.…
Click-Through Rate PredictionFeature ImportanceRecommendation SystemsToward Faster and Simpler Matrix Normalization via Rank-1 Update
Bilinear pooling has achieved an impressive improvement in many computer vision tasks. Recent studies discover that matrix normalization is vital for improving the performance of bilinear pooling. Nevertheless, tradition…
GPULow-rank Bilinear Pooling for Fine-Grained Classification
Pooling second-order local feature statistics to form a high-dimensional bilinear feature has been shown to achieve state-of-the-art performance on a variety of fine-grained classification tasks. To address the computati…
ClassificationGeneral ClassificationBoHA: Blockwise Hadamard Product Adaptation for Parameter-Efficient Fine-Tuning
Parameter-efficient fine-tuning (PEFT) of large language models trains a small task-specific parameter set while keeping the pretrained model frozen. The dominant Low-Rank Adaptation (LoRA) family makes this trade-off pr…
parameter-efficient fine-tuningArithmetic Reasoning