paper-with-me

홈 › Papers

Learning Feature Interactions with Lorentzian Factorization Machine

2019-11-22 · Canran Xu, Ming Wu

Learning representations for feature interactions to model user behaviors is critical for recommendation system and click-trough rate (CTR) predictions. Recent advances in this area are empowered by deep learning methods which could learn sophisticated feature interactions and achieve the state-of-the-art result in an end-to-end manner. These approaches require large number of training parameters integrated with the low-level representations, and thus are memory and computational inefficient. In this paper, we propose a new model named "LorentzFM" that can learn feature interactions embedded in a hyperbolic space in which the violation of triangle inequality for Lorentz distances is available. To this end, the learned representation is benefited by the peculiar geometric properties of hyperbolic triangles, and result in a significant reduction in the number of parameters (20\% to 80\%) because all the top deep learning layers are not required. With such a lightweight architecture, LorentzFM achieves comparable and even materially better results than the deep learning methods such as DeepFM, xDeepFM and Deep \& Cross in both recommendation and CTR prediction tasks.

📄 PDF Abstract BibTeX arXiv:1911.09821

Code (2)

UlionTse/mlgb pytorch
xue-pai/FuxiCTR pytorch

Tasks

Click-Through Rate PredictionDeep Learning

Similar Papers 제목 키워드 기반

Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attention Networks

2017-08-15 · Jun Xiao, Hao Ye, Xiangnan He, Hanwang Zhang 외

Factorization Machines (FMs) are a supervised learning approach that enhances the linear regression model by incorporating the second-order feature interactions. Despite effectiveness, FM can be hindered by its modelling…

regression

GraphFM: Graph Factorization Machines for Feature Interaction Modeling

2021-05-25 · Shu Wu, Zekun Li, Yunyue Su, Zeyu Cui 외

Factorization machine (FM) is a prevalent approach to modeling pairwise (second-order) feature interactions when dealing with high-dimensional sparse data. However, on the one hand, FM fails to capture higher-order featu…

Graph Neural Network

AdnFM: An Attentive DenseNet based Factorization Machine for CTR Prediction

2020-12-20 · Kai Wang, Chunxu Shen, Chaoyun Zhang Wenye Ma

In this paper, we consider the Click-Through-Rate (CTR) prediction problem. Factorization Machines and their variants consider pair-wise feature interactions, but normally we won't do high-order feature interactions usin…

Click-Through Rate Prediction

FiBiNET: Combining Feature Importance and Bilinear feature Interaction for Click-Through Rate Prediction

2019-05-23 · Tongwen Huang, Zhiqi Zhang, Junlin Zhang

Advertising and feed ranking are essential to many Internet companies such as Facebook and Sina Weibo. Among many real-world advertising and feed ranking systems, click through rate (CTR) prediction plays a central role.…

Click-Through Rate PredictionFeature ImportanceRecommendation Systems

Interaction-aware Factorization Machines for Recommender Systems

2019-02-26 · Fuxing Hong, Dongbo Huang, Ge Chen

Factorization Machine (FM) is a widely used supervised learning approach by effectively modeling of feature interactions. Despite the successful application of FM and its many deep learning variants, treating every featu…

Recommendation Systems