paper-with-me

홈 › Papers

UFIN: Universal Feature Interaction Network for Multi-Domain Click-Through Rate Prediction

2023-11-27 · Zhen Tian, Changwang Zhang, Wayne Xin Zhao, Xin Zhao, Ji-Rong Wen, Zhao Cao

Click-Through Rate (CTR) prediction, which aims to estimate the probability of a user clicking on an item, is a key task in online advertising. Numerous existing CTR models concentrate on modeling the feature interactions within a solitary domain, thereby rendering them inadequate for fulfilling the requisites of multi-domain recommendations in real industrial scenarios. Some recent approaches propose intricate architectures to enhance knowledge sharing and augment model training across multiple domains. However, these approaches encounter difficulties when being transferred to new recommendation domains, owing to their reliance on the modeling of ID features (e.g., item id). To address the above issue, we propose the Universal Feature Interaction Network (UFIN) approach for CTR prediction. UFIN exploits textual data to learn universal feature interactions that can be effectively transferred across diverse domains. For learning universal feature representations, we regard the text and feature as two different modalities and propose an encoder-decoder network founded on a Large Language Model (LLM) to enforce the transfer of data from the text modality to the feature modality. Building upon the above foundation, we further develop a mixtureof-experts (MoE) enhanced adaptive feature interaction model to learn transferable collaborative patterns across multiple domains. Furthermore, we propose a multi-domain knowledge distillation framework to enhance feature interaction learning. Based on the above methods, UFIN can effectively bridge the semantic gap to learn common knowledge across various domains, surpassing the constraints of ID-based models. Extensive experiments conducted on eight datasets show the effectiveness of UFIN, in both multidomain and cross-platform settings. Our code is available at https://github.com/RUCAIBox/UFIN.

📄 PDF Abstract BibTeX arXiv:2311.15493

Code (1)

rucaibox/ufin 공식 구현 pytorch

Tasks

Click-Through Rate PredictionKnowledge DistillationLanguage ModellingLarge Language Model

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

UFineBench: Towards Text-based Person Retrieval with Ultra-fine Granularity

2023-12-06 · CVPR 2024 1 · Jialong Zuo, Hanyu Zhou, Ying Nie, Feng Zhang 외

Existing text-based person retrieval datasets often have relatively coarse-grained text annotations. This hinders the model to comprehend the fine-grained semantics of query texts in real scenarios. To address this probl…

Person RetrievalRetrievalText based Person RetrievalText-based Person Retrieval

Multi-modal Extreme Classification

2023-09-10 · CVPR 2022 1 · Anshul Mittal, Kunal Dahiya, Shreya Malani, Janani Ramaswamy 외

This paper develops the MUFIN technique for extreme classification (XC) tasks with millions of labels where datapoints and labels are endowed with visual and textual descriptors. Applications of MUFIN to product-to-produ…

ClassificationProduct Recommendation

RUFINO at SemEval-2017 Task 2: Cross-lingual lexical similarity by extending PMI and word embeddings systems with a Swadesh's-like list

2017-08-01 · SEMEVAL 2017 8 · Sergio Jimenez, George Due{\~n}as, Lorena Gaitan, Jorge Segura

The RUFINO team proposed a non-supervised, conceptually-simple and low-cost approach for addressing the Multilingual and Cross-lingual Semantic Word Similarity challenge at SemEval 2017. The proposed systems were cross-l…

Semantic Textual SimilarityTask 2Word EmbeddingsWord Sense Disambiguation+1

Hierarchical Multi-Fidelity Learning for Predicting Three-Dimensional Flame Wrinkling and Turbulent Burning Velocity

2026-05-06 · Saghar Zolfaghari, Yu Xie, Junfeng Yang, Safa Jamali arxiv

High-fidelity experimental characterization of turbulent premixed flames remains limited by the cost and complexity of advanced diagnostics, particularly under elevated pressures and intense turbulence where measurements…

Universal Feature Selection for Simultaneous Interpretability of Multitask Datasets

2024-03-21 · Matt Raymond, Jacob Charles Saldinger, Paolo Elvati, Clayton Scott 외

Extracting meaningful features from complex, high-dimensional datasets across scientific domains remains challenging. Current methods often struggle with scalability, limiting their applicability to large datasets, or ma…

feature selectionTransfer Learning