paper-with-me

Papers

Generative Modeling with Multi-Instance Reward Learning for E-commerce Creative Optimization

2025-08-13 · Qiaolei Gu, Yu Li, DingYi Zeng, Lu Wang, Ming Pang, Changping Peng, Zhangang Lin, Ching Law, Jingping Shao arxiv

In e-commerce advertising, selecting the most compelling combination of creative elements -- such as titles, images, and highlights -- is critical for capturing user attention and driving conversions. However, existing methods often evaluate creative components individually, failing to navigate the exponentially large search space of possible combinations. To address this challenge, we propose a novel framework named GenCO that integrates generative modeling with multi-instance reward learning. Our unified two-stage architecture first employs a generative model to efficiently produce a diverse set of creative combinations. This generative process is optimized with reinforcement learning, enabling the model to effectively explore and refine its selections. Next, to overcome the challenge of sparse user feedback, a multi-instance learning model attributes combination-level rewards, such as clicks, to the individual creative elements. This allows the reward model to provide a more accurate feedback signal, which in turn guides the generative model toward creating more effective combinations. Deployed on a leading e-commerce platform, our approach has significantly increased advertising revenue, demonstrating its practical value. Additionally, we are releasing a large-scale industrial dataset to facilitate further research in this important domain.

📄 PDF Abstract BibTeX arXiv:2508.09730

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

Learning Instance-Level Representation for Large-Scale Multi-Modal Pretraining in E-commerce

2023-04-06 · CVPR 2023 1 · Yang Jin, Yongzhi Li, Zehuan Yuan, Yadong Mu

This paper aims to establish a generic multi-modal foundation model that has the scalable capability to massive downstream applications in E-commerce. Recently, large-scale vision-language pretraining approaches have ach…

Decoder

SHE: Stepwise Hybrid Examination Reinforcement Learning Framework for E-commerce Search Relevance

2025-10-09 · Pengkun Jiao, Yiming Jin, Jianhui Yang, Chenhe Dong 외 arxiv

Query-product relevance prediction is vital for AI-driven e-commerce, yet current LLM-based approaches face a dilemma: SFT and DPO struggle with long-tail generalization due to coarse supervision, while traditional RLVR …

Reinforcement Learning

MindFlow+: A Self-Evolving Agent for E-Commerce Customer Service

2025-07-25 · Ming Gong, Xucheng Huang, Ziheng Xu, Vijayan K. Asari arxiv

High-quality dialogue is crucial for e-commerce customer service, yet traditional intent-based systems struggle with dynamic, multi-turn interactions. We present MindFlow+, a self-evolving dialogue agent that learns doma…

Reinforcement LearningResponse Generation

BaNEL: Exploration Posteriors for Generative Modeling Using Only Negative Rewards

2025-10-10 · Sangyun Lee, Brandon Amos, Giulia Fanti arxiv

Today's generative models thrive with large amounts of supervised data and informative reward functions characterizing the quality of the generation. They work under the assumptions that the supervised data provides know…

DeltaRubric: Generative Multimodal Reward Modeling via Joint Planning and Verification

2026-05-10 · Rui Liu, Dian Yu, Zhenwen Liang, Yucheng Shi 외 arxiv

Aligning Multimodal Large Language Models (MLLMs) requires reliable reward models, yet existing single-step evaluators can suffer from lazy judging, exploiting language priors over fine-grained visual verification. While…

Reinforcement LearningVisual Reasoning