Ad Headline Generation using Self-Critical Masked Language Model
For any E-commerce website it is a nontrivial problem to build enduring advertisements that attract shoppers. It is hard to pass the creative quality bar of the website, especially at a large scale. We thus propose a programmatic solution to generate product advertising headlines using retail content. We propose a state of the art application of Reinforcement Learning (RL) Policy gradient methods on Transformer (Vaswani et al., 2017) based Masked Language Models (Devlin et al., 2019). Our method creates the advertising headline by jointly conditioning on multiple products that a seller wishes to advertise. We demonstrate that our method outperforms existing Transformer and LSTM + RL methods in overlap metrics and quality audits. We also show that our model generated headlines outperform human submitted headlines in terms of both grammar and creative quality as determined by audits.
Code (0)
등록된 구현이 없습니다.
Tasks
Headline GenerationLanguage ModelingLanguage ModellingPolicy Gradient MethodsReinforcement Learning (RL)Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Ad Headline Generation using Self-Critical Masked Language Model
For any E-commerce website it is a nontrivial problem to build enduring advertisements that attract shoppers. It is hard to pass the creative quality bar of the website, especially at a large scale. We thus propose a pro…
Reinforcement LearningHeadline GenerationBeliN: A Novel Corpus for Bengali Religious News Headline Generation using Contextual Feature Fusion
Automatic text summarization, particularly headline generation, remains a critical yet underexplored area for Bengali religious news. Existing approaches to headline generation typically rely solely on the article conten…
ArticlesHeadline GenerationText Summarization"Why is this misleading?": Detecting News Headline Hallucinations with Explanations
Automatic headline generation enables users to comprehend ongoing news events promptly and has recently become an important task in web mining and natural language processing. With the growing need for news headline gene…
HallucinationHeadline GenerationNatural Language InferenceSelf-Attentive Model for Headline Generation
Headline generation is a special type of text summarization task. While the amount of available training data for this task is almost unlimited, it still remains challenging, as learning to generate headlines for news ar…
ArticlesHeadline GenerationmodelText SummarizationContrastive Learning enhanced Author-Style Headline Generation
Headline generation is a task of generating an appropriate headline for a given article, which can be further used for machine-aided writing or enhancing the click-through ratio. Current works only use the article itself…
ArticlesContrastive LearningDecoderHeadline Generation