paper-with-me

홈 › Papers

Probing Product Description Generation via Posterior Distillation

2021-03-02 · Haolan Zhan, Hainan Zhang, Hongshen Chen, Lei Shen, Zhuoye Ding, Yongjun Bao, Weipeng Yan, Yanyan Lan

In product description generation (PDG), the user-cared aspect is critical for the recommendation system, which can not only improve user's experiences but also obtain more clicks. High-quality customer reviews can be considered as an ideal source to mine user-cared aspects. However, in reality, a large number of new products (known as long-tailed commodities) cannot gather sufficient amount of customer reviews, which brings a big challenge in the product description generation task. Existing works tend to generate the product description solely based on item information, i.e., product attributes or title words, which leads to tedious contents and cannot attract customers effectively. To tackle this problem, we propose an adaptive posterior network based on Transformer architecture that can utilize user-cared information from customer reviews. Specifically, we first extend the self-attentive Transformer encoder to encode product titles and attributes. Then, we apply an adaptive posterior distillation module to utilize useful review information, which integrates user-cared aspects to the generation process. Finally, we apply a Transformer-based decoding phase with copy mechanism to automatically generate the product description. Besides, we also collect a large-scare Chinese product description dataset to support our work and further research in this field. Experimental results show that our model is superior to traditional generative models in both automatic indicators and human evaluation.

📄 PDF Abstract BibTeX arXiv:2103.01594

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Residual Connection 설명 없음
Adam 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Learning to Generate Compositional Color Descriptions

2016-06-13 · EMNLP 2016 11 · Will Monroe, Noah D. Goodman, Christopher Potts

The production of color language is essential for grounded language generation. Color descriptions have many challenging properties: they can be vague, compositionally complex, and denotationally rich. We present an effe…

Language ModelingLanguage ModellingText Generation

Can We Use Probing to Better Understand Fine-tuning and Knowledge Distillation of the BERT NLU?

2023-01-27 · Jakub Hościłowicz, Marcin Sowański, Piotr Czubowski, Artur Janicki

In this article, we use probing to investigate phenomena that occur during fine-tuning and knowledge distillation of a BERT-based natural language understanding (NLU) model. Our ultimate purpose was to use probing to bet…

Knowledge DistillationNatural Language Understanding

GridProbe: Posterior-Probing for Adaptive Test-Time Compute in Long-Video VLMs

2026-05-11 · Mohamed Eltahir, Lama Ayash, Ali Habibullah, Tanveer Hussain 외 arxiv

Long-video understanding in VLMs is bottlenecked by a single monolithic forward pass over thousands of frames at quadratic attention cost. A common mitigation is to first select a small subset of informative frames befor…

A Statistical Framework for Product Description Generation

2017-11-01 · IJCNLP 2017 11 · Jinpeng Wang, Yutai Hou, Jing Liu, Yunbo Cao 외

We present in this paper a statistical framework that generates accurate and fluent product description from product attributes. Specifically, after extracting templates and learning writing knowledge from attribute-desc…

AttributeData-to-Text GenerationText Generation

Stick to Facts: Towards Fidelity-oriented Product Description Generation

2025-03-11 · Zhangming Chan, Xiuying Chen, Yongliang Wang, Juntao Li 외

Different from other text generation tasks, in product description generation, it is of vital importance to generate faithful descriptions that stick to the product attribute information. However, little attention has be…

AttributeDecoderText Generation