Who wrote this book? A challenge for e-commerce
Modern e-commerce catalogs contain millions of references, associated with textual and visual information that is of paramount importance for the products to be found via search or browsing. Of particular significance is the book category, where the author name(s) field poses a significant challenge. Indeed, books written by a given author (such as F. Scott Fitzgerald) might be listed with different authors' names in a catalog due to abbreviations and spelling variants and mistakes, among others. To solve this problem at scale, we design a composite system involving open data sources for books as well as machine learning components leveraging deep learning-based techniques for natural language processing. In particular, we use Siamese neural networks for an approximate match with known author names, and direct correction of the provided author's name using sequence-to-sequence learning with neural networks. We evaluate this approach on product data from the e-commerce website Rakuten France, and find that the top proposal of the system is the normalized author name with 72% accuracy.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Generative Retrieval for E-commerce: Jointly Learning Embedding and Codebook with Same Product Cluster
With the development of large language models (LLMs), generative retrieval is becoming increasingly important in e-commerce scenarios. Current mainstream approaches typically use a two-stage training strategy: first trai…
Who Wrote the Book? Detecting and Attributing LLM Ghostwriters
In this paper, we introduce GhostWriteBench, a dataset for LLM authorship attribution. It comprises long-form texts (50K+ words per book) generated by frontier LLMs, and is designed to test generalisation across multiple…
A Speed Limit for Evolution: Postscript
In 1995 I wrote a paper: "A Speed Limit for Evolution" whose main result was that evolution must proceed rather slowly, in accordance with the earlier views and intuitions of many authors. The abstract of the paper said:…
Extending Open Bandit Pipeline to Simulate Industry Challenges
Bandit algorithms are often used in the e-commerce industry to train Machine Learning (ML) systems when pre-labeled data is unavailable. However, the industry setting poses various challenges that make implementing bandi…
HierCat: Hierarchical Query Categorization from Weakly Supervised Data at Facebook Marketplace
Query categorization at customer-to-customer e-commerce platforms like Facebook Marketplace is challenging due to the vagueness of search intent, noise in real-world data, and imbalanced training data across languages. I…