Large-scale Multi-class and Hierarchical Product Categorization for an E-commerce Giant
In order to organize the large number of products listed in e-commerce sites, each product is usually assigned to one of the multi-level categories in the taxonomy tree. It is a time-consuming and difficult task for merchants to select proper categories within thousands of options for the products they sell. In this work, we propose an automatic classification tool to predict the matching category for a given product title and description. We used a combination of two different neural models, i.e., deep belief nets and deep autoencoders, for both titles and descriptions. We implemented a selective reconstruction approach for the input layer during the training of the deep neural networks, in order to scale-out for large-sized sparse feature vectors. GPUs are utilized in order to train neural networks in a reasonable time. We have trained our models for around 150 million products with a taxonomy tree with at most 5 levels that contains 28,338 leaf categories. Tests with millions of products show that our first predictions matches 81{\%} of merchants{'} assignments, when {``}others{''} categories are excluded.
Code (0)
등록된 구현이 없습니다.
Tasks
General ClassificationProduct CategorizationText ClassificationSimilar Papers 제목 키워드 기반
Learning curves theory for hierarchically compositional data with power-law distributed features
Recent theories suggest that Neural Scaling Laws arise whenever the task is linearly decomposed into power-law distributed units. Alternatively, scaling laws also emerge when data exhibit a hierarchically compositional s…
A BERT-based Hierarchical Classification Model with Applications in Chinese Commodity Classification
Existing e-commerce platforms heavily rely on manual annotation for product categorization, which is inefficient and inconsistent. These platforms often employ a hierarchical structure for categorizing products; however,…
Product CategorizationText ClassificationHierarchically Supervised Latent Dirichlet Allocation
We introduce hierarchically supervised latent Dirichlet allocation (HSLDA), a model for hierarchically and multiply labeled bag-of-word data. Examples of such data include web pages and their placement in directories, pr…
Product CategorizationeProduct: A Million-Scale Visual Search Benchmark to Address Product Recognition Challenges
Large-scale product recognition is one of the major applications of computer vision and machine learning in the e-commerce domain. Since the number of products is typically much larger than the number of categories of pr…
DiversitySelf-Supervised LearningWeakly-supervised LearningHierarchical Similarity Learning for Language-based Product Image Retrieval
This paper aims for the language-based product image retrieval task. The majority of previous works have made significant progress by designing network structure, similarity measurement, and loss function. However, they …
Image RetrievalRetrievalText Matching