paper-with-me

Papers

eCeLLM: Generalizing Large Language Models for E-commerce from Large-scale, High-quality Instruction Data

2024-02-13 · Bo Peng, Xinyi Ling, Ziru Chen, Huan Sun, Xia Ning

With tremendous efforts on developing effective e-commerce models, conventional e-commerce models show limited success in generalist e-commerce modeling, and suffer from unsatisfactory performance on new users and new products - a typical out-of-domain generalization challenge. Meanwhile, large language models (LLMs) demonstrate outstanding performance in generalist modeling and out-of-domain generalizability in many fields. Toward fully unleashing their power for e-commerce, in this paper, we construct ECInstruct, the first open-sourced, large-scale, and high-quality benchmark instruction dataset for e-commerce. Leveraging ECInstruct, we develop eCeLLM, a series of e-commerce LLMs, by instruction-tuning general-purpose LLMs. Our comprehensive experiments and evaluation demonstrate that eCeLLM models substantially outperform baseline models, including the most advanced GPT-4, and the state-of-the-art task-specific models in in-domain evaluation. Moreover, eCeLLM exhibits excellent generalizability to out-of-domain settings, including unseen products and unseen instructions, highlighting its superiority as a generalist e-commerce model. Both the ECInstruct dataset and the eCeLLM models show great potential in empowering versatile and effective LLMs for e-commerce. ECInstruct and eCeLLM models are publicly accessible through https://ninglab.github.io/eCeLLM.

📄 PDF Abstract BibTeX arXiv:2402.08831

Code (1)

ninglab/ecellm 공식 구현 pytorch

Tasks

Domain Generalization

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Towards Reliable Evaluation of Large Language Models for Multilingual and Multimodal E-Commerce Applications

2025-10-23 · Shuyi Xie, Ziqin Liew, Hailing Zhang, Haibo Zhang 외 arxiv

Large Language Models (LLMs) excel on general-purpose NLP benchmarks, yet their capabilities in specialized domains remain underexplored. In e-commerce, existing evaluations-such as EcomInstruct, ChineseEcomQA, eCeLLM, a…

Captions Speak Louder than Images (CASLIE): Generalizing Foundation Models for E-commerce from High-quality Multimodal Instruction Data

2024-10-22 · Xinyi Ling, Bo Peng, Hanwen Du, Zhihui Zhu 외

Leveraging multimodal data to drive breakthroughs in e-commerce applications through Multimodal Foundation Models (MFMs) is gaining increasing attention from the research community. However, there are significant challen…

Product Information Extraction using ChatGPT

2023-06-23 · Alexander Brinkmann, Roee Shraga, Reng Chiz Der, Christian Bizer

Structured product data in the form of attribute/value pairs is the foundation of many e-commerce applications such as faceted product search, product comparison, and product recommendation. Product offers often only con…

AttributeLanguage ModelingLanguage ModellingProduct Recommendation

LLP: LLM-based Product Pricing in E-commerce

2025-10-10 · Hairu Wang, Sheng You, Qiheng Zhang, Xike Xie 외 arxiv

Unlike Business-to-Consumer e-commerce platforms (e.g., Amazon), inexperienced individual sellers on Consumer-to-Consumer platforms (e.g., eBay) often face significant challenges in setting prices for their second-hand p…

Investigating LLM Applications in E-Commerce

2024-08-23 · Chester Palen-Michel, Ruixiang Wang, YiPeng Zhang, David Yu 외

The emergence of Large Language Models (LLMs) has revolutionized natural language processing in various applications especially in e-commerce. One crucial step before the application of such LLMs in these fields is to un…

In-Context Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1