EIVEN: Efficient Implicit Attribute Value Extraction using Multimodal LLM
In e-commerce, accurately extracting product attribute values from multimodal data is crucial for improving user experience and operational efficiency of retailers. However, previous approaches to multimodal attribute value extraction often struggle with implicit attribute values embedded in images or text, rely heavily on extensive labeled data, and can easily confuse similar attribute values. To address these issues, we introduce EIVEN, a data- and parameter-efficient generative framework that pioneers the use of multimodal LLM for implicit attribute value extraction. EIVEN leverages the rich inherent knowledge of a pre-trained LLM and vision encoder to reduce reliance on labeled data. We also introduce a novel Learning-by-Comparison technique to reduce model confusion by enforcing attribute value comparison and difference identification. Additionally, we construct initial open-source datasets for multimodal implicit attribute value extraction. Our extensive experiments reveal that EIVEN significantly outperforms existing methods in extracting implicit attribute values while requiring less labeled data.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeAttribute Value ExtractionMultimodal Attribute Value ExtractionSimilar Papers 제목 키워드 기반
ImplicitAVE: An Open-Source Dataset and Multimodal LLMs Benchmark for Implicit Attribute Value Extraction
Existing datasets for attribute value extraction (AVE) predominantly focus on explicit attribute values while neglecting the implicit ones, lack product images, are often not publicly available, and lack an in-depth huma…
AttributeAttribute Value ExtractionBenchmarkingMultimodal Attribute Value ExtractionMADIAVE: Multi-Agent Debate for Implicit Attribute Value Extraction
Implicit Attribute Value Extraction (AVE) is essential for accurately representing products in e-commerce, as it infers latent attributes from multimodal data. Despite advances in multimodal large language models (MLLMs)…
Attribute Value ExtractionMultimodal Joint Attribute Prediction and Value Extraction for E-commerce Product
Product attribute values are essential in many e-commerce scenarios, such as customer service robots, product recommendations, and product retrieval. While in the real world, the attribute values of a product are usually…
AttributeAttribute Value ExtractionMultimodal Attribute Value ExtractionRetrievalAutoPKG: An Automated Framework for Dynamic E-commerce Product-Attribute Knowledge Graph Construction
Product attribute extraction in e-commerce is bottlenecked by ontologies that are inconsistent, incomplete, and costly to maintain. We present AutoPKG, a multi-agent Large Language Model (LLM) framework that automaticall…
Attribute ExtractionMultimodal Attribute Extraction
The broad goal of information extraction is to derive structured information from unstructured data. However, most existing methods focus solely on text, ignoring other types of unstructured data such as images, video an…
AttributeAttribute ExtractionMultimodal Attribute Value Extraction