paper-with-me

홈 › Papers

Using Large Pretrained Language Models for Answering User Queries from Product Specifications

2020-05-29 · WS 2020 7 · Kalyani Roy, Smit Shah, Nithish Pai, Jaidam Ramtej, Prajit Prashant Nadkarn, Jyotirmoy Banerjee, Pawan Goyal, Surender Kumar

While buying a product from the e-commerce websites, customers generally have a plethora of questions. From the perspective of both the e-commerce service provider as well as the customers, there must be an effective question answering system to provide immediate answers to the user queries. While certain questions can only be answered after using the product, there are many questions which can be answered from the product specification itself. Our work takes a first step in this direction by finding out the relevant product specifications, that can help answering the user questions. We propose an approach to automatically create a training dataset for this problem. We utilize recently proposed XLNet and BERT architectures for this problem and find that they provide much better performance than the Siamese model, previously applied for this problem. Our model gives a good performance even when trained on one vertical and tested across different verticals.

📄 PDF Abstract BibTeX arXiv:2005.14613

Code (0)

등록된 구현이 없습니다.

Tasks

Question Answering

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Weight Decay 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Attention 설명 없음
WordPiece 설명 없음

Similar Papers 제목 키워드 기반

Question answering system of bridge design specification based on large language model

2024-08-26 · Leye Zhang, Xiangxiang Tian, Hongjun Zhang

This paper constructs question answering system for bridge design specification based on large language model. Three implementation schemes are tried: full fine-tuning of the Bert pretrained model, parameter-efficient fi…

Language ModelingLanguage ModellingLarge Language Modelparameter-efficient fine-tuning+2

PiggyBack: Pretrained Visual Question Answering Environment for Backing up Non-deep Learning Professionals

2022-11-29 · Zhihao Zhang, Siwen Luo, Junyi Chen, Sijia Lai 외

We propose a PiggyBack, a Visual Question Answering platform that allows users to apply the state-of-the-art visual-language pretrained models easily. The PiggyBack supports the full stack of visual question answering ta…

Deep LearningQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)

Dr. Tux: A Question Answering System for Ubuntu users

2018-08-25 · Bijil Abraham Philip, Manas Jog, Apurv Milind Upasani

Various forums and question answering (Q&A) sites are available online that allow Ubuntu users to find results similar to their queries. However, searching for a result is often time consuming as it requires the user to …

Question Answering

IQA: Interactive Query Construction in Semantic Question Answering Systems

2020-06-20 · Hamid Zafar, Mohnish Dubey, Jens Lehmann, Elena Demidova

Semantic Question Answering (SQA) systems automatically interpret user questions expressed in a natural language in terms of semantic queries. This process involves uncertainty, such that the resulting queries do not alw…

Question Answering

LifelongMemory: Leveraging LLMs for Answering Queries in Long-form Egocentric Videos

2023-12-07 · Ying Wang, Yanlai Yang, Mengye Ren

In this paper we introduce LifelongMemory, a new framework for accessing long-form egocentric videographic memory through natural language question answering and retrieval. LifelongMemory generates concise video activity…

EgoSchemaFormQuestion AnsweringRetrieval