paper-with-me

홈 › Papers

Retrieval and Generative Approaches for a Pregnancy Chatbot in Nepali with Stemmed and Non-Stemmed Data : A Comparative Study

2023-11-12 · Sujan Poudel, Nabin Ghimire, Bipesh Subedi, Saugat Singh

The field of Natural Language Processing which involves the use of artificial intelligence to support human languages has seen tremendous growth due to its high-quality features. Its applications such as language translation, chatbots, virtual assistants, search autocomplete, and autocorrect are widely used in various domains including healthcare, advertising, customer service, and target advertising. To provide pregnancy-related information a health domain chatbot has been proposed and this work explores two different NLP-based approaches for developing the chatbot. The first approach is a multiclass classification-based retrieval approach using BERTbased multilingual BERT and multilingual DistilBERT while the other approach employs a transformer-based generative chatbot for pregnancy-related information. The performance of both stemmed and non-stemmed datasets in Nepali language has been analyzed for each approach. The experimented results indicate that BERT-based pre-trained models perform well on non-stemmed data whereas scratch transformer models have better performance on stemmed data. Among the models tested the DistilBERT model achieved the highest training and validation accuracy and testing accuracy of 0.9165 on the retrieval-based model architecture implementation on the non-stemmed dataset. Similarly, in the generative approach architecture implementation with transformer 1 gram BLEU and 2 gram BLEU scores of 0.3570 and 0.1413 respectively were achieved.

📄 PDF Abstract BibTeX arXiv:2311.06898

Code (0)

등록된 구현이 없습니다.

Tasks

ChatbotRetrieval

Methods 이 논문이 사용한 방법론

Golden Queue Managers 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Retrieval Augmented Generation Framework for the Nepali Legal Domain Question Answering

2026-04-20 · Samir Wagle, Abiral Adhikari, Reewaj Khanal, Batsal Bhandari 외 arxiv

Legal domains in high-resource languages like English have widely adopted artificial intelligence for legal question answering. However, data scarcity in low resource languages such as Nepali has limited the training of …

Question AnsweringAnswer Generation

Nepali Passport Question Answering: A Low-Resource Dataset for Public Service Applications

2026-03-04 · Funghang Limbu Begha, Praveen Acharya, Bal Krishna Bal arxiv

Nepali, a low-resource language, faces significant challenges in building an effective information retrieval system due to the unavailability of annotated data and computational linguistic resources. In this study, we at…

Information RetrievalSemantic SimilarityQuestion Answering

Generative AI for Named Entity Recognition in Low-Resource Language Nepali

2025-03-12 · Sameer Neupane, Jeevan Chapagain, Nobal B. Niraula, Diwa Koirala

Generative Artificial Intelligence (GenAI), particularly Large Language Models (LLMs), has significantly advanced Natural Language Processing (NLP) tasks, such as Named Entity Recognition (NER), which involves identifyin…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER

Memory-Based Deep Neural Attention (mDNA) for Cognitive Multi-Turn Response Retrieval in Task-Oriented Chatbots

2020-08-22 · MDPI Applied Sciences 2020 8 · Jenhui Chen, Obinna Agbodike, Lei Wang

One of the important criteria used in judging the performance of a chatbot is the ability to provide meaningful and informative responses that correspond with the context of a user’s utterance. Nowadays, the number of en…

ChatbotRetrieval

A Nepali Rule Based Stemmer and its performance on different NLP applications

2020-02-23 · Pravesh Koirala, Aman Shakya

Stemming is an integral part of Natural Language Processing (NLP). It's a preprocessing step in almost every NLP application. Arguably, the most important usage of stemming is in Information Retrieval (IR). While there a…

Information RetrievalRetrieval