paper-with-me

홈 › Papers

The design and implementation of Language Learning Chatbot with XAI using Ontology and Transfer Learning

2020-09-29 · Nuobei Shi, Qin Zeng, Raymond Lee

In this paper, we proposed a transfer learning-based English language learning chatbot, whose output generated by GPT-2 can be explained by corresponding ontology graph rooted by fine-tuning dataset. We design three levels for systematically English learning, including phonetics level for speech recognition and pronunciation correction, semantic level for specific domain conversation, and the simulation of free-style conversation in English - the highest level of language chatbot communication as free-style conversation agent. For academic contribution, we implement the ontology graph to explain the performance of free-style conversation, following the concept of XAI (Explainable Artificial Intelligence) to visualize the connections of neural network in bionics, and explain the output sentence from language model. From implementation perspective, our Language Learning agent integrated the mini-program in WeChat as front-end, and fine-tuned GPT-2 model of transfer learning as back-end to interpret the responses by ontology graph.

📄 PDF Abstract BibTeX arXiv:2009.13984

Code (0)

등록된 구현이 없습니다.

Tasks

ChatbotExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)Language ModelingLanguage ModellingSentencespeech-recognitionSpeech RecognitionTransfer Learning

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Warmup With Cosine Annealing Linear Warmup With Cosine Annealing is a learning rate schedule where we increase the learning rate linearly for $n$ updates and then anneal according to a cosine schedule…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

OntoChatGPT Information System: Ontology-Driven Structured Prompts for ChatGPT Meta-Learning

2023-07-11 · Oleksandr Palagin, Vladislav Kaverinskiy, Anna Litvin, Kyrylo Malakhov

This research presents a comprehensive methodology for utilizing an ontology-driven structured prompts system in interplay with ChatGPT, a widely used large language model (LLM). The study develops formal models, both in…

ChatbotInformation RetrievalLanguage ModellingLarge Language Model+2

Chatbot-Based Ontology Interaction Using Large Language Models and Domain-Specific Standards

2024-07-22 · Jonathan Reif, Tom Jeleniewski, Milapji Singh Gill, Felix Gehlhoff 외

The following contribution introduces a concept that employs Large Language Models (LLMs) and a chatbot interface to enhance SPARQL query generation for ontologies, thereby facilitating intuitive access to formalized kno…

ChatbotMisinformation

Beyond Ontology in Dialogue State Tracking for Goal-Oriented Chatbot

2024-10-30 · Sejin Lee, Dongha Kim, Min Song

Goal-oriented chatbots are essential for automating user tasks, such as booking flights or making restaurant reservations. A key component of these systems is Dialogue State Tracking (DST), which interprets user intent a…

ChatbotDialogue State TrackingHallucinationLanguage Modeling+2

An ontology-based chatbot for crises management: use case coronavirus

2020-11-02 · Khouloud Hwerbi

Today is the era of intelligence in machines. With the advances in Artificial Intelligence, machines have started to impersonate different human traits, a chatbot is the next big thing in the domain of conversational ser…

ChatbotManagement

Improving Customer Service Chatbots with Attention-based Transfer Learning

2021-11-24 · Jordan J. Bird

With growing societal acceptance and increasing cost efficiency due to mass production, service robots are beginning to cross from the industrial to the social domain. Currently, customer service robots tend to be digita…

ChatbotTransfer Learning