Intent Classification for Bank Chatbots through LLM Fine-Tuning
This study evaluates the application of large language models (LLMs) for intent classification within a chatbot with predetermined responses designed for banking industry websites. Specifically, the research examines the effectiveness of fine-tuning SlovakBERT compared to employing multilingual generative models, such as Llama 8b instruct and Gemma 7b instruct, in both their pre-trained and fine-tuned versions. The findings indicate that SlovakBERT outperforms the other models in terms of in-scope accuracy and out-of-scope false positive rate, establishing it as the benchmark for this application.
Code (0)
등록된 구현이 없습니다.
Tasks
Chatbotintent-classificationIntent ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
DarijaBanking: A New Resource for Overcoming Language Barriers in Banking Intent Detection for Moroccan Arabic Speakers
Navigating the complexities of language diversity is a central challenge in developing robust natural language processing systems, especially in specialized domains like banking. The Moroccan Dialect (Darija) serves as t…
intent-classificationIntent ClassificationIntent DetectionLanguage Modeling+3One System to Rule them All: a Universal Intent Recognition System for Customer Service Chatbots
Customer service chatbots are conversational systems designed to provide information to customers about products/services offered by different companies. Particularly, intent recognition is one of the core components in …
AllChatbotIntent RecognitionTransfer LearningImproved Out-of-Scope Intent Classification with Dual Encoding and Threshold-based Re-Classification
Detecting out-of-scope user utterances is essential for task-oriented dialogues and intent classification. Current methodologies face difficulties with the unpredictable distribution of outliers and often rely on assumpt…
ClassificationDenoisingintent-classificationIntent Classification+1Learning Better Intent Representations for Financial Open Intent Classification
With the recent surge of NLP technologies in the financial domain, banks and other financial entities have adopted virtual agents (VA) to assist customers. A challenging problem for VAs in this domain is determining a us…
Classificationintent-classificationIntent ClassificationLanguage Modeling+2WolBanking77: Wolof Banking Speech Intent Classification Dataset
Intent classification models have made a significant progress in recent years. However, previous studies primarily focus on high-resource language datasets, which results in a gap for low-resource languages and for regio…
Intent Classification