paper-with-me

홈 › Papers

DarijaBanking: A New Resource for Overcoming Language Barriers in Banking Intent Detection for Moroccan Arabic Speakers

2024-05-26 · Abderrahman Skiredj, Ferdaous Azhari, Ismail Berrada, Saad Ezzini

Navigating the complexities of language diversity is a central challenge in developing robust natural language processing systems, especially in specialized domains like banking. The Moroccan Dialect (Darija) serves as the common language that blends cultural complexities, historical impacts, and regional differences. The complexities of Darija present a special set of challenges for language models, as it differs from Modern Standard Arabic with strong influence from French, Spanish, and Tamazight, it requires a specific approach for effective communication. To tackle these challenges, this paper introduces \textbf{DarijaBanking}, a novel Darija dataset aimed at enhancing intent classification in the banking domain, addressing the critical need for automatic banking systems (e.g., chatbots) that communicate in the native language of Moroccan clients. DarijaBanking comprises over 1,800 parallel high-quality queries in Darija, Modern Standard Arabic (MSA), English, and French, organized into 24 intent classes. We experimented with various intent classification methods, including full fine-tuning of monolingual and multilingual models, zero-shot learning, retrieval-based approaches, and Large Language Model prompting. One of the main contributions of this work is BERTouch, our BERT-based language model for intent classification in Darija. BERTouch achieved F1-scores of 0.98 for Darija and 0.96 for MSA on DarijaBanking, outperforming the state-of-the-art alternatives including GPT-4 showcasing its effectiveness in the targeted application.

📄 PDF Abstract BibTeX arXiv:2405.16482

Code (1)

abderrahmanskiredj/DarijaBanking 공식 구현

Tasks

intent-classificationIntent ClassificationIntent DetectionLanguage ModelingLanguage ModellingLarge Language ModelZero-Shot Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Residual Connection 설명 없음
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

WolBanking77: Wolof Banking Speech Intent Classification Dataset

2025-09-23 · Abdou Karim Kandji, Frédéric Precioso, Cheikh Ba, Samba Ndiaye 외 arxiv

Intent classification models have made a significant progress in recent years. However, previous studies primarily focus on high-resource language datasets, which results in a gap for low-resource languages and for regio…

Intent Classification

Overcoming Low-Resource Barriers in Tulu: Neural Models and Corpus Creation for OffensiveLanguage Identification

2025-08-15 · Anusha M D, Deepthi Vikram, Bharathi Raja Chakravarthi, Parameshwar R Hegde arxiv

Tulu, a low-resource Dravidian language predominantly spoken in southern India, has limited computational resources despite its growing digital presence. This study presents the first benchmark dataset for Offensive Lang…

Language Identification

Bootstrapping UD treebanks for Delexicalized Parsing

2019-09-01 · WS (NoDaLiDa) 2019 9 · Prasanth Kolachina, Aarne Ranta

Standard approaches to treebanking traditionally employ a waterfall model (Sommerville, 2010), where annotation guidelines guide the annotation process and insights from the annotation process in turn lead to subsequent …

Accurate and Scalable Matching of Translators to Displaced Persons for Overcoming Language Barriers

2020-11-30 · Divyansh Agarwal, Yuta Baba, Pratik Sachdeva, Tanya Tandon 외

Residents of developing countries are disproportionately susceptible to displacement as a result of humanitarian crises. During such crises, language barriers impede aid workers in providing services to those displaced. …

Humanitarian

Building Korean Linguistic Resource for NLU Data Generation of Banking App CS Dialog System

2022-10-01 · PANDL (COLING) 2022 10 · Jeongwoo Yoon, Onyu Park, Changhoe Hwang, Gwanghoon Yoo 외

Natural language understanding (NLU) is integral to task-oriented dialog systems, but demands a considerable amount of annotated training data to increase the coverage of diverse utterances. In this study, we report the …

Natural Language Understanding