Intent Classification on Low-Resource Languages with Query Similarity Search
Intent classification is an important component of a functional Information Retrieval ecosystem. Many current approaches to intent classification, typically framed as a classification problem, can be problematic as intents are often hard to define and thus data can be difficult and expensive to annotate. The problem is exacerbated when we need to extend the intent classification system to support multiple and in particular low-resource languages. To address this, we propose casting intent classification as a query similarity search problem - we use previous example queries to define an intent, and a query similarity method to classify an incoming query based on the labels of its most similar queries in latent space. With the proposed approach, we are able to achieve reasonable intent classification performance for queries in low-resource languages in a zero-shot setting.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationInformation Retrievalintent-classificationIntent ClassificationSimilar Papers 제목 키워드 기반
Intent Identification and Entity Extraction for Healthcare Queries in Indic Languages
Scarcity of data and technological limitations for resource-poor languages in developing countries like India poses a threat to the development of sophisticated NLU systems for healthcare. To assess the current status of…
Building a Task-oriented Dialog System for Languages with no Training Data: the Case for Basque
This paper presents an approach for developing a task-oriented dialog system for less-resourced languages in scenarios where training data is not available. Both intent classification and slot filling are tackled. We pro…
ClassificationGeneral Classificationintent-classificationIntent Classification+6QFS-Composer: Query-focused summarization pipeline for less resourced languages
Large language models (LLMs) demonstrate strong performance in text summarization, yet their effectiveness drops significantly across languages with restricted training resources. This work addresses the challenge of que…
Question GenerationText SummarizationQuestion AnsweringAcoustics Based Intent Recognition Using Discovered Phonetic Units for Low Resource Languages
With recent advancements in language technologies, humans are now speaking to devices. Increasing the reach of spoken language technologies requires building systems in local languages. A major bottleneck here are the un…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Cross-Lingual Transferintent-classification+4From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understanding
The lack of publicly available evaluation data for low-resource languages limits progress in Spoken Language Understanding (SLU). As key tasks like intent classification and slot filling require abundant training data, i…
intent-classificationIntent ClassificationIntent DetectionLanguage Modeling+6