paper-with-me

Papers

Balancing Accuracy and Efficiency in Multi-Turn Intent Classification for LLM-Powered Dialog Systems in Production

2024-11-19 · Junhua Liu, Yong Keat Tan, Bin Fu, Kwan Hui Lim

Accurate multi-turn intent classification is essential for advancing conversational AI systems. However, challenges such as the scarcity of comprehensive datasets and the complexity of contextual dependencies across dialogue turns hinder progress. This paper presents two novel approaches leveraging Large Language Models (LLMs) to enhance scalability and reduce latency in production dialogue systems. First, we introduce Symbol Tuning, which simplifies intent labels to reduce task complexity and improve performance in multi-turn dialogues. Second, we propose C-LARA (Consistency-aware, Linguistics Adaptive Retrieval Augmentation), a framework that employs LLMs for data augmentation and pseudo-labeling to generate synthetic multi-turn dialogues. These enriched datasets are used to fine-tune a small, efficient model suitable for deployment. Experiments conducted on multilingual dialogue datasets demonstrate significant improvements in classification accuracy and resource efficiency. Our methods enhance multi-turn intent classification accuracy by 5.09%, reduce annotation costs by 40%, and enable scalable deployment in low-resource multilingual industrial systems, highlighting their practicality and impact.

📄 PDF Abstract BibTeX arXiv:2411.12307

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationData Augmentationintent-classificationIntent Classification

Similar Papers 제목 키워드 기반

LLM-Enhanced Dialogue Management for Full-Duplex Spoken Dialogue Systems

2025-02-19 · Hao Zhang, Weiwei Li, Rilin Chen, Vinay Kothapally 외

Achieving full-duplex communication in spoken dialogue systems (SDS) requires real-time coordination between listening, speaking, and thinking. This paper proposes a semantic voice activity detection (VAD) module as a di…

Action DetectionActivity DetectionDecision MakingDialogue Management+3

MIND: Lightweight and Effective Memory Injection Defense for LLM Agents via Intent-Aware Information Bottleneck

2026-07-30 · Dongyi Liu, Haixing He, Xiaobao Wu, Jia Li arxiv

Memory-augmented LLM-based agents are vulnerable to memory injection attacks: Agents may retrieve poisoned memory from attackers, which diverts their behavior from initial user intent and finally causes task failure. How…

Intent-Aware Dialogue Generation and Multi-Task Contrastive Learning for Multi-Turn Intent Classification

2024-11-21 · Junhua Liu, Yong Keat Tan, Bin Fu, Kwan Hui Lim

Generating large-scale, domain-specific, multilingual multi-turn dialogue datasets remains a significant hurdle for training effective Multi-Turn Intent Classification models in chatbot systems. In this paper, we introdu…

ChatbotClassificationContrastive LearningDialogue Generation+2

Active Honeypot Guardrail System: Probing and Confirming Multi-Turn LLM Jailbreaks

2025-10-16 · ChenYu Wu, Yi Wang, Yang Liao arxiv

Large language models (LLMs) are increasingly vulnerable to multi-turn jailbreak attacks, where adversaries iteratively elicit harmful behaviors that bypass single-turn safety filters. Existing defenses predominantly rel…

LARA: Linguistic-Adaptive Retrieval-Augmentation for Multi-Turn Intent Classification

2024-03-25 · Junhua Liu, Yong Keat Tan, Bin Fu, Kwan Hui Lim

Multi-turn intent classification is notably challenging due to the complexity and evolving nature of conversational contexts. This paper introduces LARA, a Linguistic-Adaptive Retrieval-Augmentation framework to enhance …

ChatbotClassificationIn-Context Learningintent-classification+4