Intent Classification and Slot Filling for Privacy Policies
Understanding privacy policies is crucial for users as it empowers them to learn about the information that matters to them. Sentences written in a privacy policy document explain privacy practices, and the constituent text spans convey further specific information about that practice. We refer to predicting the privacy practice explained in a sentence as intent classification and identifying the text spans sharing specific information as slot filling. In this work, we propose PolicyIE, an English corpus consisting of 5,250 intent and 11,788 slot annotations spanning 31 privacy policies of websites and mobile applications. PolicyIE corpus is a challenging real-world benchmark with limited labeled examples reflecting the cost of collecting large-scale annotations from domain experts. We present two alternative neural approaches as baselines, (1) intent classification and slot filling as a joint sequence tagging and (2) modeling them as a sequence-to-sequence (Seq2Seq) learning task. The experiment results show that both approaches perform comparably in intent classification, while the Seq2Seq method outperforms the sequence tagging approach in slot filling by a large margin. We perform a detailed error analysis to reveal the challenges of the proposed corpus.
Code (1)
Tasks
General Classificationintent-classificationIntent ClassificationSentenceSlot FillingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Bi-directional Joint Neural Networks for Intent Classification and Slot Filling
Intent classification and slot filling are two critical tasks for natural language understanding. Traditionally the two tasks proceeded independently. However, more recently joint models for intent classification and slo…
Classificationintent-classificationIntent ClassificationIntent Classification and Slot Filling+4A survey of joint intent detection and slot-filling models in natural language understanding
Intent classification and slot filling are two critical tasks for natural language understanding. Traditionally the two tasks have been deemed to proceed independently. However, more recently, joint models for intent cla…
ClassificationGeneral Classificationintent-classificationIntent Classification+5Data Query Language and Corpus Tools for Slot-Filling and Intent Classification Data
Typical machine learning approaches to developing task-oriented dialog systems require the collection and management of large amounts of training data, especially for the tasks of intent classification and slot-filling. …
ClassificationGeneral Classificationintent-classificationIntent Classification+4BERT for Joint Intent Classification and Slot Filling
Intent classification and slot filling are two essential tasks for natural language understanding. They often suffer from small-scale human-labeled training data, resulting in poor generalization capability, especially f…
General Classificationintent-classificationIntent ClassificationIntent Detection+3A Survey of Intent Classification and Slot-Filling Datasets for Task-Oriented Dialog
Interest in dialog systems has grown substantially in the past decade. By extension, so too has interest in developing and improving intent classification and slot-filling models, which are two components that are common…
Classificationintent-classificationIntent ClassificationIntent Classification and Slot Filling+3