PolicyQA: A Reading Comprehension Dataset for Privacy Policies
Privacy policy documents are long and verbose. A question answering (QA) system can assist users in finding the information that is relevant and important to them. Prior studies in this domain frame the QA task as retrieving the most relevant text segment or a list of sentences from the policy document given a question. On the contrary, we argue that providing users with a short text span from policy documents reduces the burden of searching the target information from a lengthy text segment. In this paper, we present PolicyQA, a dataset that contains 25,017 reading comprehension style examples curated from an existing corpus of 115 website privacy policies. PolicyQA provides 714 human-annotated questions written for a wide range of privacy practices. We evaluate two existing neural QA models and perform rigorous analysis to reveal the advantages and challenges offered by PolicyQA.
Code (1)
Tasks
Question AnsweringReading ComprehensionSimilar Papers 제목 키워드 기반
A Multi-Agent Framework for Mitigating Dialect Biases in Privacy Policy Question-Answering Systems
Privacy policies inform users about data collection and usage, yet their complexity limits accessibility for diverse populations. Existing Privacy Policy Question Answering (QA) systems exhibit performance disparities ac…
Question AnsweringCheap and Good? Simple and Effective Data Augmentation for Low Resource Machine Reading
We propose a simple and effective strategy for data augmentation for low-resource machine reading comprehension (MRC). Our approach first pretrains the answer extraction components of a MRC system on the augmented data t…
Data AugmentationMachine Reading ComprehensionReading ComprehensionRetrievalSmart Privacy Policy Assistant: An LLM-Powered System for Transparent and Actionable Privacy Notices
Most users agree to online privacy policies without reading or understanding them, even though these documents govern how personal data is collected, shared, and monetized. Privacy policies are typically long, legally co…
Explanation GenerationFedQAS: Privacy-aware machine reading comprehension with federated learning
Machine reading comprehension (MRC) of text data is one important task in Natural Language Understanding. It is a complex NLP problem with a lot of ongoing research fueled by the release of the Stanford Question Answerin…
Conversational Question AnsweringFederated LearningMachine Reading ComprehensionNatural Language Understanding+3Dataset for the First Evaluation on Chinese Machine Reading Comprehension
Machine Reading Comprehension (MRC) has become enormously popular recently and has attracted a lot of attention. However, existing reading comprehension datasets are mostly in English. To add diversity in reading compreh…
Chinese Reading ComprehensionDiversityMachine Reading ComprehensionReading Comprehension