paper-with-me

홈 › Papers

StorySparkQA: Expert-Annotated QA Pairs with Real-World Knowledge for Children's Story-Based Learning

2023-11-16 · Jiaju Chen, Yuxuan Lu, Shao Zhang, Bingsheng Yao, Yuanzhe Dong, Ying Xu, Yunyao Li, Qianwen Wang, Dakuo Wang, Yuling Sun

Interactive story reading is a common parent-child activity, where parents expect to teach both language skills and real-world knowledge beyond the story. While increasing storytelling and reading systems have been developed for this activity, they often fail to infuse real-world knowledge into the conversation. This limitation can be attributed to the existing question-answering (QA) datasets used for children's education, upon which the systems are built, failing to capture the nuances of how education experts think when conducting interactive story reading activities. To bridge this gap, we design an annotation framework, empowered by existing knowledge graph to capture experts' annotations and thinking process, and leverage this framework to construct StorySparkQA dataset, which comprises 5,868 expert-annotated QA pairs with real-world knowledge. We conduct automated and human expert evaluations across various QA pair generation settings to demonstrate that our StorySparkQA can effectively support models in generating QA pairs that target real-world knowledge beyond story content. StorySparkQA is available at https://huggingface.co/datasets/NEU-HAI/StorySparkQA.

📄 PDF Abstract BibTeX arXiv:2311.09756

Code (1)

neuhai/storysparkqa 공식 구현

Tasks

Question AnsweringWorld Knowledge

Similar Papers 제목 키워드 기반

UDA: A Benchmark Suite for Retrieval Augmented Generation in Real-world Document Analysis

2024-06-21 · Yulong Hui, Yao Lu, Huanchen Zhang

The use of Retrieval-Augmented Generation (RAG) has improved Large Language Models (LLMs) in collaborating with external data, yet significant challenges exist in real-world scenarios. In areas such as academic literatur…

Question AnsweringRAGRetrievalRetrieval-augmented Generation

IndoNLI: A Natural Language Inference Dataset for Indonesian

2021-10-27 · EMNLP 2021 11 · Rahmad Mahendra, Alham Fikri Aji, Samuel Louvan, Fahrurrozi Rahman 외

We present IndoNLI, the first human-elicited NLI dataset for Indonesian. We adapt the data collection protocol for MNLI and collect nearly 18K sentence pairs annotated by crowd workers and experts. The expert-annotated d…

Natural Language InferenceSentenceSpatial ReasoningXLM-R

SnowMaster: Comprehensive Real-world Image Desnowing via MLLM with Multi-Model Feedback Optimization

2025-01-01 · CVPR 2025 1 · Jianyu Lai, Sixiang Chen, Yunlong Lin, Tian Ye 외

Snowfall presents significant challenges for visual data processing, necessitating specialized desnowing algorithms. However, existing models often fail to generalize effectively due to their heavy reliance on synthe…

Pseudo LabelPseudo Label Filtering

It is AI's Turn to Ask Humans a Question: Question-Answer Pair Generation for Children's Story Books

2021-09-08 · Bingsheng Yao, Dakuo Wang, Tongshuang Wu, Zheng Zhang 외

Existing question answering (QA) techniques are created mainly to answer questions asked by humans. But in educational applications, teachers often need to decide what questions they should ask, in order to help students…

Answer GenerationData AugmentationLanguage ModellingQuestion-Answer-Generation+1

It is AI’s Turn to Ask Humans a Question: Question-Answer Pair Generation for Children’s Story Books

2022-05-01 · ACL 2022 5 · Bingsheng Yao, Dakuo Wang, Tongshuang Wu, Zheng Zhang 외

Existing question answering (QA) techniques are created mainly to answer questions asked by humans. But in educational applications, teachers often need to decide what questions they should ask, in order to help students…

Answer GenerationQuestion-Answer-GenerationQuestion Answering