paper-with-me

홈 › Papers

Let LLMs Take on the Latest Challenges! A Chinese Dynamic Question Answering Benchmark

2024-02-29 · Zhikun Xu, Yinghui Li, Ruixue Ding, Xinyu Wang, Boli Chen, Yong Jiang, Hai-Tao Zheng, Wenlian Lu, Pengjun Xie, Fei Huang

How to better evaluate the capabilities of Large Language Models (LLMs) is the focal point and hot topic in current LLMs research. Previous work has noted that due to the extremely high cost of iterative updates of LLMs, they are often unable to answer the latest dynamic questions well. To promote the improvement of Chinese LLMs' ability to answer dynamic questions, in this paper, we introduce CDQA, a Chinese Dynamic QA benchmark containing question-answer pairs related to the latest news on the Chinese Internet. We obtain high-quality data through a pipeline that combines humans and models, and carefully classify the samples according to the frequency of answer changes to facilitate a more fine-grained observation of LLMs' capabilities. We have also evaluated and analyzed mainstream and advanced Chinese LLMs on CDQA. Extensive experiments and valuable insights suggest that our proposed CDQA is challenging and worthy of more further study. We believe that the benchmark we provide will become one of the key data resources for improving LLMs' Chinese question-answering ability in the future.

📄 PDF Abstract BibTeX arXiv:2402.19248

Code (1)

alibaba-nlp/cdqa 공식 구현 pytorch

Tasks

Question Answering

Similar Papers 제목 키워드 기반

ChineseWebText: Large-scale High-quality Chinese Web Text Extracted with Effective Evaluation Model

2023-11-02 · Jianghao Chen, Pu Jian, Tengxiao Xi, Dongyi Yi 외

During the development of large language models (LLMs), the scale and quality of the pre-training data play a crucial role in shaping LLMs' capabilities. To accelerate the research of LLMs, several large-scale datasets, …

Dynamic data sampler for cross-language transfer learning in large language models

2024-05-17 · Yudong Li, Yuhao Feng, Wen Zhou, Zhe Zhao 외

Large Language Models (LLMs) have gained significant attention in the field of natural language processing (NLP) due to their wide range of applications. However, training LLMs for languages other than English poses sign…

Language ModelingLanguage ModellingTransfer LearningUnsupervised Pre-training

CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models

2024-03-06 · Zexuan Qiu, Jingjing Li, Shijue Huang, Xiaoqi Jiao 외

Developing Large Language Models (LLMs) with robust long-context capabilities has been the recent research focus, resulting in the emergence of long-context LLMs proficient in Chinese. However, the evaluation of these mo…

ChineseFoodNet: A large-scale Image Dataset for Chinese Food Recognition

2017-05-08 · Xin Chen, Yu Zhu, Hua Zhou, Liang Diao 외

In this paper, we introduce a new and challenging large-scale food image dataset called "ChineseFoodNet", which aims to automatically recognizing pictured Chinese dishes. Most of the existing food image datasets collecte…

Food Recognition

MegaHan97K: A Large-Scale Dataset for Mega-Category Chinese Character Recognition with over 97K Categories

2025-06-05 · Yuyi Zhang, Yongxin Shi, Peirong Zhang, Yixin Zhao 외

Foundational to the Chinese language and culture, Chinese characters encompass extraordinarily extensive and ever-expanding categories, with the latest Chinese GB18030-2022 standard containing 87,887 categories. The accu…

BenchmarkingOptical Character RecognitionOptical Character Recognition (OCR)Zero-Shot Learning