DS-1000

홈페이지 · 논문 72편

DS-1000 is a code generation benchmark with a thousand data science questions spanning seven Python libraries that (1) reflects diverse, realistic, and practical use cases, (2) has a reliable metric, (3) defends against memorization by perturbing questions. Source: DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation Image Source: https://arxiv.org/abs/2211.11501