COPA

홈페이지 · 논문 329편

The Choice Of Plausible Alternatives (COPA) evaluation provides researchers with a tool for assessing progress in open-domain commonsense causal reasoning. COPA consists of 1000 questions, split equally into development and test sets of 500 questions each. Each question is composed of a premise and two alternatives, where the task is to select the alternative that more plausibly has a causal relation with the premise. The correct alternative is randomized so that the expected performance of randomly guessing is 50%. Source: Choice of Plausible Alternatives (COPA) Image Source: https://people.ict.usc.edu/~gordon/copa.html

벤치마크