paper-with-me

MBPP

Mostly Basic Python Programming

홈페이지 · 논문 666편

The benchmark consists of around 1,000 crowd-sourced Python programming problems, designed to be solvable by entry-level programmers, covering programming fundamentals, standard library functionality, and so on. Each problem consists of a task description, code solution and 3 automated test cases.

벤치마크

Code Generation on MBPP 결과 101개