Code Generation 벤치마크

Code Generation on CodeContests

11개 결과 · ⬇ CSV · JSON

Test Set pass@1

• 2023-06-14 — WizardCoder-15B: Test Set pass@1 1.11
• 2023-10-13 — CodeChain + WizardCoder-15B: Test Set pass@1 2.35
• 2023-12-26 — MoTCoder-15B: Test Set pass@1 26.34
• 2024-05-18 — MapCoder (GPT-4): Test Set pass@1 28.5
• 2024-11-21 — LPW (GPT-4o): Test Set pass@1 34.7
• 2025-06-12 — EG-CFG (DeepSeek-V3-0324): Test Set pass@1 58.18
• 2026-04-20 — SolidCoder: Test Set pass@1 77.0