Code Translation 벤치마크
Code Translation on NLC2CMD
| Rank | Model | Accuracy | Paper | Code | Year |
|---|---|---|---|---|---|
| 1 | ChatGPT | 0.806 | NL2CMD: An Updated Workflow for Natural Language to Bash Commands Translation | magnumresearchgroup/magnum-nlc2cmd · magnumresearchgroup/bash_gen | 2023 |
| 2 | Magnum | 0.532 | A Transformer-based Approach for Translating Natural Language to Bash Commands | magnumresearchgroup/magnum-nlc2cmd | 2021 |