OpenAPI code completion on OpenAPI completion refined

8개 결과 · ⬇ CSV · JSON

Correctness, avg., %

Rank	Model	Correctness, avg., %	Correctness, max., %	Validness, avg., %	Validness, max., %	Paper	Code	Year
1	Code Llama 7B, fine-tuned with document splitting	34	42	69.1	76	Optimizing Large Language Models for OpenAPI Code Completion	BohdanPetryshyn/code-llama-fim-fine-tuning · BohdanPetryshyn/openapi-completion-benchmark	2024
2	Code Llama 7B, fine-tuned at 4096 tokens	32	45	63.1	84	Optimizing Large Language Models for OpenAPI Code Completion	BohdanPetryshyn/code-llama-fim-fine-tuning · BohdanPetryshyn/openapi-completion-benchmark	2024
3	Code Llama 7B	31.1	36	60.7	64	Optimizing Large Language Models for OpenAPI Code Completion	BohdanPetryshyn/code-llama-fim-fine-tuning · BohdanPetryshyn/openapi-completion-benchmark	2024
4	GitHub Copilot	29	29	68	68	Optimizing Large Language Models for OpenAPI Code Completion	BohdanPetryshyn/code-llama-fim-fine-tuning · BohdanPetryshyn/openapi-completion-benchmark	2024
5	Code Llama 7B, fine-tuned with document splitting	34	42	69.1	76	Optimizing Large Language Models for OpenAPI Code Completion	BohdanPetryshyn/code-llama-fim-fine-tuning · BohdanPetryshyn/openapi-completion-benchmark	2024
6	Code Llama 7B, fine-tuned at 4096 tokens	32	45	63.1	84	Optimizing Large Language Models for OpenAPI Code Completion	BohdanPetryshyn/code-llama-fim-fine-tuning · BohdanPetryshyn/openapi-completion-benchmark	2024
7	Code Llama 7B	31.1	36	60.7	64	Optimizing Large Language Models for OpenAPI Code Completion	BohdanPetryshyn/code-llama-fim-fine-tuning · BohdanPetryshyn/openapi-completion-benchmark	2024
8	GitHub Copilot	29	29	68	68	Optimizing Large Language Models for OpenAPI Code Completion	BohdanPetryshyn/code-llama-fim-fine-tuning · BohdanPetryshyn/openapi-completion-benchmark	2024