paper-with-me

홈 › Papers

CodeGemma: Open Code Models Based on Gemma

2024-06-17 · CodeGemma Team, Heri Zhao, Jeffrey Hui, Joshua Howland, Nam Nguyen, Siqi Zuo, Andrea Hu, Christopher A. Choquette-Choo, Jingyue Shen, Joe Kelley, Kshitij Bansal, Luke Vilnis, Mateo Wirth, Paul Michel, Peter Choy, Pratik Joshi, Ravin Kumar, Sarmad Hashmi, Shubham Agrawal, Zhitao Gong, Jane Fine, Tris Warkentin, Ale Jakse Hartman, Bin Ni, Kathy Korevec, Kelly Schaefer, Scott Huffman

This paper introduces CodeGemma, a collection of specialized open code models built on top of Gemma, capable of a variety of code and natural language generation tasks. We release three model variants. CodeGemma 7B pretrained (PT) and instruction-tuned (IT) variants have remarkably resilient natural language understanding, excel in mathematical reasoning, and match code capabilities of other open models. CodeGemma 2B is a state-of-the-art code completion model designed for fast code infilling and open-ended generation in latency-sensitive settings.

📄 PDF Abstract BibTeX arXiv:2406.11409

Code (0)

등록된 구현이 없습니다.

Tasks

Code CompletionMathematical ReasoningNatural Language UnderstandingText Generation

Similar Papers 제목 키워드 기반

DocuMint: Docstring Generation for Python using Small Language Models

2024-05-16 · Bibek Poudel, Adam Cook, Sekou Traore, Shelah Ameli

Effective communication, specifically through documentation, is the beating heart of collaboration among contributors in software development. Recent advancements in language models (LMs) have enabled the introduction of…

BenchmarkingCode Generation

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics

2025-05-21 · Jonathan Katzy, Yongcheng Huang, Gopal-Raj Panchu, Maksym Ziemlewski 외

Large Language Models are essential coding assistants, yet their training is predominantly English-centric. In this study, we evaluate the performance of code language models in non-English contexts, identifying challeng…

Informativeness

Revisiting VerilogEval: A Year of Improvements in Large-Language Models for Hardware Code Generation

2024-08-20 · Nathaniel Pinckney, Christopher Batten, Mingjie Liu, Haoxing Ren 외

The application of large-language models (LLMs) to digital hardware code generation is an emerging field, with most LLMs primarily trained on natural language and software code. Hardware code like Verilog constitutes a s…

Code CompletionCode GenerationIn-Context LearningPrompt Engineering

Zero-Shot Attribution for Large Language Models: A Distribution Testing Approach

2025-06-25 · Clément L. Canonne, Yash Pote, Uddalok Sarkar

A growing fraction of all code is sampled from Large Language Models (LLMs). We investigate the problem of attributing code generated by language models using hypothesis testing to leverage established techniques and gua…

Large Language Models in Code Co-generation for Safe Autonomous Vehicles

2025-05-26 · Ali Nouri, Beatriz Cabrero-Daniel, Zhennan Fei, Krishna Ronanki 외

Software engineers in various industrial domains are already using Large Language Models (LLMs) to accelerate the process of implementing parts of software systems. When considering its potential use for ADAS or AD syste…

Autonomous VehiclesCode Generation