Generalizability of Code Clone Detection on CodeBERT
Transformer networks such as CodeBERT already achieve outstanding results for code clone detection in benchmark datasets, so one could assume that this task has already been solved. However, code clone detection is not a trivial task. Semantic code clones, in particular, are challenging to detect. We show that the generalizability of CodeBERT decreases by evaluating two different subsets of Java code clones from BigCloneBench. We observe a significant drop in F1 score when we evaluate different code snippets and functionality IDs than those used for model building.
Code (0)
등록된 구현이 없습니다.
Tasks
Clone DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Source Code is a Graph, Not a Sequence: A Cross-Lingual Perspective on Code Clone Detection
Source code clone detection is the task of finding code fragments that have the same or similar functionality, but may differ in syntax or structure. This task is important for software maintenance, reuse, and quality as…
Clone DetectionOn the Use of Deep Learning Models for Semantic Clone Detection
Detecting and tracking code clones can ease various software development and maintenance tasks when changes in a code fragment should be propagated over all its copies. Several deep learning-based clone detection models …
Clone DetectionDeep LearningEnhancing Neural Code Representation with Additional Context
Automated program comprehension underpins many software engineering tasks, from code summarisation to clone detection. Recent deep learning models achieve strong results but typically rely on source code alone, overlooki…
Selecting and Combining Large Language Models for Scalable Code Clone Detection
Source code clones pose risks ranging from intellectual property violations to unintended vulnerabilities. Effective and efficient scalable clone detection, especially for diverged clones, remains challenging. Large lang…
Programming Knowledge Tracing: A Comprehensive Dataset and A New Model
In this paper, we study knowledge tracing in the domain of programming education and make two important contributions. First, we harvest and publish so far the most comprehensive dataset, namely BePKT, which covers vario…
Clone DetectionKnowledge Tracing