paper-with-me

Papers

CCT-Code: Cross-Consistency Training for Multilingual Clone Detection and Code Search

2023-05-19 · Anton Tikhonov, Nikita Sorokin, Dmitry Abulkhanov, Irina Piontkovskaya, Sergey Nikolenko, Valentin Malykh

We consider the well-known and important tasks of clone detection and information retrieval for source code. The most standard setup is to search clones inside the same language code snippets. But it is also useful to find code snippets with identical behaviour in different programming languages. Nevertheless multi- and cross-lingual clone detection has been little studied in literature. We present a novel training procedure, cross-consistency training (CCT) leveraging cross-lingual similarity, that we apply to train language models on source code in various programming languages. We show that this training is effective both for encoder- and decoder-based models. The trained encoder-based CCT-LM model achieves a new state of the art on POJ-104 (monolingual C++ clone detection benchmark) with 96.73\% MAP and AdvTest (monolingual Python code search benchmark) with 47.18\% MRR. The decoder-based CCT-LM model shows comparable performance in these tasks. In addition, we formulate the multi- and cross-lingual clone detection problem and present XCD, a new benchmark dataset produced from CodeForces submissions.

📄 PDF Abstract BibTeX arXiv:2305.11626

Code (0)

등록된 구현이 없습니다.

Tasks

Clone DetectionCode SearchDecoderInformation RetrievalRetrieval

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음
Residual Connection 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

AdaCCD: Adaptive Semantic Contrasts Discovery Based Cross Lingual Adaptation for Code Clone Detection

2023-11-13 · Yangkai Du, Tengfei Ma, Lingfei Wu, Xuhong Zhang 외

Code Clone Detection, which aims to retrieve functionally similar programs from large code bases, has been attracting increasing attention. Modern software often involves a diverse range of programming languages. However…

Clone DetectionContrastive Learning

PreAlign: Boosting Cross-Lingual Transfer by Early Establishment of Multilingual Alignment

2024-07-23 · Jiahuan Li, ShuJian Huang, Aarron Ching, Xinyu Dai 외

Large language models demonstrate reasonable multilingual abilities, despite predominantly English-centric pretraining. However, the spontaneous multilingual alignment in these models is shown to be weak, leading to unsa…

Cross-Lingual TransferLanguage ModelingLanguage ModellingZero-Shot Cross-Lingual Transfer

Type-IV Code Clone Detection via Layer-Wise Non-Contrastive Representation Learning

2026-09-15 · Luciano Marchezan, Kevin Delcourt, Eugene Syriani, Houari Sahraoui arxiv

Software clones are fragments of code that are similar or functionally equivalent to each other. They pose significant challenges for maintenance, refactoring, and bug detection. Detecting Type-IV clones, which are seman…

Representation LearningContrastive Learning

The Role of Language Imbalance in Cross-lingual Generalisation: Insights from Cloned Language Experiments

2024-04-11 · Anton Schäfer, Shauli Ravfogel, Thomas Hofmann, Tiago Pimentel 외

Multilinguality is crucial for extending recent advancements in language modelling to diverse linguistic communities. To maintain high performance while representing multiple languages, multilingual models ideally align …

Language Modelling

ZC3: Zero-Shot Cross-Language Code Clone Detection

2023-08-26 · Chongyang Tao, Zhi Jin, Fang Liu, Jia Li 외

Developers introduce code clones to improve programming productivity. Many existing studies have achieved impressive performance in monolingual code clone detection. However, during software development, more and more de…

Clone DetectionLanguage Modelling