Data Augmentation for Code Translation with Comparable Corpora and Multiple References

2023-11-01 · Yiqing Xie, Atharva Naik, Daniel Fried, Carolyn Rose

One major challenge of translating code between programming languages is that parallel training data is often limited. To overcome this challenge, we present two data augmentation techniques, one that builds comparable corpora (i.e., code pairs with similar functionality), and another that augments existing parallel data with multiple reference translations. Specifically, we build and analyze multiple types of comparable corpora, including programs generated from natural language documentation using a code generation model. Furthermore, to reduce overfitting to a single reference translation, we automatically generate additional translation references for available parallel data and filter the translations by unit tests, which increases variation in target translations. Experiments show that our data augmentation techniques significantly improve CodeT5 for translation between Java, Python, and C++ by an average of 7.5% Computational Accuracy (CA@1), which verifies the correctness of translations by execution. The code is available at https://github.com/Veronicium/CMTrans.

📄 PDF Abstract BibTeX arXiv:2311.00317

Code (1)

veronicium/cmtrans 공식 구현 pytorch

Tasks

Code Generation Code Translation Data Augmentation Translation

Methods 이 논문이 사용한 방법론

Gated Linear Unit A Gated Linear Unit, or GLU computes: $$ \mathrm{GLU}(a, b) = a \otimes \sigma(b) $$ It is used in natural language processing architectures, for example the Gated CNN,…

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Data Selection for Bilingual Lexicon Induction from Specialized Comparable Corpora

2020-12-01 · COLING 2020 8 · Martin Laville, Amir Hazem, Emmanuel Morin, Phillippe Langlais

Narrow specialized comparable corpora are often small in size. This particularity makes it difficult to build efficient models to acquire translation equivalents, especially for less frequent and rare words. One way to o…

Bilingual Lexicon Induction Data Augmentation Machine Translation Translation

Automated Snippet-Alignment Data Augmentation for Code Translation

2025-10-16 · Zhiming Zhang, Qingfu Zhu, Xianzhen Luo, Yixuan Wang 외 arxiv

Code translation aims to translate the code from its source language to the target language and is used in various software development scenarios. Recent developments in Large Language Models (LLMs) have showcased their …

Data Augmentation Code Translation

SwitchOut: an Efficient Data Augmentation Algorithm for Neural Machine Translation

2018-08-22 · EMNLP 2018 10 · Xinyi Wang, Hieu Pham, Zihang Dai, Graham Neubig

In this work, we examine methods for data augmentation for text-based tasks such as neural machine translation (NMT). We formulate the design of a data augmentation policy with desirable properties as an optimization pro…

Data Augmentation Machine Translation NMT Sentence+1

From Machine Translation to Code-Switching: Generating High-Quality Code-Switched Text

2021-07-14 · ACL 2021 5 · Ishan Tarunesh, Syamantak Kumar, Preethi Jyothi

Generating code-switched text is a problem of growing interest, especially given the scarcity of corpora containing large volumes of real code-switched text. In this work, we adapt a state-of-the-art neural machine trans…

Data Augmentation Language Modeling Language Modelling Machine Translation+2

Collecting and Using Comparable Corpora for Statistical Machine Translation

2012-05-01 · LREC 2012 5 · Inguna Skadi{\c{n}}a, Ahmet Aker, Nikos Mastropavlos, Fangzhong Su 외

Lack of sufficient parallel data for many languages and domains is currently one of the major obstacles to further advancement of automated translation. The ACCURAT project is addressing this issue by researching methods…

Machine Translation Translation