Knowledge Transfer for Pseudo-code Generation from Low Resource Programming Language
Generation of pseudo-code descriptions of legacy source code for software maintenance is a manually intensive task. Recent encoder-decoder language models have shown promise for automating pseudo-code generation for high resource programming languages such as C++, but are heavily reliant on the availability of a large code-pseudocode corpus. Soliciting such pseudocode annotations for codes written in legacy programming languages (PL) is a time consuming and costly affair requiring a thorough understanding of the source PL. In this paper, we focus on transferring the knowledge acquired by the code-to-pseudocode neural model trained on a high resource PL (C++) using parallel code-pseudocode data. We aim to transfer this knowledge to a legacy PL (C) with no PL-pseudocode parallel data for training. To achieve this, we utilize an Iterative Back Translation (IBT) approach with a novel test-cases based filtration strategy, to adapt the trained C++-to-pseudocode model to C-to-pseudocode model. We observe an improvement of 23.27% in the success rate of the generated C codes through back translation, over the successive IBT iteration, illustrating the efficacy of our approach.
Code (0)
등록된 구현이 없습니다.
Tasks
Code GenerationDecoderTransfer LearningTranslationSimilar Papers 제목 키워드 기반
English WordNet Random Walk Pseudo-Corpora
This is a resource description paper that describes the creation and properties of a set of pseudo-corpora generated artificially from a random walk over the English WordNet taxonomy. Our WordNet taxonomic random walk im…
Word EmbeddingsImproving Cross-Lingual Transfer Learning for End-to-End Speech Recognition with Speech Translation
Transfer learning from high-resource languages is known to be an efficient way to improve end-to-end automatic speech recognition (ASR) for low-resource languages. Pre-trained or jointly trained encoder-decoder models, h…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Cross-Lingual TransferDecoder+9Cross-lingual Knowledge Transfer and Iterative Pseudo-labeling for Low-Resource Speech Recognition with Transducers
Voice technology has become ubiquitous recently. However, the accuracy, and hence experience, in different languages varies significantly, which makes the technology not equally inclusive. The availability of data for di…
Automatic Speech Recognitionspeech-recognitionSpeech RecognitionTransfer LearningMind the Gap: A Generalized Approach for Cross-Modal Embedding Alignment
Retrieval-Augmented Generation (RAG) systems enhance text generation by incorporating external knowledge but often struggle when retrieving context across different text modalities due to semantic gaps. We introduce a ge…
Passage RetrievalRAGRetrievalRetrieval-augmented Generation+3ChatZero:Zero-shot Cross-Lingual Dialogue Generation via Pseudo-Target Language
Although large language models(LLMs) show amazing capabilities, among various exciting applications discovered for LLMs fall short in other low-resource languages. Besides, most existing methods depend on large-scale dia…
Contrastive LearningDialogue Generation