Logical Segmentation of Source Code
Many software analysis methods have come to rely on machine learning approaches. Code segmentation - the process of decomposing source code into meaningful blocks - can augment these methods by featurizing code, reducing noise, and limiting the problem space. Traditionally, code segmentation has been done using syntactic cues; current approaches do not intentionally capture logical content. We develop a novel deep learning approach to generate logical code segments regardless of the language or syntactic correctness of the code. Due to the lack of logically segmented source code, we introduce a unique data set construction technique to approximate ground truth for logically segmented code. Logical code segmentation can improve tasks such as automatically commenting code, detecting software vulnerabilities, repairing bugs, labeling code functionality, and synthesizing new code.
Code (0)
등록된 구현이 없습니다.
Tasks
SegmentationSimilar Papers 제목 키워드 기반
Morpheus: A Deep Learning Framework For Pixel-Level Analysis of Astronomical Image Data
We present Morpheus, a new model for generating pixel-level morphological classifications of astronomical sources. Morpheus leverages advances in deep learning to perform source detection, source segmentation, and morpho…
General Classificationobject-detectionObject DetectionSegmentation+1Morphological Segmentation for Seneca
This study takes up the task of low-resource morphological segmentation for Seneca, a critically endangered and morphologically complex Native American language primarily spoken in what is now New York State and Ontario.…
DecoderModel SelectionMulti-Task LearningSegmentationExploring Segmentation Approaches for Neural Machine Translation of Code-Switched Egyptian Arabic-English Text
Data sparsity is one of the main challenges posed by code-switching (CS), which is further exacerbated in the case of morphologically rich languages. For the task of machine translation (MT), morphological segmentation h…
Machine TranslationSegmentationInitial Experiments In Cross-Lingual Morphological Analysis Using Morpheme Segmentation
The paper describes initial experiments in data-driven cross-lingual morphological analysis of open-category words using a combination of unsupervised morpheme segmentation, annotation projection and an LSTM encoder-deco…
DecoderMorphological AnalysisMorphAGram, Evaluation and Framework for Unsupervised Morphological Segmentation
Computational morphological segmentation has been an active research topic for decades as it is beneficial for many natural language processing tasks. With the high cost of manually labeling data for morphology and the i…
Segmentation