paper-with-me

홈 › Papers

Automatic Identification of Parallelizable Loops Using Transformer-Based Source Code Representations

2026-03-31 · Izavan dos S. Correia, Henrique C. T. Santos, Tiago A. E. Ferreira arxiv

Automatic parallelization remains a challenging problem in software engineering, particularly in identifying code regions where loops can be safely executed in parallel on modern multi-core architectures. Traditional static analysis techniques, such as dependence analysis and polyhedral models, often struggle with irregular or dynamically structured code. In this work, we propose a Transformer-based approach to classify the parallelization potential of source code, focusing on distinguishing independent (parallelizable) loops from undefined ones. We adopt DistilBERT to process source code sequences using subword tokenization, enabling the model to capture contextual syntactic and semantic patterns without handcrafted features. The approach is evaluated on a balanced dataset combining synthetically generated loops and manually annotated real-world code, using 10-fold cross-validation and multiple performance metrics. Results show consistently high performance, with mean accuracy above 99\% and low false positive rates, demonstrating robustness and reliability. Compared to prior token-based methods, the proposed approach simplifies preprocessing while improving generalization and maintaining computational efficiency. These findings highlight the potential of lightweight Transformer models for practical identification of parallelization opportunities at the loop level.

📄 PDF Abstract BibTeX arXiv:2603.30040

Code (0)

등록된 구현이 없습니다.

Tasks

Computational Efficiency

Similar Papers 제목 키워드 기반

Discovering Software Parallelization Points Using Deep Neural Networks

2025-09-05 · Izavan dos S. Correia, Henrique C. T. Santos, Tiago A. E. Ferreira arxiv

This study proposes a deep learning-based approach for discovering loops in programming code according to their potential for parallelization. Two genetic algorithm-based code generators were developed to produce two dis…

Learning to Parallelize with OpenMP by Augmented Heterogeneous AST Representation

2023-05-09 · Le Chen, Quazi Ishtiaque Mahmud, Hung Phan, Nesreen K. Ahmed 외

Detecting parallelizable code regions is a challenging task, even for experienced developers. Numerous recent studies have explored the use of machine learning for code analysis and program synthesis, including paralleli…

Program Synthesis

OMPar: Automatic Parallelization with AI-Driven Source-to-Source Compilation

2024-09-23 · Tal Kadosh, Niranjan Hasabnis, Prema Soundararajan, Vy A. Vo 외

Manual parallelization of code remains a significant challenge due to the complexities of modern software systems and the widespread adoption of multi-core architectures. This paper introduces OMPar, an AI-driven tool de…

C++ code

Neural Face Identification in a 2D Wireframe Projection of a Manifold Object

2022-03-08 · CVPR 2022 1 · Kehan Wang, Jia Zheng, Zihan Zhou

In computer-aided design (CAD) systems, 2D line drawings are commonly used to illustrate 3D object designs. To reconstruct the 3D models depicted by a single 2D line drawing, an important key is finding the edge loops in…

3D Object ReconstructionObjectObject Reconstruction

PRISM: Parallel Residual Iterative Sequence Model

2026-02-11 · Jie Jiang, Ke Cheng, Xin Xu, Mengyang Pang 외 arxiv

Generative sequence modeling faces a fundamental tension between the expressivity of Transformers and the efficiency of linear sequence models. Existing efficient architectures are theoretically bounded by shallow, singl…