paper-with-me

Papers

Learning Type Inference for Enhanced Dataflow Analysis

2023-10-01 · Lukas Seidel, Sedick David Baker Effendi, Xavier Pinho, Konrad Rieck, Brink van der Merwe, Fabian Yamaguchi

Statically analyzing dynamically-typed code is a challenging endeavor, as even seemingly trivial tasks such as determining the targets of procedure calls are non-trivial without knowing the types of objects at compile time. Addressing this challenge, gradual typing is increasingly added to dynamically-typed languages, a prominent example being TypeScript that introduces static typing to JavaScript. Gradual typing improves the developer's ability to verify program behavior, contributing to robust, secure and debuggable programs. In practice, however, users only sparsely annotate types directly. At the same time, conventional type inference faces performance-related challenges as program size grows. Statistical techniques based on machine learning offer faster inference, but although recent approaches demonstrate overall improved accuracy, they still perform significantly worse on user-defined types than on the most common built-in types. Limiting their real-world usefulness even more, they rarely integrate with user-facing applications. We propose CodeTIDAL5, a Transformer-based model trained to reliably predict type annotations. For effective result retrieval and re-integration, we extract usage slices from a program's code property graph. Comparing our approach against recent neural type inference systems, our model outperforms the current state-of-the-art by 7.85% on the ManyTypes4TypeScript benchmark, achieving 71.27% accuracy overall. Furthermore, we present JoernTI, an integration of our approach into Joern, an open source static analysis tool, and demonstrate that the analysis benefits from the additional type information. As our model allows for fast inference times even on commodity CPUs, making our system available through Joern leads to high accessibility and facilitates security research.

📄 PDF Abstract BibTeX arXiv:2310.00673

Code (1)

joernio/joernti-codetidal5 공식 구현 pytorch

Tasks

Type prediction

Similar Papers 제목 키워드 기반

Revealing CNN Architectures via Side-Channel Analysis in Dataflow-based Inference Accelerators

2023-11-01 · Hansika Weerasena, Prabhat Mishra

Convolutional Neural Networks (CNNs) are widely used in various domains, including image recognition, medical diagnosis and autonomous driving. Recent advances in dataflow-based CNN accelerators have enabled CNN inferenc…

Autonomous DrivingMedical DiagnosisSide Channel Analysis

Causal fault localisation in dataflow systems

2023-04-24 · Andrei Paleyes, Neil D. Lawrence

Dataflow computing was shown to bring significant benefits to multiple niches of systems engineering and has the potential to become a general-purpose paradigm of choice for data-driven application development. One of th…

Causal Inference

YFlows: Systematic Dataflow Exploration and Code Generation for Efficient Neural Network Inference using SIMD Architectures on CPUs

2023-10-01 · Cyrus Zhou, Zack Hassman, Ruize Xu, Dhirpal Shah 외

We address the challenges associated with deploying neural networks on CPUs, with a particular focus on minimizing inference time while maintaining accuracy. Our novel approach is to use the dataflow (i.e., computation o…

Code GenerationEfficient Neural Network

TorchSparse++: Efficient Training and Inference Framework for Sparse Convolution on GPUs

2023-10-25 · Haotian Tang, Shang Yang, Zhijian Liu, Ke Hong 외

Sparse convolution plays a pivotal role in emerging workloads, including point cloud processing in AR/VR, autonomous driving, and graph understanding in recommendation systems. Since the computation pattern is sparse and…

Autonomous DrivingGPURecommendation Systems

A Data-Driven Approach to Dataflow-Aware Online Scheduling for Graph Neural Network Inference

2024-11-25 · Pol Puigdemont, Enrico Russo, Axel Wassington, Abhijit Das 외

Graph Neural Networks (GNNs) have shown significant promise in various domains, such as recommendation systems, bioinformatics, and network analysis. However, the irregularity of graph data poses unique challenges for ef…

CPUGPUGraph Neural NetworkRecommendation Systems+1