SLGPT: Using Transfer Learning to Directly Generate Simulink Model Files and Find Bugs in the Simulink Toolchain

2021-05-16 · Sohil Lal Shrestha, Christoph Csallner

Finding bugs in a commercial cyber-physical system (CPS) development tool such as Simulink is hard as its codebase contains millions of lines of code and complete formal language specifications are not available. While deep learning techniques promise to learn such language specifications from sample models, deep learning needs a large number of training data to work well. SLGPT addresses this problem by using transfer learning to leverage the powerful Generative Pre-trained Transformer 2 (GPT-2) model, which has been pre-trained on a large set of training data. SLGPT adapts GPT-2 to Simulink with both randomly generated models and models mined from open-source repositories. SLGPT produced Simulink models that are both more similar to open-source models than its closest competitor, DeepFuzzSL, and found a super-set of the Simulink development toolchain bugs found by DeepFuzzSL.

📄 PDF Abstract BibTeX arXiv:2105.07465

Code (1)

https://zenodo.org/record/4734223 공식 구현

Tasks

Deep LearningTransfer Learning

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Position-Wise Feed-Forward Layer 설명 없음

Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…

Linear Warmup With Cosine Annealing Linear Warmup With Cosine Annealing is a learning rate schedule where we increase the learning rate linearly for $n$ updates and then anneal according to a cosine schedule…

Weight Decay 설명 없음

Python-Based Reinforcement Learning on Simulink Models

2024-05-14 · Georg Schäfer, Max Schirl, Jakob Rehrl, Stefan Huber 외

This paper proposes a framework for training Reinforcement Learning agents using Python in conjunction with Simulink models. Leveraging Python's superior customization options and popular libraries like Stable Baselines3…

C++ code Code Generation reinforcement-learning Reinforcement Learning

Shilling Black-box Recommender Systems by Learning to Generate Fake User Profiles

2022-06-23 · Chen Lin, Si Chen, Meifang Zeng, Sheng Zhang 외

Due to the pivotal role of Recommender Systems (RS) in guiding customers towards the purchase, there is a natural motivation for unscrupulous parties to spoof RS for profits. In this paper, we study Shilling Attack where…

Generative Adversarial Network Recommendation Systems

Cross-Modal Translation and Alignment for Survival Analysis

2023-09-22 · ICCV 2023 1 · Fengtao Zhou, Hao Chen

With the rapid advances in high-throughput sequencing technologies, the focus of survival analysis has shifted from examining clinical indicators to incorporating genomic profiles with pathological images. However, exist…

Decoder Survival Analysis Survival Prediction Translation

Modeling Uncertainty: From Simulink to Stochastic Hybrid Automata

2025-06-17 · Pauline Blohm, Felix Schulz, Lisa Willemsen, Anne Remke 외

Simulink is widely used in industrial design processes to model increasingly complex embedded control systems. Thus, their formal analysis is highly desirable. However, this comes with two major challenges: First, Simuli…

Out-of-the-box channel pruned networks

2020-04-30 · Ragav Venkatesan, Gurumurthy Swaminathan, Xiong Zhou, Anna Luo

In the last decade convolutional neural networks have become gargantuan. Pre-trained models, when used as initializers are able to fine-tune ever larger networks on small datasets. Consequently, not all the convolutional…

Reinforcement Learning Reinforcement Learning (RL)