paper-with-me

Papers

MalBERT: Using Transformers for Cybersecurity and Malicious Software Detection

2021-03-05 · Abir Rahali, Moulay A. Akhloufi

In recent years we have witnessed an increase in cyber threats and malicious software attacks on different platforms with important consequences to persons and businesses. It has become critical to find automated machine learning techniques to proactively defend against malware. Transformers, a category of attention-based deep learning techniques, have recently shown impressive results in solving different tasks mainly related to the field of Natural Language Processing (NLP). In this paper, we propose the use of a Transformers' architecture to automatically detect malicious software. We propose a model based on BERT (Bidirectional Encoder Representations from Transformers) which performs a static analysis on the source code of Android applications using preprocessed features to characterize existing malware and classify it into different representative malware categories. The obtained results are promising and show the high performance obtained by Transformer-based models for malicious software detection.

📄 PDF Abstract BibTeX arXiv:2103.03806

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Adam 설명 없음
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Weight Decay 설명 없음
Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

Large Language Model (LLM) for Software Security: Code Analysis, Malware Analysis, Reverse Engineering

2025-04-07 · Hamed Jelodar, Samita Bai, Parisa Hamedi, Hesamodin Mohammadian 외

Large Language Models (LLMs) have recently emerged as powerful tools in cybersecurity, offering advanced capabilities in malware detection, generation, and real-time monitoring. Numerous studies have explored their appli…

Language ModelingLanguage ModellingLarge Language ModelMalware Analysis+1

RatGPT: Turning online LLMs into Proxies for Malware Attacks

2023-08-17 · Mika Beckerich, Laura Plein, Sergio Coronado

The evolution of Generative AI and the capabilities of the newly released Large Language Models (LLMs) open new opportunities in software engineering. However, they also lead to new challenges in cybersecurity. Recently,…

BARTPredict: Empowering IoT Security with LLM-Driven Cyber Threat Prediction

2025-01-03 · Alaeddine Diaf, Abdelaziz Amara korba, Nour Elislem Karabadji, Yacine Ghamri-Doudane

The integration of Internet of Things (IoT) technology in various domains has led to operational advancements, but it has also introduced new vulnerabilities to cybersecurity threats, as evidenced by recent widespread cy…

Intrusion Detection

A Decompilation-Driven Framework for Malware Detection with Large Language Models

2026-01-14 · Aniesh Chawla, Udbhav Prasad arxiv

The parallel evolution of Large Language Models (LLMs) with advanced code-understanding capabilities and the increasing sophistication of malware presents a new frontier for cybersecurity research. This paper evaluates t…

Malware Detection

Malicious Source Code Detection Using Transformer

2022-09-16 · Chen Tsfaty, Michael Fire

Open source code is considered a common practice in modern software development. However, reusing other code allows bad actors to access a wide developers' community, hence the products that rely on it. Those attacks are…