paper-with-me

Papers

Semantic-aware Binary Code Representation with BERT

2021-06-10 · Hyungjoon Koo, Soyeon Park, Daejin Choi, Taesoo Kim

A wide range of binary analysis applications, such as bug discovery, malware analysis and code clone detection, require recovery of contextual meanings on a binary code. Recently, binary analysis techniques based on machine learning have been proposed to automatically reconstruct the code representation of a binary instead of manually crafting specifics of the analysis algorithm. However, the existing approaches utilizing machine learning are still specialized to solve one domain of problems, rendering recreation of models for different types of binary analysis. In this paper, we propose DeepSemantic utilizing BERT in producing the semantic-aware code representation of a binary code. To this end, we introduce well-balanced instruction normalization that holds rich information for each of instructions yet minimizing an out-of-vocabulary (OOV) problem. DeepSemantic has been carefully designed based on our study with large swaths of binaries. Besides, DeepSemantic leverages the essence of the BERT architecture into re-purposing a pre-trained generic model that is readily available as a one-time processing, followed by quickly applying specific downstream tasks with a fine-tuning process. We demonstrate DeepSemantic with two downstream tasks, namely, binary similarity comparison and compiler provenance (i.e., compiler and optimization level) prediction. Our experimental results show that the binary similarity model outperforms two state-of-the-art binary similarity tools, DeepBinDiff and SAFE, 49.84% and 15.83% on average, respectively.

📄 PDF Abstract BibTeX arXiv:2106.05478

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningClone DetectionMalware Analysis

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention 설명 없음
Adam 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Residual Connection 설명 없음
WordPiece 설명 없음

Similar Papers 제목 키워드 기반

BinBert: Binary Code Understanding with a Fine-tunable and Execution-aware Transformer

2022-08-13 · Fiorella Artuso, Marco Mormando, Giuseppe A. Di Luna, Leonardo Querzoni

A recent trend in binary code analysis promotes the use of neural solutions based on instruction embedding models. An instruction embedding model is a neural network that transforms sequences of assembly instructions int…

General Knowledge

Semantics-aware BERT for Language Understanding

2019-09-05 · Zhuosheng Zhang, Yuwei Wu, Hai Zhao, Zuchao Li 외

The latest work on language representations carefully integrates contextualized features into language model training, which enables a series of success especially in various machine reading comprehension and natural lan…

Language ModelingLanguage ModellingMachine Reading ComprehensionNatural Language Inference+5

Efficient Document Retrieval by End-to-End Refining and Quantizing BERT Embedding with Contrastive Product Quantization

2022-10-31 · Zexuan Qiu, Qinliang Su, Jianxing Yu, Shijing Si

Efficient document retrieval heavily relies on the technique of semantic hashing, which learns a binary code for every document and employs Hamming distance to evaluate document distances. However, existing semantic hash…

QuantizationRetrieval

VulBERTa: Simplified Source Code Pre-Training for Vulnerability Detection

2022-05-25 · Hazim Hanif, Sergio Maffeis

This paper presents VulBERTa, a deep learning approach to detect security vulnerabilities in source code. Our approach pre-trains a RoBERTa model with a custom tokenisation pipeline on real-world code from open-source C/…

Vulnerability Detection

MapBERT: Bitwise Masked Modeling for Real-Time Semantic Mapping Generation

2025-06-09 · Yijie Deng, Shuaihang Yuan, Congcong Wen, Hao Huang 외

Spatial awareness is a critical capability for embodied agents, as it enables them to anticipate and reason about unobserved regions. The primary challenge arises from learning the distribution of indoor semantics, compl…

Computational EfficiencyObject