paper-with-me

Papers

Source Code Foundation Models are Transferable Binary Analysis Knowledge Bases

2024-05-30 · Zian Su, Xiangzhe Xu, Ziyang Huang, Kaiyuan Zhang, Xiangyu Zhang

Human-Oriented Binary Reverse Engineering (HOBRE) lies at the intersection of binary and source code, aiming to lift binary code to human-readable content relevant to source code, thereby bridging the binary-source semantic gap. Recent advancements in uni-modal code model pre-training, particularly in generative Source Code Foundation Models (SCFMs) and binary understanding models, have laid the groundwork for transfer learning applicable to HOBRE. However, existing approaches for HOBRE rely heavily on uni-modal models like SCFMs for supervised fine-tuning or general LLMs for prompting, resulting in sub-optimal performance. Inspired by recent progress in large multi-modal models, we propose that it is possible to harness the strengths of uni-modal code models from both sides to bridge the semantic gap effectively. In this paper, we introduce a novel probe-and-recover framework that incorporates a binary-source encoder-decoder model and black-box LLMs for binary analysis. Our approach leverages the pre-trained knowledge within SCFMs to synthesize relevant, symbol-rich code fragments as context. This additional context enables black-box LLMs to enhance recovery accuracy. We demonstrate significant improvements in zero-shot binary summarization and binary function name recovery, with a 10.3% relative gain in CHRF and a 16.7% relative gain in a GPT4-based metric for summarization, as well as a 6.7% and 7.4% absolute increase in token-level precision and recall for name recovery, respectively. These results highlight the effectiveness of our approach in automating and improving binary code analysis.

📄 PDF Abstract BibTeX arXiv:2405.19581

Code (1)

ziansu/prorec 공식 구현 pytorch

Tasks

Transfer Learning

Similar Papers 제목 키워드 기반

GFT: Graph Foundation Model with Transferable Tree Vocabulary

2024-11-09 · Zehong Wang, Zheyuan Zhang, Nitesh V Chawla, Chuxu Zhang 외

Inspired by the success of foundation models in applications such as ChatGPT, as graph data has been ubiquitous, one can envision the far-reaching impacts that can be brought by Graph Foundation Models (GFMs) with broade…

Drug DiscoveryGraph Learning

BinaryAlign: Word Alignment as Binary Sequence Labeling

2024-07-16 · Gaetan Lopez Latouche, Marc-André Carbonneau, Ben Swanson

Real world deployments of word alignment are almost certain to cover both high and low resource languages. However, the state-of-the-art for this task recommends a different model class depending on the availability of g…

Word Alignment

CLAP: Learning Transferable Binary Code Representations with Natural Language Supervision

2024-02-26 · Hao Wang, Zeyu Gao, Chao Zhang, Zihan Sha 외

Binary code representation learning has shown significant performance in binary analysis tasks. But existing solutions often have poor transferability, particularly in few-shot and zero-shot scenarios where few or no tra…

Representation LearningTransfer Learning

SemDINO: Foundation Prior-Guided Cross-Temporal Semantic Alignment Network for Remote Sensing Change Detection

2026-06-08 · Xinyu Tong, Meihua Zhou, Jinxiao Sun, Yingjie Tang 외 arxiv

Semantic change detection (SCD) in remote sensing aims to identify land-cover transitions between bi-temporal observations while suppressing pseudo-changes caused by illumination variations, seasonal differences, and reg…

Change Detection

DomusFM: A Foundation Model for Event-Based Behavioral Monitoring in Smart-Homes

2026-02-02 · Michele Fiori, Gabriele Civitarese, Flora D. Salim, Claudio Bettini arxiv

Smart-home sensor-based behavioral monitoring holds significant potential for healthcare, independent living, and early detection of functional or cognitive changes. In this setting, tasks like activity recognition, pred…

Contrastive LearningActivity Recognition