Blockchain Large Language Models
This paper presents a dynamic, real-time approach to detecting anomalous blockchain transactions. The proposed tool, BlockGPT, generates tracing representations of blockchain activity and trains from scratch a large language model to act as a real-time Intrusion Detection System. Unlike traditional methods, BlockGPT is designed to offer an unrestricted search space and does not rely on predefined rules or patterns, enabling it to detect a broader range of anomalies. We demonstrate the effectiveness of BlockGPT through its use as an anomaly detection tool for Ethereum transactions. In our experiments, it effectively identifies abnormal transactions among a dataset of 68M transactions and has a batched throughput of 2284 transactions per second on average. Our results show that, BlockGPT identifies abnormal transactions by ranking 49 out of 124 attacks among the top-3 most abnormal transactions interacting with their victim contracts. This work makes contributions to the field of blockchain transaction analysis by introducing a custom data encoding compatible with the transformer architecture, a domain-specific tokenization technique, and a tree encoding method specifically crafted for the Ethereum Virtual Machine (EVM) trace representation.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionIntrusion DetectionLanguage ModelingLanguage ModellingLarge Language ModelSimilar Papers 제목 키워드 기반
Blockchain Meets LLMs: A Living Survey on Bidirectional Integration
In the domain of large language models, considerable advancements have been attained in multimodal large language models and explainability research, propelled by the continuous technological progress and innovation. Non…
SurveyBlockchain for Large Language Model Security and Safety: A Holistic Survey
With the growing development and deployment of large language models (LLMs) in both industrial and academic fields, their security and safety concerns have become increasingly critical. However, recent studies indicate t…
Data PoisoningLanguage ModelingLanguage ModellingLarge Language ModelBlockchain Data Analysis in the Era of Large-Language Models
Blockchain data analysis is essential for deriving insights, tracking transactions, identifying patterns, and ensuring the integrity and security of decentralized networks. It plays a key role in various areas, such as f…
Fraud DetectionDynamic Large Language Models on Blockchains
Training and deploying the large language models requires a large mount of computational resource because the language models contain billions of parameters and the text has thousands of tokens. Another problem is that t…
Language ModelingLanguage ModellingLarge Language ModelBlockFound: Customized blockchain foundation model for anomaly detection
We propose BlockFound, a customized foundation model for anomaly blockchain transaction detection. Unlike existing methods that rely on rule-based systems or directly apply off-the-shelf large language models, BlockFound…
Anomaly Detectionmodel