paper-with-me

홈 › Papers

Multimodal Large Language Models for Phishing Webpage Detection and Identification

2024-08-12 · Jehyun Lee, Peiyuan Lim, Bryan Hooi, Dinil Mon Divakaran

To address the challenging problem of detecting phishing webpages, researchers have developed numerous solutions, in particular those based on machine learning (ML) algorithms. Among these, brand-based phishing detection that uses models from Computer Vision to detect if a given webpage is imitating a well-known brand has received widespread attention. However, such models are costly and difficult to maintain, as they need to be retrained with labeled dataset that has to be regularly and continuously collected. Besides, they also need to maintain a good reference list of well-known websites and related meta-data for effective performance. In this work, we take steps to study the efficacy of large language models (LLMs), in particular the multimodal LLMs, in detecting phishing webpages. Given that the LLMs are pretrained on a large corpus of data, we aim to make use of their understanding of different aspects of a webpage (logo, theme, favicon, etc.) to identify the brand of a given webpage and compare the identified brand with the domain name in the URL to detect a phishing attack. We propose a two-phase system employing LLMs in both phases: the first phase focuses on brand identification, while the second verifies the domain. We carry out comprehensive evaluations on a newly collected dataset. Our experiments show that the LLM-based system achieves a high detection rate at high precision; importantly, it also provides interpretable evidence for the decisions. Our system also performs significantly better than a state-of-the-art brand-based phishing detection system while demonstrating robustness against two known adversarial attacks.

📄 PDF Abstract BibTeX arXiv:2408.05941

Code (1)

jehleekr/multimodal_llm_phishing_detection 공식 구현

Similar Papers 제목 키워드 기반

Adaptive Linguistic Prompting (ALP) Enhances Phishing Webpage Detection in Multimodal Large Language Models

2025-06-29 · Atharva Bhargude, Ishan Gonehal, Chandler Haney, Dave Yoon 외

Phishing attacks represent a significant cybersecurity threat, necessitating adaptive detection techniques. This study explores few-shot Adaptive Linguistic Prompting (ALP) in detecting phishing webpages through the mult…

KnowPhish: Large Language Models Meet Multimodal Knowledge Graphs for Enhancing Reference-Based Phishing Detection

2024-03-04 · Yuexin Li, Chengyu Huang, Shumin Deng, Mei Lin Lock 외

Phishing attacks have inflicted substantial losses on individuals and businesses alike, necessitating the development of robust and efficient automated phishing detection approaches. Reference-based phishing detectors (R…

Knowledge GraphsLanguage ModellingLarge Language Model

Phishing the Phishers with SpecularNet: Hierarchical Graph Autoencoding for Reference-Free Web Phishing Detection

2026-03-02 · Tailai Song, Pedro Casas, Michela Meo arxiv

Phishing remains the most pervasive threat to the Web, enabling large-scale credential theft and financial fraud through deceptive webpages. While recent reference-based and generative-AI-driven phishing detectors achiev…

Large Multimodal Agents for Accurate Phishing Detection with Enhanced Token Optimization and Cost Reduction

2024-12-03 · Fouad Trad, Ali Chehab

With the rise of sophisticated phishing attacks, there is a growing need for effective and economical detection solutions. This paper explores the use of large multimodal agents, specifically Gemini 1.5 Flash and GPT-4o …

A stacking model using URL and HTML features for phishing webpage detection

2019-05-01 · Yukun Li a, Zhenguo Yang b, C, ∗ 외

In this paper, we present a stacking model to detect phishing webpages using URL and HTML features. In terms of features, we design lightweight URL and HTML features and introduce HTML string embedding without using th…