paper-with-me

Papers

CyberPal.AI: Empowering LLMs with Expert-Driven Cybersecurity Instructions

2024-08-17 · Matan Levi, Yair Alluouche, Daniel Ohayon, Anton Puzanov

Large Language Models (LLMs) have significantly advanced natural language processing (NLP), providing versatile capabilities across various applications. However, their application to complex, domain-specific tasks, such as cyber-security, often faces substantial challenges. In this study, we introduce SecKnowledge and CyberPal.AI to address these challenges and train security-expert LLMs. SecKnowledge is a domain-knowledge-driven cyber-security instruction dataset, meticulously designed using years of accumulated expert knowledge in the domain through a multi-phase generation process. CyberPal.AI refers to a family of LLMs fine-tuned using SecKnowledge, aimed at building security-specialized LLMs capable of answering and following complex security-related instructions. Additionally, we introduce SecKnowledge-Eval, a comprehensive and diverse cyber-security evaluation benchmark, composed of an extensive set of cyber-security tasks we specifically developed to assess LLMs in the field of cyber-security, along with other publicly available security benchmarks. Our results show a significant average improvement of up to 24% over the baseline models, underscoring the benefits of our expert-driven instruction dataset generation process. These findings contribute to the advancement of AI-based cyber-security applications, paving the way for security-expert LLMs that can enhance threat-hunting and investigation processes.

📄 PDF Abstract BibTeX arXiv:2408.09304

Code (0)

등록된 구현이 없습니다.

Tasks

Dataset Generation

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Toward Cybersecurity-Expert Small Language Models

2025-10-15 · Matan Levi, Daniel Ohayon, Ariel Blobstein, Ravid Sagi 외 arxiv

Large language models (LLMs) are transforming everyday applications, yet deployment in cybersecurity lags due to a lack of high-quality, domain-specific models and training datasets. To address this gap, we present Cyber…

Crimson: Empowering Strategic Reasoning in Cybersecurity through Large Language Models

2024-03-01 · Jiandong Jin, Bowen Tang, Mingxuan Ma, Xiao Liu 외

We introduces Crimson, a system that enhances the strategic reasoning capabilities of Large Language Models (LLMs) within the realm of cybersecurity. By correlating CVEs with MITRE ATT&CK techniques, Crimson advances thr…

HallucinationRetrieval

CurricuLLM: Designing Personalized and Workforce-Aligned Cybersecurity Curricula Using Fine-Tuned LLMs

2026-01-08 · Arthur Nijdam, Harri Kähkönen, Valtteri Niemi, Paul Stankovski Wagner 외 arxiv

The cybersecurity landscape is constantly evolving, driven by increased digitalization and new cybersecurity threats. Cybersecurity programs often fail to equip graduates with skills demanded by the workforce, particular…

BARTPredict: Empowering IoT Security with LLM-Driven Cyber Threat Prediction

2025-01-03 · Alaeddine Diaf, Abdelaziz Amara korba, Nour Elislem Karabadji, Yacine Ghamri-Doudane

The integration of Internet of Things (IoT) technology in various domains has led to operational advancements, but it has also introduced new vulnerabilities to cybersecurity threats, as evidenced by recent widespread cy…

Intrusion Detection

Leveraging Large Language Models for Cybersecurity Risk Assessment -- A Case from Forestry Cyber-Physical Systems

2025-10-07 · Fikret Mert Gultekin, Oscar Lilja, Ranim Khojah, Rebekka Wohlrab 외 arxiv

In safety-critical software systems, cybersecurity activities become essential, with risk assessment being one of the most critical. In many software teams, cybersecurity experts are either entirely absent or represented…