paper-with-me

홈 › Papers

LLM-FS: Zero-Shot Feature Selection for Effective and Interpretable Malware Detection

2026-02-10 · Naveen Gill, Ajvad Haneef K, Madhu Kumar S D arxiv

Feature selection (FS) remains essential for building accurate and interpretable detection models, particularly in high-dimensional malware datasets. Conventional FS methods such as Extra Trees, Variance Threshold, Tree-based models, Chi-Squared tests, ANOVA, Random Selection, and Sequential Attention rely primarily on statistical heuristics or model-driven importance scores, often overlooking the semantic context of features. Motivated by recent progress in LLM-driven FS, we investigate whether large language models (LLMs) can guide feature selection in a zero-shot setting, using only feature names and task descriptions, as a viable alternative to traditional approaches. We evaluate multiple LLMs (GPT-5.0, GPT-4.0, Gemini-2.5 etc.) on the EMBOD dataset (a fusion of EMBER and BODMAS benchmark datasets), comparing them against established FS methods across several classifiers, including Random Forest, Extra Trees, MLP, and KNN. Performance is assessed using accuracy, precision, recall, F1, AUC, MCC, and runtime. Our results demonstrate that LLM-guided zero-shot feature selection achieves competitive performance with traditional FS methods while offering additional advantages in interpretability, stability, and reduced dependence on labeled data. These findings position zero-shot LLM-based FS as a promising alternative strategy for effective and interpretable malware detection, paving the way for knowledge-guided feature selection in security-critical applications

📄 PDF Abstract BibTeX arXiv:2602.09634

Code (0)

등록된 구현이 없습니다.

Tasks

Malware Detection

Similar Papers 제목 키워드 기반

BoostTaxo: Zero-Shot Taxonomy Induction via Boosting-Style Agentic Reasoning and Constraint-Aware Calibration

2026-04-03 · Yancheng Ling, Zhenlin Qin, Leizhen Wang, Zhenliang Ma arxiv

Taxonomy induction is crucial for organizing concepts into explicit and interpretable semantic hierarchies. While existing methods have achieved promising results, their generalization, structural reliability, and effici…

Boosted Zero-Shot Learning with Semantic Correlation Regularization

2017-07-25 · Te Pi, Xi Li, Zhongfei, Zhang

We study zero-shot learning (ZSL) as a transfer learning problem, and focus on the two key aspects of ZSL, model effectiveness and model adaptation. For effective modeling, we adopt the boosting strategy to learn a zero-…

Model SelectionTransfer Learningzero-shot-classificationZero-Shot Learning

Zero-Shot Feature Selection via Transferring Supervised Knowledge

2019-08-09 · Zheng Wang, Qiao Wang, Tingzhang Zhao, Xiaojun Ye

Feature selection, an effective technique for dimensionality reduction, plays an important role in many machine learning systems. Supervised knowledge can significantly improve the performance. However, faced with the ra…

Dimensionality Reductionfeature selectionZero-Shot Learning

Multi Task Learning For Zero Shot Performance Prediction of Multilingual Models

2022-05-12 · ACL 2022 5 · Kabir Ahuja, Shanu Kumar, Sandipan Dandapat, Monojit Choudhury

Massively Multilingual Transformer based Language Models have been observed to be surprisingly effective on zero-shot transfer across languages, though the performance varies from language to language depending on the pi…

feature selectionMulti-Task Learning

Interpretable Cross-Examination Technique (ICE-T): Using highly informative features to boost LLM performance

2024-05-08 · Goran Muric, Ben Delay, Steven Minton

In this paper, we introduce the Interpretable Cross-Examination Technique (ICE-T), a novel approach that leverages structured multi-prompt techniques with Large Language Models (LLMs) to improve classification performanc…

Decision Making