paper-with-me

Papers

Latent Sculpting for Zero-Shot Generalization: A Manifold Learning Approach to Out-of-Distribution Anomaly Detection

2025-12-19 · Rajeeb Thapa Chhetri, Saurab Thapa, Avinash Kumar, Zhixiong Chen arxiv

A critical vulnerability of supervised deep learning in high-dimensional tabular domains is "generalization collapse": models form precise decision boundaries around known training distributions but fail catastrophically when encountering Out-of-Distribution (OOD) data. To overcome this, we propose Latent Sculpting, a hierarchical, two-stage representation learning architecture designed to enforce explicit structural boundaries prior to density estimation. In the first stage, a Transformer-based tabular encoder is trained using our novel Binary Latent Sculpting loss. This objective explicitly condenses benign network traffic into a dense, low-entropy hypersphere while enforcing a strict geometric minimum-distance margin for anomalous patterns. In the second stage, a Masked Autoregressive Flow (MAF) maps this structurally optimized manifold to calculate exact, probabilistic anomaly thresholds. We evaluate this methodology on the CIC-IDS-2017 benchmark under a rigorous zero-shot protocol, deliberately withholding complex attack classes during training to test true OOD generalization. Averaged across three random initialization seeds to ensure statistical robustness, our framework maintains near-perfect classification on known signatures (F1 = 0.980 +/- 0.000) while achieving an overall zero-shot OOD F1-Score of 0.867 +/- 0.021 and an AUROC of 0.913 +/- 0.010 at an 85th-percentile threshold. Most notably, the model achieves an average recall of 78.7% (peaking at 97.2%) on stealthy "Infiltration" attacks and over 94% on low-volume DoS variations - complex distributional shifts where standard supervised and unsupervised baselines historically suffer near-total detection failure. These empirical results demonstrate that explicitly decoupling topological manifold structuring from probabilistic density estimation establishes a highly stable and scalable defense against zero-day cyber threats.

📄 PDF Abstract BibTeX arXiv:2512.22179

Code (0)

등록된 구현이 없습니다.

Tasks

Zero-shot GeneralizationRepresentation LearningDensity EstimationAnomaly Detection

Similar Papers 제목 키워드 기반

Preserve and Sculpt: Manifold-Aligned Fine-tuning of Vision-Language Models for Few-Shot Learning

2025-08-18 · Dexia Chen, Qianjie Zhu, Weibing Li, Yue Yu 외 arxiv

Pretrained vision-language models (VLMs), such as CLIP, have shown remarkable potential in few-shot image classification and led to numerous effective transfer learning strategies. These methods leverage the pretrained k…

Few-Shot Image ClassificationFew-Shot LearningTransfer LearningDomain Adaptation

Marginalized Latent Semantic Encoder for Zero-Shot Learning

2019-06-01 · CVPR 2019 6 · Zhengming Ding, Hongfu Liu

Zero-shot learning has been well explored to precisely identify new unobserved classes through a visual-semantic function obtained from the existing objects. However, there exist two challenging obstacles: one is that th…

Graph ReconstructionZero-Shot Learning

CLUTR: Curriculum Learning via Unsupervised Task Representation Learning

2022-10-19 · Abdus Salam Azad, Izzeddin Gur, Jasper Emhoff, Nathaniel Alexis 외

Reinforcement Learning (RL) algorithms are often known for sample inefficiency and difficult generalization. Recently, Unsupervised Environment Design (UED) emerged as a new paradigm for zero-shot generalization by simul…

Reinforcement Learning (RL)Representation LearningZero-shot Generalization

You Don't Need Prompt Engineering Anymore: The Prompting Inversion

2025-10-25 · Imran Khan arxiv

Prompt engineering, particularly Chain-of-Thought (CoT) prompting, significantly enhances LLM reasoning capabilities. We introduce "Sculpting," a constrained, rule-based prompting method designed to improve upon standard…

Mathematical ReasoningPrompt Engineering

Relative representations enable zero-shot latent space communication

2022-09-30 · Luca Moschella, Valentino Maiorca, Marco Fumero, Antonio Norelli 외

Neural networks embed the geometric structure of a data manifold lying in a high-dimensional space into latent representations. Ideally, the distribution of the data points in the latent space should depend only on the t…