Label Unification for Cross-Dataset Generalization in Cybersecurity NER
The field of cybersecurity NER lacks standardized labels, making it challenging to combine datasets. We investigate label unification across four cybersecurity datasets to increase data resource usability. We perform a coarse-grained label unification and conduct pairwise cross-dataset evaluations using BiLSTM models. Qualitative analysis of predictions reveals errors, limitations, and dataset differences. To address unification limitations, we propose alternative architectures including a multihead model and a graph-based transfer model. Results show that models trained on unified datasets generalize poorly across datasets. The multihead model with weight sharing provides only marginal improvements over unified training, while our graph-based transfer model built on BERT-base-NER shows no significant performance gains compared BERT-base-NER.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Anti-unification and Generalization: A Survey
Anti-unification (AU) is a fundamental operation for generalization computation used for inductive inference. It is the dual operation to unification, an operation at the foundation of automated theorem proving. Interest…
Automated Theorem ProvingSurveyAlgebraic anti-unification
Abstraction is key to human and artificial intelligence as it allows one to see common structure in otherwise distinct objects or situations and as such it is a key element for generality in AI. Anti-unification (or gene…
Inductive logic programmingImproving Intrusion Detection with Domain-Invariant Representation Learning in Latent Space
Domain generalization focuses on leveraging knowledge from multiple related domains with ample training data and labels to enhance inference on unseen in-distribution (IN) and out-of-distribution (OOD) domains. In our st…
Domain GeneralizationIntrusion DetectionMulti-Task LearningRepresentation LearningTIJERE: A Novel Threat Intelligence Joint Extraction Model Based on Analyst Expert Knowledge
The extraction of entities and relationships from threat intelligence reports into structured formats, such as cybersecurity knowledge graphs, is essential for automated threat analysis, detection, and mitigation. Howeve…
Joint Entity and Relation ExtractionKnowledge GraphsAugmenting Knowledge Transfer across Graphs
Given a resource-rich source graph and a resource-scarce target graph, how can we effectively transfer knowledge across graphs and ensure a good generalization performance? In many high-impact domains (e.g., brain networ…
Domain AdaptationTransfer Learning