LSTM Recurrent Neural Networks for Cybersecurity Named Entity Recognition
The automated and timely conversion of cybersecurity information from unstructured online sources, such as blogs and articles to more formal representations has become a necessity for many applications in the domain nowadays. Named Entity Recognition (NER) is one of the early phases towards this goal. It involves the detection of the relevant domain entities, such as product, version, attack name, etc. in technical documents. Although generally considered a simple task in the information extraction field, it is quite challenging in some domains like cybersecurity because of the complex structure of its entities. The state of the art methods require time-consuming and labor intensive feature engineering that describes the properties of the entities, their context, domain knowledge, and linguistic characteristics. The model demonstrated in this paper is domain independent and does not rely on any features specific to the entities in the cybersecurity domain, hence does not require expert knowledge to perform feature engineering. The method used relies on a type of recurrent neural networks called Long Short-Term Memory (LSTM) and the Conditional Random Fields (CRFs) method. The results we obtained showed that this method outperforms the state of the art methods given an annotated corpus of a decent size.
Code (0)
등록된 구현이 없습니다.
Tasks
ArticlesFeature Engineeringnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERSimilar Papers 제목 키워드 기반
Named Entity Recognition With Parallel Recurrent Neural Networks
We present a new architecture for named entity recognition. Our model employs multiple independent bidirectional LSTM units across the same input and promotes diversity among them by employing an inter-model regularizati…
DiversityFeature Engineeringnamed-entity-recognitionNamed Entity Recognition+3Using LSTM and GRU With a New Dataset for Named Entity Recognition in the Arabic Language
Named entity recognition (NER) is a natural language processing task (NLP), which aims to identify named entities and classify them like person, location, organization, etc. In the Arabic language, we can find a consider…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+2Named Entity Recognition with stack residual LSTM and trainable bias decoding
Recurrent Neural Network models are the state-of-the-art for Named Entity Recognition (NER). We present two innovations to improve the performance of these models. The first innovation is the introduction of residual con…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERJoint Extraction of Entity and Relation with Information Redundancy Elimination
To solve the problem of redundant information and overlapping relations of the entity and relation extraction model, we propose a joint extraction model. This model can directly extract multiple pairs of related entities…
DecoderLanguage ModelingLanguage Modellingnamed-entity-recognition+5Neural Reranking for Named Entity Recognition
We propose a neural reranking system for named entity recognition (NER). The basic idea is to leverage recurrent neural network models to learn sentence-level patterns that involve named entity mentions. In particular, g…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+2