Author Identification using Multi-headed Recurrent Neural Networks
Recurrent neural networks (RNNs) are very good at modelling the flow of text, but typically need to be trained on a far larger corpus than is available for the PAN 2015 Author Identification task. This paper describes a novel approach where the output layer of a character-level RNN language model is split into several independent predictive sub-models, each representing an author, while the recurrent layer is shared by all. This allows the recurrent layer to model the language as a whole without over-fitting, while the outputs select aspects of the underlying model that reflect their author's style. The method proves competitive, ranking first in two of the four languages.
Code (4)
Tasks
Language ModelingLanguage ModellingSimilar Papers 제목 키워드 기반
Authorship clustering using multi-headed recurrent neural networks
A recurrent neural network that has been trained to separately model the language of several documents by unknown authors is used to measure similarity between the documents. It is able to find clues of common authorship…
ClusteringTwo-headed eye-segmentation approach for biometric identification
Iris-based identification systems are among the most popular approaches for person identification. Such systems require good-quality segmentation modules that ideally identify the regions for different eye components. Th…
Person IdentificationVocal Bursts Valence PredictionMulti-Level Attention for Unsupervised Person Re-Identification
The attention mechanism is widely used in deep learning because of its excellent performance in neural networks without introducing additional information. However, in unsupervised person re-identification, the attention…
Person Re-IdentificationUnsupervised Person Re-IdentificationAuthorship attribution via network motifs identification
Concepts and methods of complex networks can be used to analyse texts at their different complexity levels. Examples of natural language processing (NLP) tasks studied via topological analysis of networks are keyword ide…
Authorship AttributionExtractive SummarizationSingle Headed Attention RNN: Stop Thinking With Your Head
The leading approaches in language modeling are all obsessed with TV shows of my youth - namely Transformers and Sesame Street. Transformers this, Transformers that, and over here a bonfire worth of GPU-TPU-neuromorphic …
GPUHyperparameter OptimizationLanguage ModelingLanguage Modelling