ALMs: Authorial Language Models for Authorship Attribution
In this paper, we introduce an authorship attribution method called Authorial Language Models (ALMs) that involves identifying the most likely author of a questioned document based on the perplexity of the questioned document calculated for a set of causal language models fine-tuned on the writings of a set of candidate author. We benchmarked ALMs against state-of-art-systems using the CCAT50 dataset and the Blogs50 datasets. We find that ALMs achieves a macro-average accuracy score of 83.6% on Blogs50, outperforming all other methods, and 74.9% on CCAT50, matching the performance of the best method. To assess the performance of ALMs on shorter texts, we also conducted text ablation testing. We found that to reach a macro-average accuracy of 70%, ALMs needs 40 tokens on Blogs50 and 400 tokens on CCAT50, while to reach 60% ALMs requires 20 tokens on Blogs50 and 70 tokens on CCAT50.
Code (0)
등록된 구현이 없습니다.
Tasks
Authorship AttributionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Mode Effects' Challenge to Authorship Attribution
The success of authorship attribution relies on the presence of linguistic features specific to individual authors. There is, however, limited research assessing to what extent authorial style remains constant when indiv…
Authorship AttributionFeature EngineeringSentenceAre You Robert or RoBERTa? Deceiving Online Authorship Attribution Models Using Neural Text Generators
Recently, there has been a rise in the development of powerful pre-trained natural language models, including GPT-2, Grover, and XLM. These models have shown state-of-the-art capabilities towards a variety of different N…
Authorship AttributionQuestion AnsweringSpam detectionText GenerationTraSE: Towards Tackling Authorial Style from a Cognitive Science Perspective
Stylistic analysis of text is a key task in research areas ranging from authorship attribution to forensic analysis and personality profiling. The existing approaches for stylistic analysis are plagued by issues like top…
Authorship AttributionAssessing the Stylistic Properties of Neurally Generated Text in Authorship Attribution
Recent applications of neural language models have led to an increased interest in the automatic generation of natural language. However impressive, the evaluation of neurally generated text has so far remained rather in…
AttributeAuthorship AttributionText GenerationAssessing the Stylistic Properties of Neurally Generated Text in Authorship Attribution
Recent applications of neural language models have led to an increased interest in the automatic generation of natural language. However impressive, the evaluation of neurally generated text has so far remained rather in…
AttributeAuthorship AttributionData AugmentationLanguage Modeling+2