paper-with-me

Papers

An Ensemble Approach for Annotating Source Code Identifiers with Part-of-speech Tags

2021-09-01 · Christian D. Newman, Michael J. Decker, Reem S. AlSuhaibani, Anthony Peruma, Satyajit Mohapatra, Tejal Vishnoi, Marcos Zampieri, Mohamed W. Mkaouer, Timothy J. Sheldon, Emily Hill

This paper presents an ensemble part-of-speech tagging approach for source code identifiers. Ensemble tagging is a technique that uses machine-learning and the output from multiple part-of-speech taggers to annotate natural language text at a higher quality than the part-of-speech taggers are able to obtain independently. Our ensemble uses three state-of-the-art part-of-speech taggers: SWUM, POSSE, and Stanford. We study the quality of the ensemble's annotations on five different types of identifier names: function, class, attribute, parameter, and declaration statement at the level of both individual words and full identifier names. We also study and discuss the weaknesses of our tagger to promote the future amelioration of these problems through further research. Our results show that the ensemble achieves 75\% accuracy at the identifier level and 84-86\% accuracy at the word level. This is an increase of +17\% points at the identifier level from the closest independent part-of-speech tagger.

📄 PDF Abstract BibTeX arXiv:2109.00629

Code (1)

SCANL/ensemble_tagger 공식 구현

Tasks

AttributePart-Of-Speech Tagging

Similar Papers 제목 키워드 기반

SCALAR: A Part-of-speech Tagger for Identifiers

2025-04-23 · Christian D. Newman, Brandon Scholten, Sophia Testa, Joshua A. C. Behler 외

The paper presents the Source Code Analysis and Lexical Annotation Runtime (SCALAR), a tool specialized for mapping (annotating) source code identifier names to their corresponding part-of-speech tag sequence (grammar pa…

TAG

Splitting source code identifiers using Bidirectional LSTM Recurrent Neural Network

2018-05-26 · Vadim Markovtsev, Waren Long, Egor Bulychev, Romain Keramitas 외

Programmers make rich use of natural language in the source code they write through identifiers and comments. Source code identifiers are selected from a pool of tokens which are strongly related to the meaning, naming c…

Referencing Source Code Artifacts: a Separate Concern in Software Citation

2020-01-23 · Roberto Di Cosmo, Morane Gruenpeter, Stefano Zacchiroli

Among the entities involved in software citation, software source code requires special attention, due to the role it plays in ensuring scientific reproducibility. To reference source code we need identifiers that are no…

Categorizing Mathematical Concepts with LLM Voting Ensembles in Mathswitch

2026-06-27 · Katja Berčič, Slobodan Stanojevikj arxiv

Mathswitch is an open-source project that imports mathematical concept records from sources such as Wikidata, Wikipedia, MathWorld, Encyclopedia of Mathematics, nLab, ProofWiki, and Agda-Unimath, and links records that r…

IdBench: Evaluating Semantic Representations of Identifier Names in Source Code

2019-10-11 · ICLR 2020 1 · Yaza Wainakh, Moiz Rauf, Michael Pradel

Identifier names convey useful information about the intended semantics of code. Name-based program analyses use this information, e.g., to detect bugs, to predict types, and to improve the readability of code. At the co…

Word Embeddings