Identifier Namespaces in Mathematical Notation
In this thesis, we look at the problem of assigning each identifier of a document to a namespace. At the moment, there does not exist a special dataset where all identifiers are grouped to namespaces, and therefore we need to create such a dataset ourselves. To do that, we need to find groups of documents that use identifiers in the same way. This can be done with cluster analysis methods. We argue that documents can be represented by the identifiers they contain, and this approach is similar to representing textual information in the Vector Space Model. Because of this, we can apply traditional document clustering techniques for namespace discovery. Because the problem is new, there is no gold standard dataset, and it is hard to evaluate the performance of our method. To overcome it, we first use Java source code as a dataset for our experiments, since it contains the namespace information. We verify that our method can partially recover namespaces from source code using only information about identifiers. The algorithms are evaluated on the English Wikipedia, and the proposed method can extract namespaces on a variety of topics. After extraction, the namespaces are organized into a hierarchical structure by using existing classification schemes such as MSC, PACS and ACM. We also apply it to the Russian Wikipedia, and the results are consistent across the languages. To our knowledge, the problem of introducing namespaces to mathematics has not been studied before, and prior to our work there has been no dataset where identifiers are grouped into namespaces. Thus, our result is not only a good start, but also a good indicator that automatic namespace discovery is possible.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Probing Pretrained Models of Source Code
Deep learning models are widely used for solving challenging code processing tasks, such as code generation or code summarization. Traditionally, a specific model architecture was carefully built to solve a particular co…
ClassificationregressionVariable misuseA Latent Space Analysis of Editor Lifecycles in Wikipedia
Collaborations such as Wikipedia are a key part of the value of the modern Internet. At the same time there is concern that these collaborations are threatened by high levels of member turnover. In this paper we borrow i…
Mathematical Language Processing Project
In natural language, words and phrases themselves imply the semantics. In contrast, the meaning of identifiers in mathematical formulae is undefined. Thus scientists must study the context to decode the meaning. The Math…
SentenceTAGMathAlign: Linking Formula Identifiers to their Contextual Natural Language Descriptions
Extending machine reading approaches to extract mathematical concepts and their descriptions is useful for a variety of tasks, ranging from mathematical information retrieval to increasing accessibility of scientific doc…
Information RetrievalReading ComprehensionRetrievalBeyond De-Identification: A Structured Approach for Defining and Detecting Indirect Identifiers in Medical Texts
Sharing sensitive texts for scientific purposes requires appropriate techniques to protect the privacy of patients and healthcare personnel. Anonymizing textual data is particularly challenging due to the presence of div…
De-identification