Learning Type Annotation: Is Big Data Enough?
TypeScript is a widely used optionally-typed language where developers can adopt “pay as you go” typing: they can add types as desired, and benefit from static typing. The “type annotation tax” or manual effort required to annotate new or existing TypeScript can be reduced by a variety of automatic methods. Probabilistic machine-learning (ML) approaches work quite well. ML approaches use different inductive biases, ranging from simple token sequences to complex graphical neural network (GNN) models capturing syntax and semantic relations. More sophisticated inductive biases are hand-engineered to exploit the formal nature of software. Rather than deploying fancy inductive biases for code, can we just use “big data” to learn natural patterns relevant to typing? We find evidence suggesting that this is the case. We present TypeBert, demonstrating that even with simple token-sequence inductive bias used in BERT-style models and enough data, type-annotation performance of the most sophisticated models can be surpassed.
Code (1)
Tasks
Inductive BiasSimilar Papers 제목 키워드 기반
CAT: the CELCT Annotation Tool
This paper presents CAT - CELCT Annotation Tool, a new general-purpose web-based tool for text annotation developed by CELCT (Center for the Evaluation of Language and Communication Technologies). The aim of CAT is to ma…
Managementtext annotationAlignment Annotation for Clinic Visit Dialogue to Clinical Note Sentence Language Generation
For every patient{'}s visit to a clinician, a clinical note is generated documenting their medical conversation, including complaints discussed, treatments, and medical plans. Despite advances in natural language process…
Information RetrievalRetrievalSentenceText GenerationConstruction and Annotation of a French Folkstale Corpus
In this paper, we present the digitization and annotation of a tales corpus - which is to our knowledge the only French tales corpus available and classified according to the Aarne{\&}Thompson classification - composed o…
Emotion RecognitionInformation RetrievalOptical Character Recognition (OCR)POS+1Detecting Annotation Errors in Morphological Data with the Transformer
Annotation errors that stem from various sources are usually unavoidable when performing large-scale annotation of linguistic data. In this paper, we evaluate the feasibility of using the Transformer model to detect vari…