paper-with-me

Papers

Inferring Pluggable Types with Machine Learning

2024-06-21 · Kazi Amanul Islam Siddiqui, Martin Kellogg

Pluggable type systems allow programmers to extend the type system of a programming language to enforce semantic properties defined by the programmer. Pluggable type systems are difficult to deploy in legacy codebases because they require programmers to write type annotations manually. This paper investigates how to use machine learning to infer type qualifiers automatically. We propose a novel representation, NaP-AST, that encodes minimal dataflow hints for the effective inference of type qualifiers. We evaluate several model architectures for inferring type qualifiers, including Graph Transformer Network, Graph Convolutional Network and Large Language Model. We further validated these models by applying them to 12 open-source programs from a prior evaluation of the NullAway pluggable typechecker, lowering warnings in all but one unannotated project. We discovered that GTN shows the best performance, with a recall of .89 and precision of 0.6. Furthermore, we conduct a study to estimate the number of Java classes needed for good performance of the trained model. For our feasibility study, performance improved around 16k classes, and deteriorated due to overfitting around 22k classes.

📄 PDF Abstract BibTeX arXiv:2406.15676

Code (0)

등록된 구현이 없습니다.

Tasks

16kLanguage ModelingLanguage ModellingLarge Language Model

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
LapEigen 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Position-Wise Feed-Forward Layer 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Pluggable Neural Machine Translation Models via Memory-augmented Adapters

2023-07-12 · Yuzhuang Xu, Shuo Wang, Peng Li, Xuebo Liu 외

Although neural machine translation (NMT) models perform well in the general domain, it remains rather challenging to control their generation behavior to satisfy the requirement of different users. Given the expensive t…

Machine TranslationNMTTranslation

AutoETER: Automated Entity Type Representation for Knowledge Graph Embedding

2020-09-25 · Findings of the Association for Computational Linguistics 2020 · Guanglin Niu, Bo Li, Yongfei Zhang, ShiLiang Pu 외

Recent advances in Knowledge Graph Embedding (KGE) allow for representing entities and relations in continuous vector spaces. Some traditional KGE models leveraging additional type information can improve the representat…

ClusteringGraph EmbeddingKnowledge Graph EmbeddingLink Prediction+3

PlugNet: Degradation Aware Scene Text Recognition Supervised by a Pluggable Super-Resolution Unit

2020-08-01 · ECCV 2020 8 · Yongqiang Mou, Lei Tan, Hui Yang, Jingying Chen 외

In this paper, we address the problem of recognizing degradation images that are suffering from high blur or low-resolution. We propose a novel degradation aware scene text recognizer with a pluggable super-resolution un…

DiversityMulti-Task LearningScene Text RecognitionSuper-Resolution

Inferring Reward Machines and Transition Machines from Partially Observable Markov Decision Processes

2025-08-03 · Yuly Wu, Jiamou Liu, Libo Zhang arxiv

Partially Observable Markov Decision Processes (POMDPs) are fundamental to many real-world applications. Although reinforcement learning (RL) has shown success in fully observable domains, learning policies from traces i…

Reinforcement Learning

Clusters in Explanation Space: Inferring disease subtypes from model explanations

2019-12-18 · Marc-Andre Schulz, Matt Chapman-Rounds, Manisha Verma, Danilo Bzdok 외

Identification of disease subtypes and corresponding biomarkers can substantially improve clinical diagnosis and treatment selection. Discovering these subtypes in noisy, high dimensional biomedical data is often impossi…

ClusteringDiagnostic