EditCompletion 벤치마크
EditCompletion on C# EditCompletion
Accuracy
- 2020-05-27 — C3PO: Accuracy 53.2
| Rank | Model | Accuracy | Paper | Code | Year |
|---|---|---|---|---|---|
| 1 | C3PO | 53.2 | A Structural Model for Contextual Code Changes | tech-srl/c3po | 2020 |
| 2 | LaserTagger (Transformer) | 41.4 | A Structural Model for Contextual Code Changes | tech-srl/c3po | 2020 |
| 3 | LaserTagger (LSTM) | 40.9 | A Structural Model for Contextual Code Changes | tech-srl/c3po | 2020 |
| 4 | SequenceR (Transformer) | 32.6 | A Structural Model for Contextual Code Changes | tech-srl/c3po | 2020 |
| 5 | SequenceR | 30.7 | A Structural Model for Contextual Code Changes | tech-srl/c3po | 2020 |
| 6 | Path2Tree (Transformer) | 25.5 | A Structural Model for Contextual Code Changes | tech-srl/c3po | 2020 |
| 7 | Path2Tree (LSTM) | 22.5 | A Structural Model for Contextual Code Changes | tech-srl/c3po | 2020 |