Better Modeling the Programming World with Code Concept Graphs-augmented Multi-modal Learning
The progress made in code modeling has been tremendous in recent years thanks to the design of natural language processing learning approaches based on state-of-the-art model architectures. Nevertheless, we believe that the current state-of-the-art does not focus enough on the full potential that data may bring to a learning process in software engineering. Our vision articulates on the idea of leveraging multi-modal learning approaches to modeling the programming world. In this paper, we investigate one of the underlying idea of our vision whose objective based on concept graphs of identifiers aims at leveraging high-level relationships between domain concepts manipulated through particular language constructs. In particular, we propose to enhance an existing pretrained language model of code by joint-learning it with a graph neural network based on our concept graphs. We conducted a preliminary evaluation that shows gain of effectiveness of the models for code search using a simple joint-learning method and prompts us to further investigate our research vision.
Code (0)
등록된 구현이 없습니다.
Tasks
Code SearchGraph Neural NetworkLanguage ModelingLanguage ModellingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Do Large Code Models Understand Programming Concepts? Counterfactual Analysis for Code Predicates
Large Language Models' success on text generation has also made them better at code generation and coding tasks. While a lot of work has demonstrated their remarkable performance on tasks such as code completion and edit…
Code CompletionCode GenerationcounterfactualText GenerationModeling Student Learning with 3.8 Million Program Traces
As programmers write code, they often edit and retry multiple times, creating rich "interaction traces" that reveal how they approach coding tasks and provide clues about their level of skill development. For novice prog…
Code GenerationLLM-Aided Customizable Profiling of Code Data Based On Programming Language Concepts
Data profiling is critical in machine learning for generating descriptive statistics, supporting both deeper understanding and downstream tasks like data valuation and curation. This work addresses profiling specifically…
Code GenerationData ValuationDescriptiveLarge Language Models for In-Context Student Modeling: Synthesizing Student's Behavior in Visual Programming
Student modeling is central to many educational technologies as it enables predicting future learning outcomes and designing targeted instructional strategies. However, open-ended learning domains pose challenges for acc…
MisconceptionsProgramming knowledge tracing based on heterogeneous graph representation
Existing programming knowledge tracing methods have not deeply explored the relationships between knowledge concepts and programming questions or students’ codes, which leads to insufficient representation of programming…
Graph structure learningKnowledge TracingRepresentation Learning