Approach to improving the quality of program code generation by large language models

Подход к повышению качества генерации программного кода большими языковыми моделями
A.N. Timofeev, S.S. Mikhaylova
2024-04-04

code error checkingknowledge baseslarge language modelsontology-based verificationprogram code generation
Problem. The problems that arise when using large language models in code generation problems and existing methods of solving them are investigated. Target. Improve the quality of program code generation Results. An approach to quality improvement based on verification of generation results using a model that includes ontologies and knowledge bases is proposed. Practical significance. Among the possible approaches to the application of ontologies and knowledge bases in code generation tasks, the following can be distinguished: checking the code for possible errors, generating explanations, generating hints, preparing tasks, evaluating results. The proposed approach is aimed at verifying and enriching the semantics of intermediate or final results of the large language model (LLM), as well as to improve the quality of manually written code.
1
An approach is proposed that improves program code generation quality by verifying LLM-generated results using a model incorporating ontologies and knowledge bases.
2
The proposed verification approach can also be applied to improve the quality of manually written code.
3
The verification model aims to enrich and validate the semantics of intermediate or final outputs from large language models.
4
Using ontologies and knowledge bases enables additional capabilities: code error checking, explanation generation, hint generation, task preparation, and result evaluation.

Program code generated by large language models

Improving the quality of generated program code via verification and semantic enrichment using a model that incorporates ontologies and knowledge bases (including error checking, explanations, hints, task preparation, and result evaluation)

Publication Details
Publication Date
2024-04-04
Journal
Publisher
ISSN
Cited by
0
Access Type
Author Information
Authors
A.N. Timofeev
S.S. Mikhaylova
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat
Make a presentation
100%