Development of REGAI: Rubric Enabled Generative Artificial Intelligence
This paper presents and evaluates a new retrieval augmented generation (RAG) and large language model (LLM)-based artificial intelligence (AI) technique: rubric enabled generative artificial intelligence (REGAI). REGAI uses rubrics, which can be created manually or automatically by the system, to enhance the performance of LLMs for evaluation purposes. REGAI improves on the performance of both classical LLMs and RAG-based LLM techniques. This paper describes REGAI, presents data regarding its performance and discusses several possible application areas for the technology.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingLarge Language ModelRAGRetrievalRetrieval-augmented GenerationSimilar Papers 제목 키워드 기반
Artificial intelligence-enabled precision medicine for inflammatory skin diseases
Recent advances in artificial intelligence (AI) and multimodal data collection are revolutionizing dermatology. Generative AI and machine learning approaches offer opportunities to enhance the diagnosis and treatment of …
Generative AI Agent for Next-Generation MIMO Design: Fundamentals, Challenges, and Vision
Next-generation multiple input multiple output (MIMO) is expected to be intelligent and scalable. In this paper, we study generative artificial intelligence (AI) agent-enabled next-generation MIMO design. Firstly, we pro…
AI AgentLanguage ModelingLanguage ModellingLarge Language Model+3Health-SCORE: Towards Scalable Rubrics for Improving Health-LLMs
Rubrics are essential for evaluating open-ended LLM responses, especially in safety-critical domains such as healthcare. However, creating high-quality and domain-specific rubrics typically requires significant human exp…
Reinforcement LearningGenerative-Evaluative Agreement: A Necessary Validity Criterion for LLM-Enabled Adaptive Assessment
When the same LLM generates assessment items, simulates student responses, and scores them, the validation loop is self-referential. We introduce Generative-Evaluative Agreement (GEA), a validity criterion measuring whet…
Using Learning Progressions to Guide AI Feedback for Science Learning
Generative artificial intelligence (AI) offers scalable support for formative feedback, yet most AI-generated feedback relies on task-specific rubrics authored by domain experts. While effective, rubric authoring is time…