Using off-the-shelf LLMs to query enterprise data by progressively revealing ontologies
Ontologies are known to improve the accuracy of Large Language Models (LLMs) when translating natural language queries into a formal query language like SQL or SPARQL. There are two ways to leverage ontologies when working with LLMs. One is to fine-tune the model, i.e., to enhance it with specific domain knowledge. Another is the zero-shot prompting approach, where the ontology is provided as part of the input question. Unfortunately, modern enterprises typically have ontologies that are too large to fit in a prompt due to LLM's token size limitations. We present a solution that incrementally reveals "just enough" of an ontology that is needed to answer a given question.
Code (0)
등록된 구현이 없습니다.
Tasks
Natural Language QueriesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
BEAVER: An Enterprise Benchmark for Text-to-SQL
Existing text-to-SQL benchmarks have largely been constructed from web tables with human-generated question-SQL pairs. LLMs typically show strong results on these benchmarks, leading to a belief that LLMs are effective a…
Natural Language QueriesPrompt EngineeringRAGText to SQL+1CSR-RAG: An Efficient Retrieval System for Text-to-SQL on the Enterprise Scale
Natural language to SQL translation (Text-to-SQL) is one of the long-standing problems that has recently benefited from advances in Large Language Models (LLMs). While most academic Text-to-SQL benchmarks request schema …
Table RetrievalLLM and Agent-Driven Data Analysis: A Systematic Approach for Enterprise Applications and System-level Deployment
The rapid progress in Generative AI and Agent technologies is profoundly transforming enterprise data management and analytics. Traditional database applications and system deployment are fundamentally impacted by AI-dri…
Computational EfficiencyRAG Strategies for Natural Language-Based SQL Query and REST API Call Generation
Enterprise software systems commonly expose business functionality through both relational databases and REST APIs. Accessing these interfaces requires specialized technical knowledge, as users must determine whether a r…
Code GenerationERATTA: Extreme RAG for Table To Answers with Large Language Models
Large language models (LLMs) with retrieval augmented-generation (RAG) have been the optimal choice for scalable generative AI solutions in the recent past. Although RAG implemented with AI agents (agentic-RAG) has been …
Question AnsweringRAGRetrievalRetrieval-augmented Generation