paper-with-me

홈 › Papers

A Survey of Query Optimization in Large Language Models

2024-12-23 · Mingyang Song, Mao Zheng

\textit{Query Optimization} (QO) refers to techniques aimed at enhancing the efficiency and quality of Large Language Models (LLMs) in understanding and answering queries, especially complex ones in scenarios like Retrieval-Augmented Generation (RAG). Specifically, RAG mitigates the limitations of LLMs by dynamically retrieving and leveraging up-to-date relevant information, which provides a cost-effective solution to the challenge of LLMs producing plausible but potentially inaccurate responses. Recently, as RAG evolves and incorporates multiple components that influence its performance, QO has emerged as a critical element, playing a pivotal role in determining the effectiveness of RAG's retrieval stage in accurately sourcing the necessary multiple pieces of evidence to answer queries correctly. In this paper, we trace the evolution of QO techniques by summarizing and analyzing significant studies. Through an organized framework and categorization, we aim to consolidate existing QO techniques in RAG, elucidate their technological foundations, and highlight their potential to enhance the versatility and applications of LLMs.

📄 PDF Abstract BibTeX arXiv:2412.17558

Code (0)

등록된 구현이 없습니다.

Tasks

RAGRetrievalRetrieval-augmented GenerationSurvey

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Adam 설명 없음
Weight Decay 설명 없음
Multi-Head Attention 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

A Survey of Large Language Model-Based Generative AI for Text-to-SQL: Benchmarks, Applications, Use Cases, and Challenges

2024-12-06 · Aditi Singh, Akash Shetty, Abul Ehtesham, Saket Kumar 외

Text-to-SQL systems facilitate smooth interaction with databases by translating natural language queries into Structured Query Language (SQL), bridging the gap between non-technical users and complex database management …

Domain GeneralizationLanguage ModelingLanguage ModellingLarge Language Model+3

Natural Language Interfaces for Tabular Data Querying and Visualization: A Survey

2023-10-27 · Weixu Zhang, Yifei Wang, Yuanfeng Song, Victor Junqiu Wei 외

The emergence of natural language processing has revolutionized the way users interact with tabular data, enabling a shift from traditional query languages and manual plotting to more intuitive, language-based interfaces…

Data InteractionData VisualizationNatural Language QueriesSemantic Parsing+3

Recent Advances in SQL Query Generation: A Survey

2020-05-15 · Jovan Kalajdjieski, Martina Toshevska, Frosina Stojanovska

Natural language is hypothetically the best user interface for many domains. However, general models that provide an interface between natural language and any other domain still do not exist. Providing natural language …

Survey

A Survey on Video Moment Localization

2023-06-13 · Meng Liu, Liqiang Nie, Yunxiao Wang, Meng Wang 외

Video moment localization, also known as video moment retrieval, aiming to search a target segment within a video described by a given natural language query. Beyond the task of temporal action localization whereby the t…

Action LocalizationMoment RetrievalRetrievalSurvey+1

Tell Me How to Survey: Literature Review Made Simple with Automatic Reading Path Generation

2021-10-12 · Jiayuan Ding, Tong Xiang, Zijing Ou, Wangyang Zuo 외

Recent years have witnessed the dramatic growth of paper volumes with plenty of new research papers published every day, especially in the area of computer science. How to glean papers worth reading from the massive lite…

Survey