paper-with-me

홈 › Papers

Enhancing Cloud-Based Large Language Model Processing with Elasticsearch and Transformer Models

2024-02-24 · Chunhe Ni, Jiang Wu, Hongbo Wang, Wenran Lu, Chenwei Zhang

Large Language Models (LLMs) are a class of generative AI models built using the Transformer network, capable of leveraging vast datasets to identify, summarize, translate, predict, and generate language. LLMs promise to revolutionize society, yet training these foundational models poses immense challenges. Semantic vector search within large language models is a potent technique that can significantly enhance search result accuracy and relevance. Unlike traditional keyword-based search methods, semantic search utilizes the meaning and context of words to grasp the intent behind queries and deliver more precise outcomes. Elasticsearch emerges as one of the most popular tools for implementing semantic search an exceptionally scalable and robust search engine designed for indexing and searching extensive datasets. In this article, we delve into the fundamentals of semantic search and explore how to harness Elasticsearch and Transformer models to bolster large language model processing paradigms. We gain a comprehensive understanding of semantic search principles and acquire practical skills for implementing semantic search in real-world model application scenarios.

📄 PDF Abstract BibTeX arXiv:2403.00807

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingLarge Language Model

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Multi-Head Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

BLINK with Elasticsearch for Efficient Entity Linking in Business Conversations

2022-05-09 · NAACL (ACL) 2022 7 · Md Tahmid Rahman Laskar, Cheng Chen, Aliaksandr Martsinovich, Jonathan Johnston 외

An Entity Linking system aligns the textual mentions of entities in a text to their corresponding entries in a knowledge base. However, deploying a neural entity linking system for efficient real-time inference in produc…

Entity Linking

Efficient comparison of sentence embeddings

2022-04-02 · Spyros Zoupanos, Stratis Kolovos, Athanasios Kanavos, Orestis Papadimitriou 외

The domain of natural language processing (NLP), which has greatly evolved over the last years, has highly benefited from the recent developments in word and sentence embeddings. Such embeddings enable the transformation…

Semantic SimilaritySemantic Textual SimilaritySentenceSentence Embedding+2

Optimizing Retrieval-Augmented Generation with Elasticsearch for Enhanced Question-Answering Systems

2024-10-18 · Jiajing Chen, Runyuan Bao, Hongye Zheng, Zhen Qi 외

This study aims to improve the accuracy and quality of large-scale language models (LLMs) in answering questions by integrating Elasticsearch into the Retrieval Augmented Generation (RAG) framework. The experiment uses t…

Question AnsweringRAGRetrievalRetrieval-augmented Generation+2

Towards Practical Visual Search Engine within Elasticsearch

2018-06-23 · Cun Mu, Jun Zhao, Guang Yang, Jing Zhang 외

In this paper, we describe our end-to-end content-based image retrieval system built upon Elasticsearch, a well-known and popular textual search engine. As far as we know, this is the first time such a system has been im…

Content-Based Image RetrievalImage RetrievalRetrieval

Cloud Security Leveraging AI: A Fusion-Based AISOC for Malware and Log Behaviour Detection

2025-12-16 · Nnamdi Philip Okonkwo, Lubna Luxmi Dhirani arxiv

Cloud Security Operations Center (SOC) enable cloud governance, risk and compliance by providing insights visibility and control. Cloud SOC triages high-volume, heterogeneous telemetry from elastic, short-lived resources…