DS SERVE: A Framework for Efficient and Scalable Neural Retrieval
We present DS-Serve, a framework that transforms large-scale text datasets, comprising half a trillion tokens, into a high-performance neural retrieval system. DS-Serve offers both a web interface and API endpoints, achieving low latency with modest memory overhead on a single node. The framework also supports inference-time trade-offs between latency, accuracy, and result diversity. We anticipate that DS-Serve will be broadly useful for a range of applications, including large-scale retrieval-augmented generation (RAG), training data attribution, training search agents, and beyond.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Tool-to-Agent Retrieval: Bridging Tools and Agents for Scalable LLM Multi-Agent Systems
Recent advances in LLM Multi-Agent Systems enable scalable orchestration of sub-agents, each coordinating hundreds or thousands of tools or Model Context Protocol (MCP) servers. However, existing retrieval methods typica…
Accurate and Scalable Multimodal Pathology Retrieval via Attentive Vision-Language Alignment
The rapid digitization of histopathology slides has opened up new possibilities for computational tools in clinical and research workflows. Among these, content-based slide retrieval stands out, enabling pathologists to …
Contrastive LearningImage RetrievalA multimodal deep learning framework for scalable content based visual media retrieval
We propose a novel, efficient, modular and scalable framework for content based visual media retrieval systems by leveraging the power of Deep Learning which is flexible to work both for images and videos conjointly and …
Multimodal Deep LearningRetrievalSlugbot: An Application of a Novel and Scalable Open Domain Socialbot Framework
In this paper we introduce a novel, open domain socialbot for the Amazon Alexa Prize competition, aimed at carrying on friendly conversations with users on a variety of topics. We present our modular system, highlighting…
Dialogue ManagementInformation RetrievalManagementNatural Language Understanding+1Reducing Redundancy in Whole-Slide Image Patching for Scalable Indexing and Retrieval
The rapid growth of digital pathology has created an urgent need for efficient indexing and retrieval of whole slide images (WSIs). This need is intensified by emerging generative AI workflows, particularly retrieval-aug…