paper-with-me

홈 › Papers

Navigable Proximity Graph-Driven Native Hybrid Queries with Structured and Unstructured Constraints

2022-03-25 · Mengzhao Wang, Lingwei Lv, Xiaoliang Xu, Yuxiang Wang, Qiang Yue, Jiongkang Ni

As research interest surges, vector similarity search is applied in multiple fields, including data mining, computer vision, and information retrieval. {Given a set of objects (e.g., a set of images) and a query object, we can easily transform each object into a feature vector and apply the vector similarity search to retrieve the most similar objects. However, the original vector similarity search cannot well support \textit{hybrid queries}, where users not only input unstructured query constraint (i.e., the feature vector of query object) but also structured query constraint (i.e., the desired attributes of interest). Hybrid query processing aims at identifying these objects with similar feature vectors to query object and satisfying the given attribute constraints. Recent efforts have attempted to answer a hybrid query by performing attribute filtering and vector similarity search separately and then merging the results later, which limits efficiency and accuracy because they are not purpose-built for hybrid queries.} In this paper, we propose a native hybrid query (NHQ) framework based on proximity graph (PG), which provides the specialized \textit{composite index and joint pruning} modules for hybrid queries. We easily deploy existing various PGs on this framework to process hybrid queries efficiently. Moreover, we present two novel navigable PGs (NPGs) with optimized edge selection and routing strategies, which obtain better overall performance than existing PGs. After that, we deploy the proposed NPGs in NHQ to form two hybrid query methods, which significantly outperform the state-of-the-art competitors on all experimental datasets (10$\times$ faster under the same \textit{Recall}), including eight public and one in-house real-world datasets. Our code and datasets have been released at \url{https://github.com/AshenOn3/NHQ}.

📄 PDF Abstract BibTeX arXiv:2203.13601

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeInformation RetrievalObjectRetrieval

Similar Papers 제목 키워드 기반

An Efficient and Robust Framework for Approximate Nearest Neighbor Search with Attribute Constraint

2023-09-21 · NeurIPS 2023 11

This paper introduces an efficient and robust framework for hybrid query (HQ) processing, which combines approximate nearest neighbor search (ANNS) with attribute constraint. HQ aims to find objects that are similar to a…

Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphs

2016-03-30 · Yu. A. Malkov, D. A. Yashunin

We present a new approach for the approximate K-nearest neighbor search based on navigable small world graphs with controllable hierarchy (Hierarchical NSW, HNSW). The proposed solution is fully graph-based, without any …

GEM: A Native Graph-based Index for Multi-Vector Retrieval

2026-03-20 · Yao Tian, Zhoujin Tian, Xi Zhao, Ruiyuan Zhang 외 arxiv

In multi-vector retrieval, both queries and data are represented as sets of high-dimensional vectors, enabling finer-grained semantic matching and improving retrieval quality over single-vector approaches. However, its p…

Understanding and Improving Proximity Graph based Maximum Inner Product Search

2019-09-30 · Jie Liu, Xiao Yan, Xinyan Dai, Zhirong Li 외

The inner-product navigable small world graph (ip-NSW) represents the state-of-the-art method for approximate maximum inner product search (MIPS) and it can achieve an order of magnitude speedup over the fastest baseline…

Navigable Graphs for High-Dimensional Nearest Neighbor Search: Constructions and Limits

2024-05-29 · Haya Diwan, Jinrui Gou, Cameron Musco, Christopher Musco 외

There has been significant recent interest in graph-based nearest neighbor search methods, many of which are centered on the construction of navigable graphs over high-dimensional point sets. A graph is navigable if we c…