paper-with-me

홈 › Papers

LIST: Learning to Index Spatio-Textual Data for Embedding based Spatial Keyword Queries

2024-03-12 · Ziqi Yin, Shanshan Feng, Shang Liu, Gao Cong, Yew Soon Ong, Bin Cui

With the proliferation of spatio-textual data, Top-k KNN spatial keyword queries (TkQs), which return a list of objects based on a ranking function that considers both spatial and textual relevance, have found many real-life applications. To efficiently handle TkQs, many indexes have been developed, but the effectiveness of TkQ is limited. To improve effectiveness, several deep learning models have recently been proposed, but they suffer severe efficiency issues and there are no efficient indexes specifically designed to accelerate the top-k search process for these deep learning models. To tackle these issues, we consider embedding based spatial keyword queries, which capture the semantic meaning of query keywords and object descriptions in two separate embeddings to evaluate textual relevance. Although various models can be used to generate these embeddings, no indexes have been specifically designed for such queries. To fill this gap, we propose LIST, a novel machine learning based Approximate Nearest Neighbor Search index that Learns to Index the Spatio-Textual data. LIST utilizes a new learning-to-cluster technique to group relevant queries and objects together while separating irrelevant queries and objects. There are two key challenges in building an effective and efficient index, i.e., the absence of high-quality labels and the unbalanced clustering results. We develop a novel pseudo-label generation technique to address the two challenges. Additionally, we introduce a learning based spatial relevance model that can integrates with various text relevance models to form a lightweight yet effective relevance for reranking objects retrieved by LIST.

📄 PDF Abstract BibTeX arXiv:2403.07331

Code (0)

등록된 구현이 없습니다.

Tasks

Pseudo LabelReranking

Similar Papers 제목 키워드 기반

Ovis: Structural Embedding Alignment for Multimodal Large Language Model

2024-05-31 · Shiyin Lu, Yang Li, Qing-Guo Chen, Zhao Xu 외

Current Multimodal Large Language Models (MLLMs) typically integrate a pre-trained LLM with another pre-trained vision transformer through a connector, such as an MLP, endowing the LLM with visual capabilities. However, …

Language ModelingMultimodal Large Language ModelVisual Question Answering (VQA)

STIndex: A Context-Aware Multi-Dimensional Spatiotemporal Information Extraction System

2026-04-07 · Wenxiao Zhang, Yu Liu, Qiang sun, Yihao Ding 외 arxiv

Extracting structured knowledge from unstructured data still faces practical limitations: entity and event extraction pipelines remain brittle, knowledge graph construction requires costly ontology engineering, and cross…

Information ExtractionDomain GeneralizationEvent Extraction

SPIRE: Structure-Preserving Interpretable Retrieval of Evidence

2026-02-12 · Mike Rainey, Umut Acar, Muhammed Sezer arxiv

Retrieval-augmented generation over semi-structured sources such as HTML is constrained by a mismatch between document structure and the flat, sequence-based interfaces of today's embedding and generative models. Retriev…

Efficient Inverted Indexes for Approximate Retrieval over Learned Sparse Representations

2024-04-29 · Sebastian Bruch, Franco Maria Nardini, Cosimo Rulli, Rossano Venturini

Learned sparse representations form an attractive class of contextual embeddings for text retrieval. That is so because they are effective models of relevance and are interpretable by design. Despite their apparent compa…

RetrievalText Retrieval

Deep context: end-to-end contextual speech recognition

2018-08-07 · Golan Pundak, Tara N. Sainath, Rohit Prabhavalkar, Anjuli Kannan 외

In automatic speech recognition (ASR) what a user says depends on the particular context she is in. Typically, this context is represented as a set of word n-grams. In this work, we present a novel, all-neural, end-to-en…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition