paper-with-me

Papers

Techniques for Inverted Index Compression

2019-08-28 · Giulio Ermanno Pibiri, Rossano Venturini

The data structure at the core of large-scale search engines is the inverted index, which is essentially a collection of sorted integer sequences called inverted lists. Because of the many documents indexed by such engines and stringent performance requirements imposed by the heavy load of queries, the inverted index stores billions of integers that must be searched efficiently. In this scenario, index compression is essential because it leads to a better exploitation of the computer memory hierarchy for faster query processing and, at the same time, allows reducing the number of storage machines. The aim of this article is twofold: first, surveying the encoding algorithms suitable for inverted index compression and, second, characterizing the performance of the inverted index through experimentation.

📄 PDF Abstract BibTeX arXiv:1908.10598

Code (2)

jermp/2i_bench 공식 구현
jermp/s_indexes

Similar Papers 제목 키워드 기반

Universal Indexes for Highly Repetitive Document Collections

2016-05-24 · Claude Francisco, Fariña Antonio, Martínez-Prieto Miguel A., Navarro Gonzalo

Indexing highly repetitive collections has become a relevant problem with the emergence of large repositories of versioned documents, among other applications. These collections may reach huge sizes, but are formed mostl…

On Optimally Partitioning Variable-Byte Codes

2018-04-29 · Giulio Ermanno Pibiri, Rossano Venturini

The ubiquitous Variable-Byte encoding is one of the fastest compressed representation for integer sequences. However, its compression ratio is usually not competitive with other more sophisticated encoders, especially wh…

The Potential of Learned Index Structures for Index Compression

2019-01-29 · Oosterhuis Harrie, Culpepper J. Shane, de Rijke Maarten

Inverted indexes are vital in providing fast key-word-based search. For every term in the document collection, a list of identifiers of documents in which the term appears is stored, along with auxiliary information such…

Inverted Semantic-Index for Image Retrieval

2022-06-25 · Ying Wang

This paper addresses the construction of inverted index for large-scale image retrieval. The inverted index proposed by J. Sivic brings a significant acceleration by reducing distance computations with only a small fract…

Clusteringimage-classificationImage ClassificationImage Retrieval+2

Quasi-Succinct Indices

2012-06-19 · Sebastiano Vigna

Compressed inverted indices in use today are based on the idea of gap compression: documents pointers are stored in increasing order, and the gaps between successive document pointers are stored using suitable codes whic…