paper-with-me

Papers

conLSH: Context based Locality Sensitive Hashing for Mapping of noisy SMRT Reads

2019-03-11 · Angana Chakraborty, Sanghamitra Bandyopadhyay

Single Molecule Real-Time (SMRT) sequencing is a recent advancement of Next Gen technology developed by Pacific Bio (PacBio). It comes with an explosion of long and noisy reads demanding cutting edge research to get most out of it. To deal with the high error probability of SMRT data, a novel contextual Locality Sensitive Hashing (conLSH) based algorithm is proposed in this article, which can effectively align the noisy SMRT reads to the reference genome. Here, sequences are hashed together based not only on their closeness, but also on similarity of context. The algorithm has $\mathcal{O}(n^{\rho+1})$ space requirement, where $n$ is the number of sequences in the corpus and $\rho$ is a constant. The indexing time and querying time are bounded by $\mathcal{O}( \frac{n^{\rho+1} \cdot \ln n}{\ln \frac{1}{P_2}})$ and $\mathcal{O}(n^\rho)$ respectively, where $P_2 > 0$, is a probability value. This algorithm is particularly useful for retrieving similar sequences, a widely used task in biology. The proposed conLSH based aligner is compared with rHAT, popularly used for aligning SMRT reads, and is found to comprehensively beat it in speed as well as in memory requirements. In particular, it takes approximately $24.2\%$ less processing time, while saving about $70.3\%$ in peak memory requirement for H.sapiens PacBio dataset.

📄 PDF Abstract BibTeX arXiv:1903.04925

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

An Improved Video Analysis using Context based Extension of LSH

2017-05-10 · Angana Chakraborty, Sanghamitra Bandyopadhyay

Locality Sensitive Hashing (LSH) based algorithms have already shown their promise in finding approximate nearest neighbors in high dimen- sional data space. However, there are certain scenarios, as in sequential data, w…

Action RecognitionRetrievalTemporal Action LocalizationVideo Retrieval

Locality-sensitive hashing in function spaces

2020-02-10 · Will Shand, Stephen Becker

We discuss the problem of performing similarity search over function spaces. To perform search over such spaces in a reasonable amount of time, we use {\it locality-sensitive hashing} (LSH). We present two methods that a…

Neural Locality Sensitive Hashing for Entity Blocking

2024-01-31 · Runhui Wang, Luyang Kong, Yefan Tao, Andrew Borthwick 외

Locality-sensitive hashing (LSH) is a fundamental algorithmic technique widely employed in large-scale data processing applications, such as nearest-neighbor search, entity resolution, and clustering. However, its applic…

BlockingEntity Resolution

Super-Bit Locality-Sensitive Hashing

2012-12-01 · NeurIPS 2012 12 · Jianqiu Ji, Jianmin Li, Shuicheng Yan, Bo Zhang 외

Sign-random-projection locality-sensitive hashing (SRP-LSH) is a probabilistic dimension reduction method which provides an unbiased estimate of angular similarity, yet suffers from the large variance of its estimation. …

Dimensionality ReductionRetrieval

Hashing for Similarity Search: A Survey

2014-08-13 · Jingdong Wang, Heng Tao Shen, Jingkuan Song, Jianqiu Ji

Similarity search (nearest neighbor search) is a problem of pursuing the data items whose distances to a query item are the smallest from a large database. Various methods have been developed to address this problem, and…

Survey