TinySearch -- Semantics based Search Engine using Bert Embeddings

2019-08-07 · Manish Patel

Existing search engines use keyword matching or tf-idf based matching to map the query to the web-documents and rank them. They also consider other factors such as page rank, hubs-and-authority scores, knowledge graphs to make the results more meaningful. However, the existing search engines fail to capture the meaning of query when it becomes large and complex. BERT, introduced by Google in 2018, provides embeddings for words as well as sentences. In this paper, I have developed a semantics-oriented search engine using neural networks and BERT embeddings that can search for query and rank the documents in the order of the most meaningful to least meaningful. The results shows improvement over one existing search engine for complex queries for given set of documents.

📄 PDF Abstract BibTeX arXiv:1908.02451

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge Graphs

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Residual Connection 설명 없음

Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.

Weight Decay 설명 없음

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Adam 설명 없음

How Can BERT Help Lexical Semantics Tasks?

2019-11-07 · Yile Wang, Leyang Cui, Yue Zhang

Contextualized embeddings such as BERT can serve as strong input representations to NLP tasks, outperforming their static embeddings counterparts such as skip-gram, CBOW and GloVe. However, such embeddings are dynamic, c…

Sentence Word Embeddings

BERTMap: A BERT-based Ontology Alignment System

2021-12-05 · Yuan He, Jiaoyan Chen, Denvar Antonyrajah, Ian Horrocks

Ontology alignment (a.k.a ontology matching (OM)) plays a critical role in knowledge integration. Owing to the success of machine learning in many domains, it has been applied in OM. However, the existing methods, which …

Feature Engineering Ontology Matching Word Embeddings

Privacy-Preserving Text Classification on BERT Embeddings with Homomorphic Encryption

2022-10-05 · NAACL 2022 7 · Garam Lee, Minsoo Kim, Jai Hyun Park, Seung-won Hwang 외

Embeddings, which compress information in raw text into semantics-preserving low-dimensional vectors, have been widely adopted for their efficacy. However, recent research has shown that embeddings can potentially leak p…

Classification GPU Privacy Preserving text-classification+1

Learning Text-Image Joint Embedding for Efficient Cross-Modal Retrieval with Deep Feature Engineering

2021-10-22 · Zhongwei Xie, Ling Liu, Yanzhao Wu, Luo Zhong 외

This paper introduces a two-phase deep feature engineering framework for efficient learning of semantics enhanced joint embedding, which clearly separates the deep feature engineering in data preprocessing from training …

Cross-Modal Retrieval Feature Engineering Retrieval Triplet

Feature Engineering vs BERT on Twitter Data

2022-10-28 · Ryiaadh Gani, Lisa Chalaguine

In this paper, we compare the performances of traditional machine learning models using feature engineering and word vectors and the state-of-the-art language model BERT using word embeddings on three datasets. We also c…

Feature Engineering GPU Language Modeling Language Modelling+1