Neural Embedding Language Models in Semantic Clustering of Web Search Results
In this paper, a new approach towards semantic clustering of the results of ambiguous search queries is presented. We propose using distributed vector representations of words trained with the help of prediction-based neural embedding models to detect senses of search queries and to cluster search engine results page according to these senses. The words from titles and snippets together with semantic relationships between them form a graph, which is further partitioned into components related to different query senses. This approach to search engine results clustering is evaluated against a new manually annotated evaluation data set of Russian search queries. We show that in the task of semantically clustering search results, prediction-based models slightly but stably outperform traditional count-based ones, with the same training corpora.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringSimilar Papers 제목 키워드 기반
Language Modeling by Clustering with Word Embeddings for Text Readability Assessment
We present a clustering-based language model using word embeddings for text readability prediction. Presumably, an Euclidean semantic space hypothesis holds true for word embeddings whose training is done by observing wo…
ClusteringLanguage ModelingLanguage ModellingSentence+1Graph-based Clustering for Detecting Semantic Change Across Time and Languages
Despite the predominance of contextualized embeddings in NLP, approaches to detect semantic change relying on these embeddings and clustering methods underperform simpler counterparts based on static word embeddings. Thi…
Binary ClassificationClusteringWord EmbeddingsOMNIA: Closing the Loop by Leveraging LLMs for Knowledge Graph Completion
Knowledge Graphs (KGs) are widely used to represent structured knowledge, yet their automatic construction, especially with Large Language Models (LLMs), often results in incomplete or noisy outputs. Knowledge Graph Comp…
Knowledge Graph CompletionKnowledge GraphsSemantically Enriched Cross-Lingual Sentence Embeddings for Crisis-related Social Media Texts
Tasks such as semantic search and clustering on crisis-related social media texts enhance our comprehension of crisis discourse, aiding decision-making and targeted interventions. Pre-trained language models have advance…
Decision MakingDiversitySentenceSentence EmbeddingsText Clustering with Large Language Model Embeddings
Text clustering is an important method for organising the increasing volume of digital content, aiding in the structuring and discovery of hidden patterns in uncategorised data. The effectiveness of text clustering large…
ClusteringDimensionality ReductionLanguage ModelingLanguage Modelling+3