Hash2Vec, Feature Hashing for Word Embeddings

2016-08-31 · Luis Argerich, Joaquín Torré Zaffaroni, Matías J Cano

In this paper we propose the application of feature hashing to create word embeddings for natural language processing. Feature hashing has been used successfully to create document vectors in related tasks like document classification. In this work we show that feature hashing can be applied to obtain word embeddings in linear time with the size of the data. The results show that this algorithm, that does not need training, is able to capture the semantic meaning of words. We compare the results against GloVe showing that they are similar. As far as we know this is the first application of feature hashing to the word embeddings problem and the results indicate this is a scalable technique with practical results for NLP applications.

📄 PDF Abstract BibTeX arXiv:1608.08940

Code (0)

등록된 구현이 없습니다.

Tasks

Document Classification General ClassificationWord Embeddings

Methods 이 논문이 사용한 방법론

GloVe GloVe Embeddings are a type of word embedding that encode the co-occurrence probability ratio between two words as vector differences. GloVe uses a weighted least squares…

Hash Embeddings for Efficient Word Representations

2017-09-12 · NeurIPS 2017 12 · Dan Svenstrup, Jonas Meinertz Hansen, Ole Winther

We present hash embeddings, an efficient method for representing words in a continuous vector form. A hash embedding may be seen as an interpolation between a standard word embedding and a word embedding created using a …

Refining BERT Embeddings for Document Hashing via Mutual Information Maximization

2021-09-07 · Findings (EMNLP) 2021 11 · Zijing Ou, Qinliang Su, Jianxing Yu, Ruihui Zhao 외

Existing unsupervised document hashing methods are mostly established on generative models. Due to the difficulties of capturing long dependency structures, these methods rarely model the raw documents directly, but inst…

Attribute

Weakly Supervised Deep Image Hashing through Tag Embeddings

2018-06-15 · CVPR 2019 6 · Vijetha Gattupalli, Yaoxin Zhuo, Baoxin Li

Many approaches to semantic image hashing have been formulated as supervised learning problems that utilize images and label information to learn the binary hash codes. However, large-scale labeled image data is expensiv…

Deep Hashing Image Retrieval Retrieval TAG+1

Johnson-Lindenstrauss embeddings for noisy vectors -- taking advantage of the noise

2022-09-01 · Zhen Shao

This paper investigates theoretical properties of subsampling and hashing as tools for approximate Euclidean norm-preserving embeddings for vectors with (unknown) additive Gaussian noises. Such embeddings are sometimes c…

Dimensionality Reduction LEMMA

Hashing-Baseline: Rethinking Hashing in the Age of Pretrained Models

2025-09-17 · Ilyass Moummad, Kawtar Zaher, Lukas Rauch, Alexis Joly arxiv

Information retrieval with compact binary embeddings, also referred to as hashing, is crucial for scalable fast search applications, yet state-of-the-art hashing methods require expensive, scenario-specific training. In …

Information Retrieval Image Retrieval