Visual Word Embedding for Text Classification
The question we answer with this paper is: ‘can we convert a text document into an image to take advantage of image neural models to classify text documents?’ To answer this question we present a novel text classification method that converts a document into an encoded image, using word embedding. The proposed approach computes the Word2Vec word embedding of a text document, quantizes the embedding, and arranges it into a 2D visual representation, as an RGB image. Finally, visual embedding is categorized with state-of-the-art image classification models. We achieved competitive performance on well-known benchmark text classification datasets. In addition, we evaluated our proposed approach in a multimodal setting that allows text and image information in the same feature space.
Code (1)
Tasks
ClassificationGeneral Classificationimage-classificationImage Classificationtext-classificationText ClassificationSimilar Papers 제목 키워드 기반
Visual Word2Vec (vis-w2v): Learning Visually Grounded Word Embeddings Using Abstract Scenes
We propose a model to learn visually grounded word embeddings (vis-w2v) to capture visual notions of semantic relatedness. While word embeddings trained using text have been extremely successful, they cannot uncover noti…
Common Sense ReasoningImage RetrievalRetrievalVisual Grounding+1From Image to Text Classification: A Novel Approach based on Clustering Word Embeddings
In this paper, we propose a novel approach for text classification based on clustering word embeddings, inspired by the bag of visual words model, which is widely used in computer vision. After each word in a collection …
ClusteringGeneral ClassificationImage to textText Categorization+3Visualizing Linguistic Shift
Neural network based models are a very powerful tool for creating word embeddings, the objective of these models is to group similar words together. These embeddings have been used as features to improve results in vario…
Document ClassificationLanguage ModelingLanguage Modellingnamed-entity-recognition+4Understanding Visual Concepts Across Models
Large multimodal models such as Stable Diffusion can generate, detect, and classify new visual concepts after fine-tuning just a single word embedding. Do models learn similar words for the same concepts (i.e. <orange-ca…
Image Generationobject-detectionObject DetectionText to Image Generation+4Improving Neural Metaphor Detection with Visual Datasets
We present new results on Metaphor Detection by using text from visual datasets. Using a straightforward technique for sampling text from Vision-Language datasets, we create a data structure we term a visibility word emb…