Incorporating visual features into word embeddings: A bimodal autoencoder-based approach
Code (0)
등록된 구현이 없습니다.
Tasks
Representation LearningWord EmbeddingsSimilar Papers 제목 키워드 기반
Incorporating Subword Information into Matrix Factorization Word Embeddings
The positive effect of adding subword information to word embeddings has been demonstrated for predictive models. In this paper we investigate whether similar benefits can also be derived from incorporating subwords into…
Word EmbeddingsLanguage with Vision: a Study on Grounded Word and Sentence Embeddings
Grounding language in vision is an active field of research seeking to construct cognitively plausible word and sentence representations by incorporating perceptual knowledge from vision into text-based representations. …
SentenceSentence EmbeddingsVisual GroundingWord Embeddings+1Training and Evaluating Multimodal Word Embeddings with Large-scale Web Annotated Images
In this paper, we focus on training and evaluating effective word embeddings with both text and visual information. More specifically, we introduce a large-scale dataset with 300 million sentences describing over 40 mill…
Image RetrievalSentenceWord EmbeddingsVisually Aligned Word Embeddings for Improving Zero-shot Learning
Zero-shot learning (ZSL) highly depends on a good semantic embedding to connect the seen and unseen classes. Recently, distributed word embeddings (DWE) pre-trained from large text corpus have become a popular choice to …
Semantic SimilaritySemantic Textual SimilarityWord EmbeddingsZero-Shot LearningLanguage Features Matter: Effective Language Representations for Vision-Language Tasks
Shouldn't language and vision features be treated equally in vision-language (VL) tasks? Many VL approaches treat the language component as an afterthought, using simple language models that are either built upon fixed w…
Image CaptioningLanguage ModellingPhrase GroundingQuestion Answering+6