paper-with-me

홈 › Papers

Learning Generic Sentence Representations Using Convolutional Neural Networks

2016-11-23 · EMNLP 2017 9 · Zhe Gan, Yunchen Pu, Ricardo Henao, Chunyuan Li, Xiaodong He, Lawrence Carin

We propose a new encoder-decoder approach to learn distributed sentence representations that are applicable to multiple purposes. The model is learned by using a convolutional neural network as an encoder to map an input sentence into a continuous vector, and using a long short-term memory recurrent neural network as a decoder. Several tasks are considered, including sentence reconstruction and future sentence prediction. Further, a hierarchical encoder-decoder model is proposed to encode a sentence to predict multiple future sentences. By training our models on a large collection of novels, we obtain a highly generic convolutional sentence encoder that performs well in practice. Experimental results on several benchmark datasets, and across a broad range of applications, demonstrate the superiority of the proposed model over competing methods.

📄 PDF Abstract BibTeX arXiv:1611.07897

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderSentence

Similar Papers 제목 키워드 기반

Modelling the Combination of Generic and Target Domain Embeddings in a Convolutional Neural Network for Sentence Classification

2016-08-01 · WS 2016 8 · Nut Limsopatham, Nigel Collier
ChunkingGeneral ClassificationNamed Entity Recognition (NER)Part-Of-Speech Tagging+4

Learning Compressed Sentence Representations for On-Device Text Processing

2019-06-19 · ACL 2019 7 · Dinghan Shen, Pengyu Cheng, Dhanasekar Sundararaman, Xinyuan Zhang 외

Vector representations of sentences, trained on massive text corpora, are widely used as generic sentence embeddings across a variety of NLP problems. The learned representations are generally assumed to be continuous an…

RetrievalSentenceSentence Embeddings

Skip-Thought Vectors

2015-06-22 · NeurIPS 2015 12 · Ryan Kiros, Yukun Zhu, Ruslan Salakhutdinov, Richard S. Zemel 외

We describe an approach for unsupervised learning of a generic, distributed sentence encoder. Using the continuity of text from books, we train an encoder-decoder model that tries to reconstruct the surrounding sentences…

DecoderSentence

InferLite: Simple Universal Sentence Representations from Natural Language Inference Data

2018-10-01 · EMNLP 2018 10 · Jamie Kiros, William Chan

Natural language inference has been shown to be an effective supervised task for learning generic sentence embeddings. In order to better understand the components that lead to effective representations, we propose a lig…

GPUNatural Language InferencePositionSentence+2

Exploiting Word Internal Structures for Generic Chinese Sentence Representation

2017-09-01 · EMNLP 2017 9 · Shaonan Wang, Jiajun Zhang, Cheng-qing Zong

We introduce a novel mixed characterword architecture to improve Chinese sentence representations, by utilizing rich semantic information of word internal structures. Our architecture uses two key strategies. The first i…

SentenceSentence Similarity