The Fixed-Size Ordinally-Forgetting Encoding Method for Neural Network Language Models
Code (0)
등록된 구현이 없습니다.
Tasks
Information RetrievalLanguage ModellingMachine TranslationSpeech RecognitionSimilar Papers 제목 키워드 기반
A Fixed-Size Encoding Method for Variable-Length Sequences with its Application to Neural Network Language Models
In this paper, we propose the new fixed-size ordinally-forgetting encoding (FOFE) method, which can almost uniquely encode any variable-length sequence of words into a fixed-size representation. FOFE can model the word o…
Dual Fixed-Size Ordinally Forgetting Encoding (FOFE) for Competitive Neural Language Models
In this paper, we propose a new approach to employ the fixed-size ordinally-forgetting encoding (FOFE) (Zhang et al., 2015b) in neural languages modelling, called dual-FOFE. The main idea of dual-FOFE is that it allows t…
Language ModelingLanguage ModellingMachine TranslationSpeech Recognition+1Fixed-Size Ordinally Forgetting Encoding Based Word Sense Disambiguation
In this paper, we present our method of using fixed-size ordinally forgetting encoding (FOFE) to solve the word sense disambiguation (WSD) problem. FOFE enables us to encode variable-length sequence of words into a theor…
Language ModelingLanguage ModellingWord Sense DisambiguationWord Embeddings based on Fixed-Size Ordinally Forgetting Encoding
In this paper, we propose to learn word embeddings based on the recent fixed-size ordinally forgetting encoding (FOFE) method, which can almost uniquely encode any variable-length sequence into a fixed-size representatio…
Language ModelingLanguage ModellingSemantic Textual SimilarityWord Embeddings+1A Local Detection Approach for Named Entity Recognition and Mention Detection
In this paper, we study a novel approach for named entity recognition (NER) and mention detection (MD) in natural language processing. Instead of treating NER as a sequence labeling problem, we propose a new local detect…
Feature EngineeringImage Classificationnamed-entity-recognitionNamed Entity Recognition+4