paper-with-me

홈 › Papers

DR-BiLSTM: Dependent Reading Bidirectional LSTM for Natural Language Inference

2018-02-15 · NAACL 2018 6 · Reza Ghaeini, Sadid A. Hasan, Vivek Datla, Joey Liu, Kathy Lee, Ashequl Qadir, Yuan Ling, Aaditya Prakash, Xiaoli Z. Fern, Oladimeji Farri

We present a novel deep learning architecture to address the natural language inference (NLI) task. Existing approaches mostly rely on simple reading mechanisms for independent encoding of the premise and hypothesis. Instead, we propose a novel dependent reading bidirectional LSTM network (DR-BiLSTM) to efficiently model the relationship between a premise and a hypothesis during encoding and inference. We also introduce a sophisticated ensemble strategy to combine our proposed models, which noticeably improves final predictions. Finally, we demonstrate how the results can be improved further with an additional preprocessing step. Our evaluation shows that DR-BiLSTM obtains the best single model and ensemble model results achieving the new state-of-the-art scores on the Stanford NLI dataset.

📄 PDF Abstract BibTeX arXiv:1802.05577

Code (0)

등록된 구현이 없습니다.

Tasks

Natural Language Inference

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

Improved Sentence Modeling using Suffix Bidirectional LSTM

2018-05-18 · Siddhartha Brahma

Recurrent neural networks have become ubiquitous in computing representations of sequential data, especially textual data in natural language processing. In particular, Bidirectional LSTMs are at the heart of several neu…

ClassificationGeneral ClassificationNatural Language InferenceSentence+4

The RepEval 2017 Shared Task: Multi-Genre Natural Language Inference with Sentence Representations

2017-07-25 · WS 2017 9 · Nikita Nangia, Adina Williams, Angeliki Lazaridou, Samuel R. Bowman

This paper presents the results of the RepEval 2017 Shared Task, which evaluated neural network sentence representation learning models on the Multi-Genre Natural Language Inference corpus (MultiNLI) recently introduced …

Natural Language InferenceRepresentation LearningSentence

Phrase break prediction with bidirectional encoder representations in Japanese text-to-speech synthesis

2021-04-26 · Kosuke Futamata, Byeongseon Park, Ryuichi Yamamoto, Kentaro Tachibana

We propose a novel phrase break prediction method that combines implicit features extracted from a pre-trained large language model, a.k.a BERT, and explicit features extracted from BiLSTM with linguistic features. In co…

Language ModelingLanguage ModellingLarge Language ModelSentence+4

NCUEE at MEDIQA 2019: Medical Text Inference Using Ensemble BERT-BiLSTM-Attention Model

2019-08-01 · WS 2019 8 · Lung-Hao Lee, Yi Lu, Po-Han Chen, Po-Lei Lee 외

This study describes the model design of the NCUEE system for the MEDIQA challenge at the ACL-BioNLP 2019 workshop. We use the BERT (Bidirectional Encoder Representations from Transformers) as the word embedding method t…

Natural Language Inference

Joint User and Data Detection in Grant-Free NOMA with Attention-based BiLSTM Network

2022-09-14 · Saud Khan, Salman Durrani, Muhammad Basit Shahab, Sarah J. Johnson 외

We consider the multi-user detection (MUD) problem in uplink grant-free non-orthogonal multiple access (NOMA), where the access point has to identify the total number and correct identity of the active Internet of Things…