Cached Long Short-Term Memory Neural Networks for Document-Level Sentiment Classification
Recently, neural networks have achieved great success on sentiment classification due to their ability to alleviate feature engineering. However, one of the remaining challenges is to model long texts in document-level sentiment classification under a recurrent architecture because of the deficiency of the memory unit. To address this problem, we present a Cached Long Short-Term Memory neural networks (CLSTM) to capture the overall semantic information in long texts. CLSTM introduces a cache mechanism, which divides memory into several groups with different forgetting rates and thus enables the network to keep sentiment information better within a recurrent unit. The proposed CLSTM outperforms the state-of-the-art models on three publicly available document-level sentiment analysis datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationFeature EngineeringGeneral ClassificationSentiment AnalysisSentiment ClassificationSimilar Papers 제목 키워드 기반
End-to-End Long Document Summarization using Gradient Caching
Training transformer-based encoder-decoder models for long document summarization poses a significant challenge due to the quadratic memory consumption during training. Several approaches have been proposed to extend the…
DecoderDocument SummarizationLong-Form Narrative SummarizationD-MEM: Dopamine-Gated Agentic Memory via Reward Prediction Error Routing
Autonomous LLM agents require structured long-term memory, yet current "append-and-evolve" systems like A-MEM face O(N^2) write-latency and excessive token costs. We introduce D-MEM (Dopamine-Gated Agentic Memory), a bio…
MELODI: Exploring Memory Compression for Long Contexts
We present MELODI, a novel memory architecture designed to efficiently process long documents using short context windows. The key principle behind MELODI is to represent short-term and long-term memory as a hierarchical…
Multi-Timescale Long Short-Term Memory Neural Network for Modelling Sentences and Documents
Semantic Modelling with Long-Short-Term Memory for Information Retrieval
In this paper we address the following problem in web document and information retrieval (IR): How can we use long-term context information to gain better IR performance? Unlike common IR methods that use bag of words re…
Information RetrievalRetrieval