paper-with-me

홈 › Papers

RAM: Towards an Ever-Improving Memory System by Learning from Communications

2024-04-18 · Jiaqi Li, Xiaobo Wang, Wentao Ding, ZiHao Wang, Yipeng Kang, Zixia Jia, Zilong Zheng

We introduce an innovative RAG-based framework with an ever-improving memory. Inspired by humans'pedagogical process, RAM utilizes recursively reasoning-based retrieval and experience reflections to continually update the memory and learn from users' communicative feedback, namely communicative learning. Extensive experiments with both simulated and real users demonstrate significant improvements over traditional RAG and self-knowledge methods, particularly excelling in handling false premise and multi-hop questions. Furthermore, RAM exhibits promising adaptability to various feedback and retrieval methods, showcasing its potential for advancing AI capabilities in dynamic knowledge acquisition and lifelong learning.

📄 PDF Abstract BibTeX arXiv:2404.12045

Code (0)

등록된 구현이 없습니다.

Tasks

Lifelong learningRAGRetrieval

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
WordPiece 설명 없음
Weight Decay 설명 없음

Similar Papers 제목 키워드 기반

What If Memory Information is Stored Inside the Neuron, Instead of in the Synapse?

2021-01-24 · James Tee, Desmond P. Taylor

Memory information in the brain is commonly believed to be stored in the synapse. However, a recent groundbreaking electrophysiology research has raised the possibility that memory information may actually be stored insi…

Semantic Communication with Memory

2023-03-22 · Huiqiang Xie, Zhijin Qin, Geoffrey Ye Li

While semantic communication succeeds in efficiently transmitting due to the strong capability to extract the essential semantic information, it is still far from the intelligent or human-like communications. In this pap…

Semantic Communication

A New Frame Synchronization Algorithm for Linear Periodic Channels with Memory -- Full Version

2020-07-10 · Oren Kolaman, Ron Dabora

Identifying the start time of a sequence of symbols received at the receiver, commonly referred to as \emph{frame synchronization}, is a critical task for achieving good performance in digital communications systems empl…

Towards Intelligent Communications: Large Model Empowered Semantic Communications

2024-02-20 · Huiqiang Xie, Zhijin Qin, Xiaoming Tao, Zhu Han

Deep learning enabled semantic communications have shown great potential to significantly improve transmission efficiency and alleviate spectrum scarcity, by effectively exchanging the semantics behind the data. Recently…

modelSemantic Communication

End-to-End Autoencoder Communications with Optimized Interference Suppression

2021-12-29 · Kemal Davaslioglu, Tugba Erpek, Yalin E. Sagduyu

An end-to-end communications system based on Orthogonal Frequency Division Multiplexing (OFDM) is modeled as an autoencoder (AE) for which the transmitter (coding and modulation) and receiver (demodulation and decoding) …

DecoderGenerative Adversarial NetworkQuantization