paper-with-me

홈 › Papers

From LLM to Conversational Agent: A Memory Enhanced Architecture with Fine-Tuning of Large Language Models

2024-01-05 · Na Liu, Liangyu Chen, Xiaoyu Tian, Wei Zou, Kaijiang Chen, Ming Cui

This paper introduces RAISE (Reasoning and Acting through Scratchpad and Examples), an advanced architecture enhancing the integration of Large Language Models (LLMs) like GPT-4 into conversational agents. RAISE, an enhancement of the ReAct framework, incorporates a dual-component memory system, mirroring human short-term and long-term memory, to maintain context and continuity in conversations. It entails a comprehensive agent construction scenario, including phases like Conversation Selection, Scene Extraction, CoT Completion, and Scene Augmentation, leading to the LLMs Training phase. This approach appears to enhance agent controllability and adaptability in complex, multi-turn dialogues. Our preliminary evaluations in a real estate sales context suggest that RAISE has some advantages over traditional agents, indicating its potential for broader applications. This work contributes to the AI field by providing a robust framework for developing more context-aware and versatile conversational agents.

📄 PDF Abstract BibTeX arXiv:2401.02777

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Residual Connection 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

Let's Give a Voice to Conversational Agents in Virtual Reality

2023-08-04 · Michele Yin, Gabriel Roccabruna, Abhinav Azad, Giuseppe Riccardi

The dialogue experience with conversational agents can be greatly enhanced with multimodal and immersive interactions in virtual reality. In this work, we present an open-source architecture with the goal of simplifying …

Speech-to-Texttext-to-speechText to SpeechUnity

Cognis: Context-Aware Memory for Conversational AI Agents

2026-03-27 · Parshva Daftari, Khush Patel, Shreyas Kapale, Jithin George 외 arxiv

LLM agents lack persistent memory, causing conversations to reset each session and preventing personalization over time. We present Lyzr Cognis, a unified memory architecture for conversational AI agents that addresses t…

Answer Generation

AgenticAI-DialogGen: Topic-Guided Conversation Generation for Fine-Tuning and Evaluating Short- and Long-Term Memories of LLMs

2026-04-14 · Manoj Madushanka Perera, Adnan Mahmood, Kasun Eranda Wijethilake, Quan Z. Sheng arxiv

Recent advancements in Large Language Models (LLMs) have improved their ability to process extended conversational contexts, yet fine-tuning and evaluating short- and long-term memories remain difficult due to the absenc…

Knowledge Graphs

R$^3$Mem: Bridging Memory Retention and Retrieval via Reversible Compression

2025-02-21 · Xiaoqiang Wang, Suyuchen Wang, Yun Zhu, Bang Liu

Memory plays a key role in enhancing LLMs' performance when deployed to real-world applications. Existing solutions face trade-offs: explicit memory designs based on external storage require complex management and incur …

Language ModelingLanguage Modellingparameter-efficient fine-tuningRetrieval+1

Memoria: A Scalable Agentic Memory Framework for Personalized Conversational AI

2025-12-14 · Samarth Sarin, Lovepreet Singh, Bhaskarjit Sarmah, Dhagash Mehta arxiv

Agentic memory is emerging as a key enabler for large language models (LLM) to maintain continuity, personalization, and long-term context in extended user interactions, critical capabilities for deploying LLMs as truly …