paper-with-me

Papers

Interactive and Expressive Code-Augmented Planning with Large Language Models

2024-11-21 · Anthony Z. Liu, Xinhe Wang, Jacob Sansom, Yao Fu, Jongwook Choi, Sungryull Sohn, Jaekyeom Kim, Honglak Lee

Large Language Models (LLMs) demonstrate strong abilities in common-sense reasoning and interactive decision-making, but often struggle with complex, long-horizon planning tasks. Recent techniques have sought to structure LLM outputs using control flow and other code-adjacent techniques to improve planning performance. These techniques include using variables (to track important information) and functions (to divide complex tasks into smaller re-usable sub-tasks). However, purely code-based approaches can be error-prone and insufficient for handling ambiguous or unstructured data. To address these challenges, we propose REPL-Plan, an LLM planning approach that is fully code-expressive (it can utilize all the benefits of code) while also being dynamic (it can flexibly adapt from errors and use the LLM for fuzzy situations). In REPL-Plan, an LLM solves tasks by interacting with a Read-Eval-Print Loop (REPL), which iteratively executes and evaluates code, similar to language shells or interactive code notebooks, allowing the model to flexibly correct errors and handle tasks dynamically. We demonstrate that REPL-Plan achieves strong results across various planning domains compared to previous methods.

📄 PDF Abstract BibTeX arXiv:2411.13826

Code (0)

등록된 구현이 없습니다.

Tasks

Common Sense ReasoningDecision Making

Similar Papers 제목 키워드 기반

Thought-Augmented Planning for LLM-Powered Interactive Recommender Agent

2025-06-30 · Haocheng Yu, Yaxiong Wu, Hao Wang, Wei Guo 외

Interactive recommendation is a typical information-seeking task that allows users to interactively express their needs through natural language and obtain personalized recommendations. Large language model-powered (LLM-…

Interactive RecommendationLarge Language ModelRecommendation SystemsUser Simulation

Actionet: An Interactive End-To-End Platform For Task-Based Data Collection And Augmentation In 3D Environment

2020-10-03 · Jiafei Duan, Samson Yu, Hui Li Tan, Cheston Tan

The problem of task planning for artificial agents remains largely unsolved. While there has been increasing interest in data-driven approaches for the study of task planning for artificial agents, a significant remainin…

Dataset GenerationTask Planning

RealityTalk: Real-Time Speech-Driven Augmented Presentation for AR Live Storytelling

2022-08-12 · Jian Liao, Adnan Karim, Shivesh Jadon, Rubaiat Habib Kazi 외

We present RealityTalk, a system that augments real-time live presentations with speech-driven interactive virtual elements. Augmented presentations leverage embedded visuals and animation for engaging and expressive sto…

Video Editing

SentiAvatar: Towards Expressive and Interactive Digital Humans

2026-04-03 · Chuhao Jin, Rui Zhang, Qingzhe Gao, Haoyu Shi 외 arxiv

We present SentiAvatar, a framework for building expressive interactive 3D digital humans, and use it to create SuSu, a virtual character that speaks, gestures, and emotes in real time. Achieving such a system remains ch…

SIMS: Simulating Stylized Human-Scene Interactions with Retrieval-Augmented Script Generation

2024-11-29 · Wenjia Wang, Liang Pan, Zhiyang Dou, Jidong Mei 외

Simulating stylized human-scene interactions (HSI) in physical environments is a challenging yet fascinating task. Prior works emphasize long-term execution but fall short in achieving both diverse style and physical pla…

Motion PlanningRAGRetrievalRetrieval-augmented Generation+2