paper-with-me

Papers

WorldString: Actionable World Representation

2026-05-18 · Kunqi Xu, Jitao Li, Jianglong Ye, Tianshu Tang, Isabella Liu, Sifei Liu, Xueyan Zou arxiv

Inspired by the emergent behaviors in large language models that generalized human intelligence, the research community is pursuing similar emergent capabilities within world models, with a emphasis on modeling the physical world. Within the scope of physical world model, objects are the fundamental primitives that constitute physical reality. From humans to computers, nearly everything we interact with is an object. These objects are rarely static; they are actionable entities with varying states determined by their intrinsic properties. While current methods approach object action states either via video generation or dynamic scene reconstruction, none explicitly model this basic element in a unified, principled way to build an actionable object representation. We propose WorldString, a neural architecture capable of modeling the state manifold of real-world objects by learning directly from point clouds or RGB-D video streams. Serving as a versatile digital twin, it acts as a foundational building block for physical world models; thus, we name it WorldString. Sweetly, its fully differentiable structure seamlessly enables future integration with policy learning and neural dynamics.

📄 PDF Abstract BibTeX arXiv:2605.18743

Code (0)

등록된 구현이 없습니다.

Tasks

Video GenerationPoint Clouds

Similar Papers 제목 키워드 기반

Actionable Neural Representations: Grid Cells from Minimal Constraints

2022-09-30 · William Dorrell, Peter E. Latham, Timothy E. J. Behrens, James C. R. Whittington

To afford flexible behaviour, the brain must build internal representations that mirror the structure of variables in the external world. For example, 2D space obeys rules: the same set of actions combine in the same way…

Navigate

Towards Problem Solving Agents that Communicate and Learn

2017-08-01 · WS 2017 8 · Anjali Narayan-Chen, Colin Graber, Mayukh Das, Md. Rakibul Islam 외

Agents that communicate back and forth with humans to help them execute non-linguistic tasks are a long sought goal of AI. These agents need to translate between utterances and actionable meaning representations that can…

Semantic Parsing

Learning Actionable Representations from Visual Observations

2018-08-02 · Debidatta Dwibedi, Jonathan Tompson, Corey Lynch, Pierre Sermanet

In this work we explore a new approach for robots to teach themselves about the world simply by observing it. In particular we investigate the effectiveness of learning task-agnostic representations for continuous contro…

continuous-controlContinuous ControlReinforcement Learning

An Actionable Diagnosis of Multilingual, Multi-Agent Planning Failures

2026-08-04 · Vikas Pahuja, Jonathan Brokman, Omer Hofman, Tamir Nizri 외 arxiv

Multilingual multi-agent systems exhibit substantial degradation beyond English, yet prior work rarely identifies how task-critical information is lost when user requests are converted into executable plans. We study the…

J-LAW: Joint Localization and Actionable World Modeling via Coupled Latent Factor Graphs

2026-06-27 · Guanqun Cao, Liang Chen arxiv

Classical SLAM estimates metric poses and a geometric map but produces no actionable predictive model for planning. Action-conditioned world models learn compact latent dynamics for planning but ignore global metric cons…