paper-with-me

홈 › Papers

One Lens, Many Worlds : A Capability-Typed Interface for World-Model Interpretability

2026-06-07 · Bhavith Chandra Challagundla, Sanskar Pandey, Param Thakkar, Rishikesh Mallagundla, Yugandhar Reddy Gogireddy, Wenhao Lu, Hindol Roy Choudhury, Shravani Challagundla, Mohamed Deraz Nasr, Spursh Deshpande arxiv

World models are now built on substantially different computational substrates. Latent recurrent state-space models such as PlaNet and the Dreamer family compress observations into recurrent states; token-based models such as IRIS quantize observations into a learned codebook and predict autoregressively with a transformer; and joint-embedding predictive architectures such as I-JEPA predict in a learned latent space with no pixel decoder. The interpretability methods applied to these models, including probing, activation patching, sparse autoencoders, and surprise analysis, share a common set of primitives, yet they are re-implemented from scratch for each architecture because existing hook-and-cache tooling assumes a transformer language model with no notion of actions, environment steps, or imagined rollouts. We argue that this fragmentation reflects the tooling rather than the models, and that the shared structure of world models is captured by a small typed interface. We present WorldModelLens, an open-source interpretability substrate organized around a capability-typed adapter: every model implements four required methods (encode, transition, initial state, sample) and declares a set of optional heads (decode, reward, continue, actor, critic) through an explicit capability descriptor, so that reinforcement-learning and self-supervised world models are first-class without either imitating the other. A single hook and cache layer exposes time-indexed activations, imagination rollouts, and intervention replay over this interface, allowing each analysis to be written once.

📄 PDF Abstract BibTeX arXiv:2606.09936

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

DrawTalking: Building Interactive Worlds by Sketching and Speaking

2024-01-11 · Karl Toby Rosenberg, Rubaiat Habib Kazi, Li-Yi Wei, Haijun Xia 외

We introduce DrawTalking, an approach to building and controlling interactive worlds by sketching and speaking while telling stories. It emphasizes user control and flexibility, and gives programming-like capability with…

Identifiability of Relational Queries in Multi-View Pretraining

2026-07-06 · Ratan Bahadur Thapa, Daniel Hernández arxiv

When data sources are integrated through a shared interface, a downstream query may or may not be determined by what the interface exposes: two globally consistent worlds can agree on every shared attribute yet disagree …

Web World Models

2025-12-29 · Jichen Feng, Yifan Zhang, Chenggong Zhang, Yifu Lu 외 arxiv

Language agents increasingly require persistent worlds in which they can act, remember, and learn. Existing approaches sit at two extremes: conventional web frameworks provide reliable but fixed contexts backed by databa…

Fine-Grained Table Retrieval Through the Lens of Complex Queries

2026-03-07 · Wojciech Kosiuk, Xingyu Ji, Yeounoh Chung, Fatma Özcan 외 arxiv

Enabling question answering over tables and databases in natural language has become a key capability in the democratization of insights from tabular data sources. These systems first require retrieval of data that is re…

Open-Domain Question AnsweringTable Retrieval

BlueprintRepair: Typed Local Edits for Failed Lean Proof Blueprints

2026-07-30 · Ruslan Khrulev arxiv

LLM-based Lean proving systems increasingly organize a proof as a blueprint: a dependency graph of formal statements. We introduce BlueprintRepair, a repair interface that lets a model change this graph through ten schem…