paper-with-me

Papers

NoteEx: Interactive Visual Context Manipulation for LLM-Assisted Exploratory Data Analysis in Computational Notebooks

2025-11-10 · Mohammad Hasan Payandeh, Lin-Ping Yuan, Jian Zhao arxiv

Computational notebooks have become popular for Exploratory Data Analysis (EDA), augmented by LLM-based code generation and result interpretation. Effective LLM assistance hinges on selecting informative context -- the minimal set of cells whose code, data, or outputs suffice to answer a prompt. As notebooks grow long and messy, users can lose track of the mental model of their analysis. They thus fail to curate appropriate contexts for LLM tasks, causing frustration and tedious prompt engineering. We conducted a formative study (n=6) that surfaced challenges in LLM context selection and mental model maintenance. Therefore, we introduce NoteEx, a JupyterLab extension that provides a semantic visualization of the EDA workflow, allowing analysts to externalize their mental model, specify analysis dependencies, and enable interactive selection of task-relevant contexts for LLMs. A user study (n=12) against a baseline shows that NoteEx improved mental model retention and context selection, leading to more accurate and relevant LLM responses.

📄 PDF Abstract BibTeX arXiv:2511.07223

Code (0)

등록된 구현이 없습니다.

Tasks

Prompt EngineeringCode Generation

Similar Papers 제목 키워드 기반

Leveraging Post Hoc Context for Faster Learning in Bandit Settings with Applications in Robot-Assisted Feeding

2020-11-05 · Ethan K. Gordon, Sumegh Roychowdhury, Tapomayukh Bhattacharjee, Kevin Jamieson 외

Autonomous robot-assisted feeding requires the ability to acquire a wide variety of food items. However, it is impossible for such a system to be trained on all types of food in existence. Therefore, a key challenge is c…

Adaptive Robot-Assisted Feeding: An Online Learning Framework for Acquiring Previously Unseen Food Items

2019-08-19 · Ethan K. Gordon, Xiang Meng, Matt Barnes, Tapomayukh Bhattacharjee 외

A successful robot-assisted feeding system requires bite acquisition of a wide variety of food items. It must adapt to changing user food preferences under uncertain visual and physical environments. Different food items…

Streaming Drag-Oriented Interactive Video Manipulation: Drag Anything, Anytime!

2025-10-03 · Junbao Zhou, Yuan Zhou, Kesen Zhao, Qingshan Xu 외 arxiv

Achieving streaming, fine-grained control over the outputs of autoregressive video diffusion models remains challenging, making it difficult to ensure that they consistently align with user expectations. To bridge this g…

Analyzing Multimodal Interaction Strategies for LLM-Assisted Manipulation of 3D Scenes

2024-10-29 · Junlong Chen, Jens Grubert, Per Ola Kristensson

As more applications of large language models (LLMs) for 3D content for immersive environments emerge, it is crucial to study user behaviour to identify interaction patterns and potential barriers to guide the future des…

3D scene Editingmultimodal interaction

PhyEdit: Towards Real-World Object Manipulation via Physically-Grounded Image Editing

2026-04-08 · Ruihang Xu, Dewei Zhou, Xiaolong Shen, Fan Ma 외 arxiv

Achieving physically accurate object manipulation in image editing is essential for its potential applications in interactive world models. However, existing visual generative models often fail at precise spatial manipul…

Image Editing