EDAssistant: Supporting Exploratory Data Analysis in Computational Notebooks with In-Situ Code Search and Recommendation
Using computational notebooks (e.g., Jupyter Notebook), data scientists rationalize their exploratory data analysis (EDA) based on their prior experience and external knowledge such as online examples. For novices or data scientists who lack specific knowledge about the dataset or problem to investigate, effectively obtaining and understanding the external information is critical to carry out EDA. This paper presents EDAssistant, a JupyterLab extension that supports EDA with in-situ search of example notebooks and recommendation of useful APIs, powered by novel interactive visualization of search results. The code search and recommendation are enabled by state-of-the-art machine learning models, trained on a large corpus of EDA notebooks collected online. A user study is conducted to investigate both EDAssistant and data scientists' current practice (i.e., using external search engines). The results demonstrate the effectiveness and usefulness of EDAssistant, and participants appreciated its smooth and in-context support of EDA. We also report several design implications regarding code recommendation tools.
Code (0)
등록된 구현이 없습니다.
Tasks
Code SearchSimilar Papers 제목 키워드 기반
From Data to Dialogue: Leveraging the Structure of Knowledge Graphs for Conversational Exploratory Search
Exploratory search is an open-ended information retrieval process that aims at discovering knowledge about a topic or domain rather than searching for a specific answer or piece of information. Conversational interfaces …
ArticlesConversational SearchInformation RetrievalKnowledge Graphs+2StickyLand: Breaking the Linear Presentation of Computational Notebooks
How can we better organize code in computational notebooks? Notebooks have become a popular tool among data scientists, as they seamlessly weave text and code together, supporting users to rapidly iterate and document co…
Supporting Sign Languages Exploratory Linguistics with an Automatization of the Annotation Process (Vers un traitement automatique en soutien d'une linguistique exploratoire des Langues des Signes) [in French]
Enhancing Exploratory Learning through Exploratory Search with the Emergence of Large Language Models
In the information era, how learners find, evaluate, and effectively use information has become a challenging issue, especially with the added complexity of large language models (LLMs) that have further confused learner…
Information RetrievalRetrievalExplaining dimensionality reduction results using Shapley values
Dimensionality reduction (DR) techniques have been consistently supporting high-dimensional data analysis in various applications. Besides the patterns uncovered by these techniques, the interpretation of DR results base…
ClusteringDimensionality Reduction