paper-with-me

홈 › Papers

Eliciting Best Practices for Collaboration with Computational Notebooks

2022-02-15 · Luigi Quaranta, Fabio Calefato, Filippo Lanubile

Despite the widespread adoption of computational notebooks, little is known about best practices for their usage in collaborative contexts. In this paper, we fill this gap by eliciting a catalog of best practices for collaborative data science with computational notebooks. With this aim, we first look for best practices through a multivocal literature review. Then, we conduct interviews with professional data scientists to assess their awareness of these best practices. Finally, we assess the adoption of best practices through the analysis of 1,380 Jupyter notebooks retrieved from the Kaggle platform. Findings reveal that experts are mostly aware of the best practices and tend to adopt them in their daily work. Nonetheless, they do not consistently follow all the recommendations as, depending on specific contexts, some are deemed unfeasible or counterproductive due to the lack of proper tool support. As such, we envision the design of notebook solutions that allow data scientists not to have to prioritize exploration and rapid prototyping over writing code of quality.

📄 PDF Abstract BibTeX arXiv:2202.07233

Code (1)

collab-uniba/pynblint

Methods 이 논문이 사용한 방법론

AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…

Similar Papers 제목 키워드 기반

Assessing the Quality of Computational Notebooks for a Frictionless Transition from Exploration to Production

2022-05-24 · Luigi Quaranta

The massive trend of integrating data-driven AI capabilities into traditional software systems is rising new intriguing challenges. One of such challenges is achieving a smooth transition from the explorative phase of Ma…

Pynblint: a Static Analyzer for Python Jupyter Notebooks

2022-05-24 · Luigi Quaranta, Fabio Calefato, Filippo Lanubile

Jupyter Notebook is the tool of choice of many data scientists in the early stages of ML workflows. The notebook format, however, has been criticized for inducing bad programming practices; indeed, researchers have alrea…

Debug Smarter, Not Harder: AI Agents for Error Resolution in Computational Notebooks

2024-10-18 · Konstantin Grotov, Artem Borzilov, Maksim Krivobok, Timofey Bryksin 외

Computational notebooks became indispensable tools for research-related development, offering unprecedented interactivity and flexibility in the development process. However, these benefits come at the cost of reproducib…

AI AgentBug fixing

CORAL: COde RepresentAtion Learning with Weakly-Supervised Transformers for Analyzing Data Analysis

2020-08-28 · Ge Zhang, Mike A. Merrill, Yang Liu, Jeffrey Heer 외

Large scale analysis of source code, and in particular scientific source code, holds the promise of better understanding the data science process, identifying analytical best practices, and providing insights to the buil…

ArticlesDescriptiveRepresentation Learning

Similarity Search on Computational Notebooks

2022-01-30 · Misato Horiuchi, Yuya Sasaki, Chuan Xiao, Makoto Onizuka

Computational notebook software such as Jupyter Notebook is popular for data science tasks. Numerous computational notebooks are available on the Web and reusable; however, searching for computational notebooks manually …