The Rise of Open Science: Tracking the Evolution and Perceived Value of Data and Methods Link-Sharing Practices
In recent years, funding agencies and journals increasingly advocate for open science practices (e.g. data and method sharing) to improve the transparency, access, and reproducibility of science. However, quantifying these practices at scale has proven difficult. In this work, we leverage a large-scale dataset of 1.1M papers from arXiv that are representative of the fields of physics, math, and computer science to analyze the adoption of data and method link-sharing practices over time and their impact on article reception. To identify links to data and methods, we train a neural text classification model to automatically classify URL types based on contextual mentions in papers. We find evidence that the practice of link-sharing to methods and data is spreading as more papers include such URLs over time. Reproducibility efforts may also be spreading because the same links are being increasingly reused across papers (especially in computer science); and these links are increasingly concentrated within fewer web domains (e.g. Github) over time. Lastly, articles that share data and method links receive increased recognition in terms of citation count, with a stronger effect when the shared links are active (rather than defunct). Together, these findings demonstrate the increased spread and perceived value of data and method sharing practices in open science.
Code (1)
Tasks
ArticlesMathtext-classificationText ClassificationSimilar Papers 제목 키워드 기반
Evolutionary dynamics with random payoff matrices
Uncertainty, characterised by randomness and stochasticity, is ubiquitous in applications of evolutionary game theory across various fields, including biology, economics and social sciences. The uncertainty may arise fro…
Challenges and Trends in User Trust Discourse in AI
The Internet revolution in 1990, followed by the data-driven and information revolution, has transformed the world as we know it. Nowadays, what seam to be 10 to 20 years ago, a science fiction idea (i.e., machines domin…
MisconceptionsFacial Emotion Recognition does not detect feeling unsafe in automated driving
Trust and perceived safety play a crucial role in the public acceptance of automated vehicles. To understand perceived risk, an experiment was conducted using a driving simulator under two automated driving styles and op…
Facial Expression RecognitionFacial Emotion RecognitionData Science with Vadalog: Bridging Machine Learning and Reasoning
Following the recent successful examples of large technology companies, many modern enterprises seek to build knowledge graphs to provide a unified view of corporate knowledge and to draw deep insights using machine lear…
BIG-bench Machine LearningKnowledge GraphsLogical ReasoningManagementWhat Should Data Science Education Do with Large Language Models?
The rapid advances of large language models (LLMs), such as ChatGPT, are revolutionizing data science and statistics. These state-of-the-art tools can streamline complex processes. As a result, it reshapes the role of da…