paper-with-me

홈 › Papers

Lessons Learned from Mining the Hugging Face Repository

2024-02-11 · Joel Castaño, Silverio Martínez-Fernández, Xavier Franch

The rapidly evolving fields of Machine Learning (ML) and Artificial Intelligence have witnessed the emergence of platforms like Hugging Face (HF) as central hubs for model development and sharing. This experience report synthesizes insights from two comprehensive studies conducted on HF, focusing on carbon emissions and the evolutionary and maintenance aspects of ML models. Our objective is to provide a practical guide for future researchers embarking on mining software repository studies within the HF ecosystem to enhance the quality of these studies. We delve into the intricacies of the replication package used in our studies, highlighting the pivotal tools and methodologies that facilitated our analysis. Furthermore, we propose a nuanced stratified sampling strategy tailored for the diverse HF Hub dataset, ensuring a representative and comprehensive analytical approach. The report also introduces preliminary guidelines, transitioning from repository mining to cohort studies, to establish causality in repository mining studies, particularly within the ML model of HF context. This transition is inspired by existing frameworks and is adapted to suit the unique characteristics of the HF model ecosystem. Our report serves as a guiding framework for researchers, contributing to the responsible and sustainable advancement of ML, and fostering a deeper understanding of the broader implications of ML models.

📄 PDF Abstract BibTeX arXiv:2402.07323

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Exploring the Carbon Footprint of Hugging Face's ML Models: A Repository Mining Study

2023-05-18 · Joel Castaño, Silverio Martínez-Fernández, Xavier Franch, Justus Bogner

The rise of machine learning (ML) systems has exacerbated their carbon footprint due to increased capabilities and model sizes. However, there is scarce knowledge on how the carbon footprint of ML models is actually meas…

A Mining Software Repository Extended Cookbook: Lessons learned from a literature review

2021-10-08 · Daniel Barros, Flavio Horita, Igor Wiese, Kanan Silva

The main purpose of Mining Software Repositories (MSR) is to discover the latest enhancements and provide an insight into how to make improvements in a software project. In light of it, this paper updates the MSR finding…

Searching for Relevant Lessons Learned Using Hybrid Information Retrieval Classifiers: A Case Study in Software Engineering

2018-12-12 · Abdellatif Tamer Mohamed, Capretz Luiz Fernando

The lessons learned (LL) repository is one of the most valuable sources of knowledge for a software organization. It can provide distinctive guidance regarding previous working solutions for historical software managemen…

Information RetrievalManagementRetrieval

Lessons Learned: On the Challenges of Migrating a Research Data Repository from a Research Institution to a University Library.

2018-05-01 · LREC 2018 5 · Thorsten Trippel, Claus Zinn

Some thoughts about benchmarks for NMR

2014-05-06 · Daniel Le Berre

The NMR community would like to build a repository of benchmarks to push forward the design of systems implementing NMR as it has been the case for many other areas in AI. There are a number of lessons which can be learn…