paper-with-me

Papers

Risks and Opportunities of Open-Source Generative AI

2024-05-14 · Francisco Eiras, Aleksandar Petrov, Bertie Vidgen, Christian Schroeder, Fabio Pizzati, Katherine Elkins, Supratik Mukhopadhyay, Adel Bibi, Aaron Purewal, Csaba Botos, Fabro Steibel, FAZEL KESHTKAR, Fazl Barez, Genevieve Smith, Gianluca Guadagni, Jon Chun, Jordi Cabot, Joseph Imperial, Juan Arturo Nolazco, Lori Landay, Matthew Jackson, Phillip H. S. Torr, Trevor Darrell, Yong Lee, Jakob Foerster

Applications of Generative AI (Gen AI) are expected to revolutionize a number of different areas, ranging from science & medicine to education. The potential for these seismic changes has triggered a lively debate about the potential risks of the technology, and resulted in calls for tighter regulation, in particular from some of the major tech companies who are leading in AI development. This regulation is likely to put at risk the budding field of open-source generative AI. Using a three-stage framework for Gen AI development (near, mid and long-term), we analyze the risks and opportunities of open-source generative AI models with similar capabilities to the ones currently available (near to mid-term) and with greater capabilities (long-term). We argue that, overall, the benefits of open-source Gen AI outweigh its risks. As such, we encourage the open sourcing of models, training and evaluation data, and provide a set of recommendations and best practices for managing risks associated with open-source generative AI.

📄 PDF Abstract BibTeX arXiv:2405.08597

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Near to Mid-term Risks and Opportunities of Open-Source Generative AI

2024-04-25 · Francisco Eiras, Aleksandar Petrov, Bertie Vidgen, Christian Schroeder de Witt 외

In the next few years, applications of Generative AI are expected to revolutionize a number of different areas, ranging from science & medicine to education. The potential for these seismic changes has triggered a lively…

Challenges and Opportunities of NLP for HR Applications: A Discussion Paper

2024-05-13 · Jochen L. Leidner, Mark Stevenson

Over the course of the recent decade, tremendous progress has been made in the areas of machine learning and natural language processing, which opened up vast areas of potential application use cases, including hiring an…

Management

Toward a Public and Secure Generative AI: A Comparative Analysis of Open and Closed LLMs

2025-05-15 · Jorge Machado

Generative artificial intelligence (Gen AI) systems represent a critical technology with far-reaching implications across multiple domains of society. However, their deployment entails a range of risks and challenges tha…

Analysing Safety Risks in LLMs Fine-Tuned with Pseudo-Malicious Cyber Security Data

2025-05-15 · Adel ElZemity, Budi Arief, Shujun Li

The integration of large language models (LLMs) into cyber security applications presents significant opportunities, such as enhancing threat analysis and malware detection, but can also introduce critical risks and safe…

Malware DetectionSafety Alignment

Looking Forward: Challenges and Opportunities in Agentic AI Reliability

2025-11-14 · Liudong Xing, Janet, Lin arxiv

This chapter presents perspectives for challenges and future development in building reliable AI systems, particularly, agentic AI systems. Several open research problems related to mitigating the risks of cascading fail…