paper-with-me

홈 › Papers

Contemporary AI foundation models increase biological weapons risk

2025-06-12 · Roger Brent, T. Greg McKelvey Jr

The rapid advancement of artificial intelligence has raised concerns about its potential to facilitate biological weapons development. We argue existing safety assessments of contemporary foundation AI models underestimate this risk, largely due to flawed assumptions and inadequate evaluation methods. First, assessments mistakenly assume biological weapons development requires tacit knowledge, or skills gained through hands-on experience that cannot be easily verbalized. Second, they rely on imperfect benchmarks that overlook how AI can uplift both nonexperts and already-skilled individuals. To challenge the tacit knowledge assumption, we examine cases where individuals without formal expertise, including a 2011 Norwegian ultranationalist who synthesized explosives, successfully carried out complex technical tasks. We also review efforts to document pathogen construction processes, highlighting how such tasks can be conveyed in text. We identify "elements of success" for biological weapons development that large language models can describe in words, including steps such as acquiring materials and performing technical procedures. Applying this framework, we find that advanced AI models Llama 3.1 405B, ChatGPT-4o, and Claude 3.5 Sonnet can accurately guide users through the recovery of live poliovirus from commercially obtained synthetic DNA, challenging recent claims that current models pose minimal biosecurity risk. We advocate for improved benchmarks, while acknowledging the window for meaningful implementation may have already closed.

📄 PDF Abstract BibTeX arXiv:2506.13798

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

LLaMA LLaMA is a collection of foundation language models ranging from 7B to 65B parameters. It is based on the transformer architecture with various improvements that were…

Similar Papers 제목 키워드 기반

The implicated scientist: on the role of AI researchers in the development of weapons systems

2026-04-20 · Alexandra Volokhova, Alex Hernandez-Garcia arxiv

Artificial intelligence (AI) technologies are increasingly used in modern weapons systems. Notably, these systems have recently been involved in mass killings and destruction at scale. Furthermore, there is currently a s…

Is open robotics innovation a threat to international peace and security?

2026-01-15 · Ludovic Righetti, Vincent Boulanin arxiv

Open access to publication, software and hardware is central to robotics: it lowers barriers to entry, supports reproducible science and accelerates reliable system development. However, openness also exacerbates the inh…

Decoding the Black Box: Integrating Moral Imagination with Technical AI Governance

2025-03-09 · Krti Tallam

This paper examines the intricate interplay among AI safety, security, and governance by integrating technical systems engineering with principles of moral imagination and ethical philosophy. Drawing on foundational insi…

EthicsMathPhilosophy

On the Societal Impact of Open Foundation Models

2024-02-27 · Sayash Kapoor, Rishi Bommasani, Kevin Klyman, Shayne Longpre 외

Foundation models are powerful technologies: how they are released publicly directly shapes their societal impact. In this position paper, we focus on open foundation models, defined here as those with broadly available …

Decision Making

Intolerable Risk Threshold Recommendations for Artificial Intelligence

2025-03-04 · Deepika Raman, Nada Madkour, Evan R. Murphy, Krystal Jackson 외

Frontier AI models -- highly capable foundation models at the cutting edge of AI development -- may pose severe risks to public safety, human rights, economic stability, and societal value in the coming years. These risk…