paper-with-me

홈 › Papers

The Dynamics of Intelligence Explosions

2026-08-14 · Toby Ord arxiv

AI is increasingly being used to help with AI R&D. Under certain conditions this feedback loop might be able to produce an intelligence explosion, with rapidly escalating AI capabilities. I explore the mathematics of the most explosive possibilities, with an eye to understanding what drives the dynamics. I show that singular growth (towards a vertical asymptote) is harder to achieve than would be expected from recent economics-inspired modelling, and that there is an important but neglected class of growth rates that are faster than exponential but don't lead to a vertical asymptote. I draw out the generation time (the time to go around the feedback loop) as a neglected parameter that plays a pivotal role in determining the behaviour of any intelligence explosion --- one cannot have singular growth unless the generation time rapidly approaches zero.

📄 PDF Abstract BibTeX arXiv:2608.14426

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

The First Star-by-star $N$-body/Hydrodynamics Simulation of Our Galaxy Coupling with a Surrogate Model

2025-10-27 · Keiya Hirashima, Michiko S. Fujii, Takayuki R. Saitoh, Naoto Harada 외 arxiv

A major goal of computational astrophysics is to simulate the Milky Way Galaxy with sufficient resolution down to individual stars. However, the scaling fails due to some small-scale, short-timescale phenomena, such as s…

Preventing Gradient Explosions in Gated Recurrent Units

2017-12-01 · NeurIPS 2017 12 · Sekitoshi Kanai, Yasuhiro Fujiwara, Sotetsu Iwamura

A gated recurrent unit (GRU) is a successful recurrent neural network architecture for time-series data. The GRU is typically trained using a gradient-based method, which is subject to the exploding gradient problem in w…

Language ModelingLanguage ModellingMusic ModelingTime Series+1

Monitoring of Underwater Critical Infrastructures: the Nord Stream and Other Recent Case Studies

2023-02-03 · Giovanni Soldi, Domenico Gaglione, Simone Raponi, Nicola Forti 외

The explosions on September 26th, 2022, which damaged the gas pipelines of Nord Stream 1 and Nord Stream 2, have highlighted the need and urgency of improving the resilience of Underwater Critical Infrastructures (UCIs).…

US-China perspectives on extreme AI risks and global governance

2024-06-23 · Akash Wasil, Tim Durgin

The United States and China will play an important role in navigating safety and security challenges relating to advanced artificial intelligence. We sought to better understand how experts in each country describe safet…

Martingale property and moment explosions in signature volatility models

2025-03-21 · Eduardo Abi Jaber, Paul Gassiat, Dimitri Sotnikov

We study the martingale property and moment explosions of a signature volatility model, where the volatility process of the log-price is given by a linear form of the signature of a time-extended Brownian motion. Excludi…