Episode #61
State of Play: What a Takeover Would Actually Require
The Los Angeles Times asked its readers on Friday whether there is really a ten percent chance AI could kill us all. This third episode on the week of the Coxon resignation answers with the numbers that exist and the parts list that does not. Metaculus puts all-cause extinction by 2100 at 2 percent and a conditional AI-catastrophe question at 30 percent; the only large researcher survey, from 2023, has a median of 5 percent with 38 to 51 percent giving at least 10; the 25 percent figure comes from 59 self-selected x-risk professionals; Pew finds 52 percent of Americans more concerned than excited and 71 percent expecting fewer jobs. The episode puts the sceptics, the worried and the middle in their own verified words, then walks RAND's four capabilities an AI would need for extinction: cyber (real and Critical, bounded by hardened targets), survival without maintainers (replication only in controlled environments; compute in named multi-hundred-megawatt buildings), bio (uplift real, no autonomous lab exists), robotics (no evaluation exists), and deception (the one item trending the wrong way: Astra can evade chain-of-thought monitors under adversarial conditions). It reframes fast versus slow takeoff as measured takeoff, with inputs accelerating and outputs bounded by compute, evaluation, taste and power, and asks who benefits from each framing. The fantastical scenario requires three absent things at once. The realistic one is cheaper cyber incidents, ungoverned agents, and displacement. The standard the show proposes for everyone, including itself: show the step.
