Episode #30
Will AI kill us all?
Both Kieron and Neil have been gallivanting round the country all week, both are recording on a Friday afternoon with the pub in sight, and Neil has already had a text from a mate asking where he is. Housing Community Summit β a full room, and one uncomfortable answer Kieron was back in Liverpool, this time speaking solo to a breakout session of CEOs and chairs. The stats he opened with tell the whole story of AI in housing right now: 76% of housing staff say they use AI. 69% of the public don't know AI is being used in public services at all, and don't trust it. 87% rate their own AI skills as low. And 44% of organisations still have no AI policy. Enormous usage, by people who'll openly tell you they don't know much about it, with nothing written down about what they should or shouldn't be doing. Then he asked the room how they know they can trust their AI's responses. The headline answer: we don't know. So he sent them five questions to take back to their teams: Which documents does it read, and who keeps those current? Can it show its sources, so an answer can be checked rather than just trusted? Who built it, who signed it off, and who reviews it? What happens when a policy changes β does the agent change with it? Would you be comfortable if this answer reached a resident, the regulator, or the ombudsman? If you can't answer those, you've got work to do. The complaint that came back from its own reply Neil was chatting to a friend (in a bar, obvs) who lives in a housing association property. He'd put in a complaint last week, ten pages, written with the help of AI. He got a response but couldn't tell whether it was AI or not. That's good because the housing association is a Leading AI customer so there's a reasonable chance KnowledgeFlow wrote the reply. Complaints in housing are up 90%, and one report this week says they've doubled since ChatGPT. The genuinely good side: people who'd struggle to write a compelling complaint can now represent themselves properly. The difficult side for housing thought is there's no change to statutory response times so they're having to deal with twice the volume and ten times the size. "Which bit of stupid is that?" A customer emailed Neil to explain they'd been busy so hadn't moved their AI adoption on, but mentioned in passing that one of the team had put a load of confidential information into a public AI tool to produce a three-page report which they thought was "great". This is an organisation that has a private, secure AI assistant built specifically so that wouldn't happen. Dumb. The formatting was lovely, apparently. Are we all going to die? A 10% chance, apparently Kieron got asked about the Anthropic researcher's resignation on a webinar with the Moving On Up team and gave the honest answer "You're about as qualified to assess that number as I am." The more useful point came from a Radio 4 interview which said you can't buy a sandwich, board a plane, or ride in a lift without a regulatory framework, and yet you can build superintelligence, and the only real constraint is investment. The companies themselves are asking to be regulated. Nobody's going to stop first in a trillion-dollar race. A Singaporean government minister running his life on a $15 Raspberry Pi He uses a Raspberry PI with 8GB of RAM, a small local model, and it manages his schedule, drafts his speeches, and briefs him before visits. Which raises the trillion-dollar question: if that's all most people actually need, has everybody placed their bets in the wrong place? Meanwhile Nvidia posted $96.2 billion of revenue in a single quarter, up 106% year on year. And Kieron's mum is currently a data centre protester in Devon, banners up outside the house and everything. Watermarking, properly explained Donald got under the skin of how Claude's watermarking actually works. It isn't a label, it's a pattern woven through the way tokens are assembled, detectable if you hold the right key. Very clever, but easy to bypass by pasting the text into a different model and asking it to rewrite while retaining everything. So much for the end of the AI detector industry. Also: Daniel Susskind's book on teaching in an era of AI. PISA scores have fallen and haven't recovered post-pandemic, and his answer is to train children both with AI and without it so they understand the difference. Kieron tells the story of the 1890s New York horse manure crisis (he so full of **** ). And the discovery that China's clampdown on AI companions applies only to Chinese citizens. Their companies are free to sell AI boyfriends and girlfriends abroad, though Neil doesn't think Mrs Watkins will allow him to have one and Kieron's worried about spending too much time on a screen without that kind of distraction. It's been one of those weeks... Two mates. A bar. Thirty years of business between them. And all they want to talk about is AI. Pull up a stool β we'll get the beers in.