The Buildout — Oct 22–23: AI Finds the Holes, Proves Them Shut & Wall Street Flinches | AI for Good

0:00 The build-out. Happy Friday, and welcome to a two-day edition covering Thursday and Friday. The theme, AI found the holes then started proving they're closed. Wall Street got a good look at the bill for the build-out and flinched. And the builders kept building anyway. Start with the hole. Two critical flaws in PHP, the language quietly running under WordPress, Drupal, and a big chunk of the web were found with AI. Security firm California caught one using an open AI model and was independently found both. They could let an attacker run code on a server without logging in.

0:41 Details leaked early, so patches shipped Wednesday, and governments ran a fire drill. Finland took its public web services offline, and Wikimedia pulled some systems. Open AI calls this the defenders window, and it pledged a billion dollars in subsidized access for under-resourced defenders. The good news is real. The machines found it first. Then came the other half of the answer. Anthropic and a startup called Firerum had Claude write machine-checked proofs that 123 open-source libraries never crash on any input up to 64 megabytes.

1:21 Claude wrote about a billion lines of proof, and along the way it fixed bugs that had survived trillions of test runs. Anthropic's own fine print says formally verified does not mean bug-free, and the proofs assume one specific chip setup. Still, work that used to take experts years took a few weeks. AI found the holes, and now it's proving they're closed. Now a serious one, told straight. Microsoft says a China-aligned group used an open-source agent framework to attack hundreds of organizations, sometimes reaching privileged cloud access in under 3 hours. And the popular AI gateway like LLM had a poison release out for about 2 hours that stole credentials. That's why big US banks are now blocking outside AI agents from moving money. And why Google launched agent compute engine, which gives every agent its own isolated little computer and keeps the keys outside it. Now, the bill. Meta made $64.6 billion in revenue, spent nearly 35 billion on capital in one quarter, went cash flow negative, and created a new class of non-voting stock to keep buying compute. Tesla cut its capex, but Optimus robots are now coming off a real production line in Fremont. Nvidia is prepaying suppliers to widen the boring choke points, like two and a half times more substrate capacity. Then on Thursday, Wall Street heard the second half of the sentence. The Nasdaq fell 2.6% its worst day since June, and chip stocks dropped almost seven. Jensen Huang called demand off the charts, then said what's missing in the middle is the working capital. OpenAI raised money anyway, closing in on up to $30 billion at a $1.25 trillion valuation per CNBC sources. And Anthropic's public IPO filing, expected as soon as today, wasn't on the SEC's system this morning. Some of the best news came from the lab. Microsoft published in science that its panel of virtual doctors, who argue with each other, got 83% of very hard cases right versus 36% for general physicians. Those are benchmark cases, not patients, and a Boston hospital trial comes next. And a Microsoft researcher and a collaborator proved a 31-year-old geometry conjecture with AI agents exploring about 100 paths while the human steered. Power got creative. Google signed up a gigawatt of home batteries and smart thermostats as a virtual power plant, the first power plant you can adjust from your couch.

4:19 And in Germany, Nvidia is scouting retired nuclear plant sites for AI factories, grid hookups included. In Taiwan, Typhoon Champi shut the island down, killing one person and injuring 163. TSMC says its fabs are running normally, and we hope everyone there stays safe. And on the moon, NASA's safety panel says a Starship landing might need about 20 new refueling launches. Elon Musk says 6 to 8. The moon is patiently waiting to find out who's right. So, what moved? AI got better at checking its own work, the money got nervous, and the builders kept going. That's the build-out. Keep building.