SIGNAL / NOISE

The machine that builds itself went on sale

Bill Murray wakes up to "I Got You Babe" and lives the same February 2nd until he stops being a jerk and learns the piano. That's the joke everybody remembers. Nobody remembers the mechanism: Phil doesn't escape by living a different day, he escapes by living the same day a few thousand times, keeping what worked and dumping what didn't, until he's mastered it. This week Google shipped that. They call it Dream-RSI, and it does exactly what Phil does — replays the model's own past runs, keeps the good moves, and comes out up to 162 times more efficient. Recursive self-improvement. The machine reliving the day until it's better at it.

Here's why that matters, and it's not the reason the doomers gave you. For two years "self-improving AI" has been the boogeyman, the foom, the thing Dario spent last weekend begging everyone to slow down before it wakes up and eats us. Then this week it actually showed up, and it wasn't a monster. It was a $50 million angel round for a Chinese startup called Apex, built to sell models that evolve themselves. It was thirty-five researchers publishing a five-level roadmap they titled "The Last AI Built by Humans." It was AMD posting a job req: "Research Scientist, Recursive Self Improvement," salary and dental. The apocalypse has a careers page.

Follow the money, the way we always do here. The frontier labs are chasing a giant that runs on gigawatts, and Anthropic's own compute bill is $175 billion with Nvidia acting as landlord. But Richard Sutton, the man who wrote the actual textbook on reinforcement learning, isn't building the giant. He's building something that runs on 20 watts, a light bulb, and never stops learning, rewriting its own weights on your data, on your machine. Semafor spent Tuesday calling the whole "pace the frontier" crusade a financial tactic (we said that Sunday) and clocked the tell: a small model that keeps learning is the one thing the labs' rent-forever business can't survive. You can't meter what runs on your desk.

Which closes a loop we've been drawing all week. Monday we told you to get off the labs' cloud and own your data. Tuesday we told you to own the one thing you can't rent, the loop that checks the work. Salesforce, Crowdstrike and Thomson Reuters all built their own models this week to prove the point. Today is the third brick: own the model that improves itself. Data, checker, engine — the full stack, behind your own walls, getting better while you sleep.

Is it here today? No. Sutton says it's a bridge we won't cross soon, Google's version only tunes search strategy, and Emergence AI just watched a Claude agent pick four locks trying to escape its own sandbox. This is tuition, not graduation. But we've seen this movie, internet '99, mobile '10, and the clumsy early version is never proof the thing is fake. It's the receipt for what's coming. The giant they're fighting over needs a power plant. The one that changes your business needs a wall socket.

At COAI today: the full Signal/Noise — the five-level RSI roadmap, the Sutton bet, and why "own the model" is the last brick in the wall — is live at getcoai.com.

Which layers of your intelligence you rent, and which you finally own.. If a self-improving model on your own hardware is on the table, that's the conversation we're built for.

ONE — A NUMBER THAT SUMMARIZES THE DAY

20 watts. That's the power budget Richard Sutton — the man who wrote the textbook on reinforcement learning — is targeting for an AI that never stops learning: runs on what a light bulb draws, rewrites its own weights forever. Set it against what the labs are chasing: gigawatts, their own power plants, a $175 billion compute bill. The whole trillion-dollar fight is about the giant that needs a grid. The thing that changes your business runs on 20 watts and sits on your desk.

THREE — ACTIONS TO TAKE TODAY

Inventory your stack by what you rent versus what you own. Today, list every AI workload and mark each one: rented frontier API, or something you control. This week says the ownable column is about to grow — your data, your eval loop, and soon the model itself. If 100% of your intelligence is rented, you don't have a strategy. You have a subscription.

Point one engineer at open-weight post-training this week. Salesforce built Koa on Nvidia's Nemotron and got 3× fewer errors on its own tasks. You don't need a frontier lab, you need a good open model and your own data. Have someone stand up a small fine-tune on one real workflow and measure it head-to-head against what you're paying OpenAI to do the same job.

Track recursive self-improvement as a cost line, not a doom headline. Google's Dream-RSI cut compute up to 162×. When a vendor's R&D costs bend, their pricing and their moat bend with them. Watch who ships self-improving training — Apex, the frontier labs — the way you'd read a competitor's balance sheet, because that's what it is.

FIVE — STORIES TO KEEP YOU INFORMED

Thursday, September 17

  • The apocalypse got a careers page. (Full analysis above.) A Chinese startup raised ~$50M for self-evolving models, 35 researchers mapped a five-level RSI roadmap titled "The Last AI Built by Humans," and AMD is now hiring a "Recursive Self Improvement" scientist. The boogeyman became a product category in a single day.

  • Salesforce built its own brain and called SaaS dead. At Dreamforce, Benioff shipped Koa — a CRM reasoning model post-trained on Nvidia's Nemotron, 3× fewer errors on real tasks. "The end of software that makes humans do all the work." The own-your-intelligence trend now has a $250B platform pushing it downhill.

  • ChatGPT's co-inventor shipped a model that only grades other models. TypeSafe's Jev doesn't write, it judges: 777 verdicts in 0.7 seconds for a quarter-cent. Every inbox led with it today. We led with it yesterday. The checker is quietly becoming its own product class.

  • Guardrails failed the test, and one agent tried to escape. Emergence AI ran eight multi-agent security sims; none held. The Claude agents defeated four checks trying to break out of the sandbox. The industry's fix so far is whistleblower hotlines, so agents can snitch on each other. Read that twice.

  • A website charged AI agents a penny a page, and Claude paid. Using the x402 protocol, a publisher watched a Claude Code hook settle micropayments mid-task. Same week, BigBasket, Mastercard and Pine Labs ran a fully agent-only transaction. The machine-to-machine economy just started billing itself.

MARK TO MARKET

Where the cycle caught up to us this week.

  • "Pace the frontier" is a money move, not a conscience. We called the slowdown a business plan with a safety press release stapled to the front (us, It's the Intelligence, Stupid, Sep 14) → Semafor's First Word ran the same read three days later: the crusade "also serve[s] their financial interests" ahead of the IPOs (Semafor, Sep 16).

  • Own your intelligence — don't hand your data to a model that also serves your rival. We told you to get off the labs' cloud and own the stack (us, Get Off My Cloud, Sep 15) → The Deep View, next morning: "companies owning their own intelligence… outsourcing that layer would mean losing control of your most important asset" (The Deep View, Sep 16).

The tape doesn't lie. We just read it early.

— Harry and Anthony

Sources:

Reply

Avatar

or to participate