Not words, not pictures
By now a fair number of readers are quietly objecting. Machines that seem to understand things already exist: you can talk to one today. It has read more than any human ever will, it explains, it jokes, it helps write books (I use one most days, and gladly). If that’s not understanding, it’s doing a strong impression of it. Why is this book off in a corner, fussing over spoons and rovers?
Because of where that machine’s knowledge came from, and what that means for the two promises this book actually cares about: learning forever, and learning true.
The ultimate watcher
Chapter 4 handed us the tool for this: hold any learning life up and read it as before, action, after. A language model’s training life has a familiar shape: given everything so far, guess the next word, then see the real next word and be corrected by the gap. Before, guess, after. It’s prediction-error learning, the same fuel PRA runs on, and that shared fuel is exactly why these systems got so good.
But hold the two side by side and look at the middle.
When PRA’s rover rolls forward, the world reacts. The next observation exists because of what the rover just did; poke differently and the world answers differently. That’s the middle of a real triplet: an act, with consequences that belong to you.
When a language model guesses the next word of a book, the book does not react. The next word was fixed years before, printed on the page, waiting. Guessing differently changes nothing about what arrives. The middle of its triplet isn’t an act: it’s only a guess. The model is reading humanity’s diary, billions of pages of it, and learning to finish our sentences. It is the most accomplished watcher ever built. And chapter 4 already showed the wall every watcher hits: to a watcher, “the crow causes the dawn” and “the crow merely comes first” look identical. You can’t run the rooster experiment on a library. The library can’t be surprised by you.
Under the hood: the passive loop, precisely. LLM pretraining is next-token prediction over a static corpus with teacher forcing: the model’s own outputs never influence the next input during training. There are no interventions, so the data can’t distinguish causation from correlation except where the diary’s authors happened to write the distinction down. Deployment then freezes the weights (chapter 1’s snapshot); in-context adaptation changes activations, not weights, and evaporates with the context window. Both of this book’s complaints (no interventions, no continual weight change) are structural, not a matter of scale.
Secondhand, and never pushed back on
There’s a second problem, and it’s sneakier than the first. Everything in the diary is secondhand. It’s a record of the world as people described it, including our errors, our guesses, our confident nonsense. A watcher of text learns what we tend to say, and we do not reliably say what is true.
Try a small experiment. Say, out loud: “I can jump across that creek.” Notice that nothing happens. The sentence comes out smoothly whether or not it’s true; your mouth doesn’t check. Text is like that all the way down. A wrong sentence reads as easily as a right one, and a shelf of wrong books sits as quietly as a shelf of right ones. Now actually jump. The creek checks. Cold water settles the question in a way no amount of fluent talking can undo.
That’s the difference between the two teachers. A brain learning from its own triplets gets the creek: every prediction is checked against what actually happens next, thousands of times a day. A brain learning from text gets the sentences: it’s graded on whether its next word sounds like what people tend to write. Sounding right and being right overlap a lot, which is why language models are useful. But they are different tests, and only one of them is graded by the world.
And beneath both problems sits the oldest one. Open a dictionary and look up “water”: a clear liquid. Look up “liquid”: a substance that flows. Look up “flow”… Around and around: words pointing at words, forever, unless somewhere in the loop a word touches something that once splashed you. For you, “water” exits the dictionary and lands on a memory of your own body. For a system made only of text, the loop has no exit. There’s nothing at the bottom.
Different question, different machine
None of this is a demand that language models be abolished. I said it in chapter 1 and mean it: PRA does not compete with them at language, and it would lose embarrassingly if it tried. They answer a question (“given everything humanity has written, what comes next?”) and answer it brilliantly.
PRA answers a different question: “given everything this body has lived, what happens if I do this, here, now?” Firsthand, private, grounded in consequences, and never finished. That’s why the demonstrations in this book are rovers and games instead of chat: on the axis this book cares about, the never-stop-learning axis, the talking machines don’t compete either. Two questions, two machines. This book is about the second one.
None of this makes language the enemy. A conversation fits the triplet as naturally as a motor command does. I said something, and the other person answered. That reply is a real consequence of a real act, because this time the world I poked was a person, and a person reacts. A person can be surprised by what I say, push back, correct me. A conversation partner has everything a pile of text lacks. That is the door Part 6 walks through: to this brain, a teacher is simply another world to learn from, one that talks back. Whether that door leads where I hoped is no longer a guess; the first measurements are in, they carry a twist, and they wait at the far end of the book.
That closes the case this half of the book was building. The raw material is settled: triplets, streams of them, firsthand. Now comes the machine that eats them, and it doesn’t look anything like one diligent student at a desk. It looks like a tournament, running in the dark, where the contestants are guesses about what kind of world this is and the losers are deleted. Part 3 opens the lid.