Large Language Thing

Home/Concepts/Free energy and dissipative structures: why continuous ingestion follows

Free energy and dissipative structures: why continuous ingestion follows

On the intake axis there is no fourth class because there is no fourth thermodynamic regime. A structure is either paid for once and frozen, sustained only while a particular flux…

The concept, on its own terms

Thermodynamics separates two quantities that everyday language treats as one. Total energy is conserved; that is the first law, and it never budges. But not all of that energy is available to do anything. The portion that can be extracted as useful work, at a given temperature and pressure, is free energy. The rest is locked as entropy, unavailable, already spent in the currency that matters for producing change. A hot cup of coffee holds the same total energy whether it is doing something or not. Its free energy — its capacity to drive a process — leaks away as it equilibrates with the room, and once it reaches room temperature that capacity is gone even though the joules are, in a sense, still there.

The second law says entropy in an isolated system never decreases. For a long time this was read as a ban on order: everything tends to sameness, structure is a temporary accident on the way to heat death. But the second law governs isolated systems, and almost nothing interesting is isolated. A system held open to a steady flow of free energy — heated from below, fed a chemical gradient, supplied with sunlight — can organise itself into sustained, ordered patterns precisely because it is exporting entropy to its surroundings faster than it generates it internally. The order is real. It is also not free, in either sense of the word. It has to be paid for, continuously, by the flux that maintains it.

Heat a shallow layer of fluid from below. Below a critical threshold — a Rayleigh number near 1708 — nothing happens beyond quiet conduction. Cross it, and the fluid organises itself within seconds into a lattice of hexagonal convection cells, each one a small heat engine lifting warm fluid and dropping cold fluid in a fixed rotation. The pattern holds indefinitely, as long as the heating continues. Turn the burner off and the cells do not fade gradually. They stop, almost at once, leaving no residue of themselves in the fluid. The order was never a property of the liquid. It was a property of the gradient, made visible while the gradient lasted.

Origin: an old problem, an accounting answer

The question behind this is old: if the universe runs downhill towards disorder, why does it produce so much order along the way — crystals, flames, weather systems, cells, forests? Lars Onsager's 1931 work on reciprocal relations in irreversible processes gave the first rigorous handle on systems away from equilibrium. Erwin Schrödinger, lecturing in Dublin in 1944, sharpened the biological version of the question: how does an organism resist the slide into equilibrium that thermodynamics seems to demand of it? His answer, loosely put, was that living things feed on "negative entropy" drawn from their surroundings.

Ilya Prigogine, working in Brussels from the 1940s onward, turned this into a formal theory. Systems driven far enough from equilibrium by a continuous input of free energy can settle into stable, ordered configurations that he named dissipative structures. Convection cells, chemical oscillators such as the Belousov–Zhabotinsky reaction, flames, hurricanes, living cells — all instances of the same accounting principle. They import free energy, degrade it in the course of maintaining their pattern, and export the resulting entropy outward. Order is not exempted from the second law. It is financed by it, at the price of accelerating the law's operation in the environment around the structure. Prigogine received the 1977 Nobel Prize in Chemistry for the work. Nothing about it overturns the second law. It explains, with a ledger, why the law is compatible with everything interesting that ever happens.

The signature of a dissipative structure, and the point worth holding onto before any turn towards computation, is that its persistence is an activity rather than a state. A crystal, once formed, sits there; you could put it in a drawer for a century and take it out unchanged. A convection cell, a flame, a hurricane, a human body sits nowhere. Cut the flux and it does not decay slowly towards its earlier form. It stops being what it was, on the spot, because what it was is the process of maintaining itself against continuous decay.

The turn

The lineage from Large Language Model to Large World Model to Large Universe Model is usually described along an axis of intake — how much of the world a system takes in, and how continuously. Read thermodynamically, the same axis describes something narrower and more exact: how the system's internal order is paid for.

A Large Language Model is trained once, on a corpus fixed at a moment, and then frozen. Querying it costs energy — running inference on large parameter counts is not free, and treating the electricity bill as irrelevant would be a mistake worth returning to. But the internal order of the model, its weights, its represented structure, does not change with use. It is order imposed once and then held constant, regardless of what happens in the world afterward. In the vocabulary above, it is a crystal: expensive to make, cheap to keep, and correct only about the moment it was made.

A Large World Model is closer to the convection cell. It is coherent while a scene is present to it — sensors returning a live feed, a bounded environment being actively perceived — and that coherence is real, not illusory, for as long as the flux of observation continues. But there is no mechanism carrying that structure across a gap. Turn the sensor away, and the represented world does not persist in diminished form. It has nothing to persist as. Like the cell that vanishes when the burner is switched off, the pattern belonged to the flux, not to any substrate that kept it independently.

A Large Universe Model is the argued case of something further along the same axis: a structure proposed to hold a genuine non-equilibrium steady state. Streams arrive continuously rather than once. Beliefs are actively maintained against decay by that continuous arrival, which is the import half of the ledger. And — the half that gets forgotten in most accounts of "more data, more often" — stale and contradicted belief has to be exported, through retraction, contradiction detection, and provenance tracking, or the structure accumulates informational entropy until it collapses under its own noise. Prigogine's insight was that order requires both halves of the transaction. A structure that only imports is not sustaining a pattern; it is silting up.

Why this is the top rung, not merely a further rung

On this axis there is no fourth position, because there is no fourth thermodynamic regime for a maintained structure to occupy. It is either paid for once and frozen, sustained only while a specific flux is present, or sustained by continuous flux with no stopping point. Those three exhaust the logical space, in the same way that a system is either isolated, closed to matter but open to energy, or fully open. The third regime here — continuous intake, continuous export, no gap — is terminal not because it is the largest but because "every stream, running, without a stopping point" has no successor category of evidence. You cannot observe more often than always. You cannot draw from more places than everywhere available. What is left past that point is quantitative, not categorical: more channels feeding the same steady state, faster entropy export, longer mean time between corrupted beliefs, cheaper dissipation per revision. Scale, trust, and time. A Bénard cell does not graduate into a new kind of pattern by convecting harder; it just convects, at whatever intensity the gradient supports.

The misreading to disown

The tempting reading of all this is that nature is driven towards complexity — that dissipative structures are evidence of a cosmic tendency, that systems evolve to dissipate gradients ever faster, and that something like continuous, self-maintaining intelligence is therefore thermodynamically destined to arise. Maximum entropy production has been proposed as a general principle along these lines. It is a suggestive heuristic at best, contradicted by enough counter-cases that it cannot bear the weight of an inevitability argument, and nothing here should be read as endorsing it. A second, more technical confusion conflates thermodynamic free energy with the variational free energy of predictive-processing accounts of cognition; the mathematics is structurally similar, which is precisely why the two get merged, but the quantities are not the same thing and the argument made here does not depend on that equivalence. What is being claimed is a constraint, not a drive. Order maintained against decay has to be paid for continuously, or it stops being maintained. Nothing says the payment must be made, or that anything is destined to make it.

The objections that hold

The strongest objection is that the framing risks being decorative: a data centre running inference on a frozen model burns real power, so calling that model a crystal seems to ignore the joules. The reply has to be precise rather than defensive. The relevant flux for the crystal claim is not electrical, it is informational — the availability of new observations that could still revise the model's internal state. A frozen model dissipates power on every query and imports none of that availability regardless. A second objection, and this one should be conceded without qualification, is that dissipative structures are cognitively empty. A convection cell has no memory and no error correction; it reforms identically from the same boundary conditions and represents nothing. Borrowing its persistence licenses nothing about provenance or revisable belief, which are epistemic properties thermodynamics has nothing to say about. The physics establishes only that maintenance needs both import and export. What goes on the export side — what counts as a stale belief, what counts as a contradiction worth resolving — is not a thermodynamic question at all.

A third objection narrows the claim usefully: continuous dissipative maintenance is expensive and has no reserve. A frozen corpus survives a power cut, an audit, a decade in storage. A non-equilibrium steady state dies the instant its flux falters, and lives systems answer this by spending enormous resources on redundancy — a resting adult turns over close to a body-mass's worth of ATP daily just holding ion gradients against thermal noise, none of it growth. This does not overturn the ranking on the intake axis. It is a separate argument about cost, and it is correct: fragility is the price of the third regime, and a frozen instrument remains the right tool for a fixed question about a fixed past.

What the concept establishes, and what it does not

It establishes that maintained order comes in exactly three payment structures, and that continuous, gapless intake with continuous export is the last of them — not the biggest instance, the last kind. It explains why the Large Universe Model position cannot be superseded on this particular axis while remaining silent on almost everything else that matters: whether such a structure can be built at any workable cost, whether its epistemics are sound, whether its export half can be trusted to discard the right things. !note Thermodynamics tells you the ledger needs two sides; it never tells you what to write on either one.

Continue