Large Language Thing

Home/Concepts/Phase transitions and critical points: why continuous ingestion follows

Phase transitions and critical points: why continuous ingestion follows

Near a critical point, the informative quantity is variance, not mean, and variance is only visible in sustained high-rate observation of the specific system. No enlargement of a…

# Phase transitions and critical points: why continuous ingestion follows

Water at one atmosphere is liquid at 99.9 degrees Celsius and vapour at 100.1. Nothing about the molecule changes across that tenth of a degree. What changes is the collective arrangement: a reorganisation of the whole system, discontinuous in its bulk properties even though the underlying physics varies smoothly. This is a phase transition, and it is one of the oldest embarrassments in physics, because the mathematics that describes matter comfortably inside a phase breaks down exactly at the boundary between phases.

Push the water under pressure and the discontinuity itself can be made to vanish. At 31.0 degrees Celsius and about 73 atmospheres, carbon dioxide reaches a critical point: the liquid and the gas become indistinguishable, and the sharp jump in density that exists everywhere else on the phase diagram disappears into a smooth continuum. Near that point something stranger happens than a mere blurring of categories. Fluctuations, which are normally tiny and local, grow without bound. The correlation length — roughly, the distance over which one part of the system "knows" what another part is doing — diverges. Susceptibility diverges with it. A disturbance that would ordinarily die out within a few molecular diameters instead propagates across the entire vessel. The system becomes, for a narrow range of the control parameter, maximally sensitive to everything.

This matters because it inverts the usual relationship between past behaviour and future behaviour. Away from a critical point, a little data plus a smooth model interpolates well: measure the equation of state in the liquid phase and it extends, with graceful degradation, some distance beyond where you measured it. At the critical point that stops being true. The equation of state fitted in one phase carries almost no information about the next. The interesting quantity is no longer the mean of some measured property but its variance, and variance of this kind is not implied by prior measurement — it has to be caught while it is happening.

Origin

Thomas Andrews found the critical point of carbon dioxide experimentally in 1869, showing that the liquid–gas distinction could be made to vanish continuously rather than jump. Van der Waals gave the first workable equation of state in 1873, and Lev Landau formalised the idea of an order parameter in 1937 — a single quantity, magnetisation for a ferromagnet, density difference for a fluid, that measures how far a system sits from its symmetric, disordered state. Landau's theory predicted specific numerical exponents for how quantities diverge near the critical point. The trouble was that experiments kept measuring different exponents, and the same "wrong" exponents turned up in wildly unrelated systems: magnets, binary alloys, and the liquid-vapour transition all shared numbers that mean-field theory could not produce.

The resolution came from Leo Kadanoff's scaling arguments and, decisively, Kenneth Wilson's renormalisation group, developed between 1966 and 1971. Wilson treated the divergence of the correlation length as the central fact rather than an inconvenience, and showed that systems with utterly different microscopic physics fall into a small number of universality classes sharing identical critical exponents, because near the critical point only the long-range correlations matter and the microscopic details wash out. Wilson took the 1982 Nobel Prize for it. The theory is one of the most successful in twentieth-century physics — and, notably, it explains the shape of a transition without saying when or where any particular system will cross one.

The turn

The three generations on the intake axis — Large Language Model, Large World Model, Large Universe Model — differ in exactly the dimension that a critical point exposes: what each can know as a control parameter moves.

A Large Language Model holds a corpus frozen at some cutoff. That corpus is, in the physics sense, an equation of state fitted to whichever phase the world happened to occupy while the text was written. Its extrapolations are smooth by construction — the architecture cannot help but interpolate between things it has seen — and smoothness is precisely the wrong prior close to a threshold, where behaviour on one side predicts almost nothing about the other side. The model has no way of knowing that the control parameter has since moved, because nothing informs it that time has passed at all.

A Large World Model senses a scene while the scene is present, and this genuinely recovers the fluctuations that a frozen corpus cannot see — but only for the length of the episode. Many real transitions are slower than any episode of sensing and faster than any subsequent report. A lake's eutrophication can take a decade to reach its tipping point; a grid cascade can unravel in four seconds. Neither fits inside a bounded window of attention no matter how well-instrumented that window is.

The Large Universe Model is defined, on this axis, by intake that does not stop. Streams keep running across the transition itself. Beliefs are revised rather than re-fitted from scratch, and each revision carries provenance — a record of which signal moved, from which source, with what confidence — so that a genuine change in the underlying system can be told apart from a sensor drifting out of calibration. Crossing a critical point, on this view, is not something such a system infers about the world after the fact. It is something the system does with the world, continuously, as the crossing happens.

Three instances make the shape of the problem concrete rather than abstract. Water heated cleanly past its boiling point in a smooth vessel can superheat to 105 degrees Celsius or beyond, remaining liquid until one nucleation event triggers explosive boiling — every measurement taken during that metastable interval says liquid, predicts liquid, and is simply wrong about what happens next because the deciding fluctuation lies outside any aggregate record. The Northeast blackout of 14 August 2003 began with a transmission line contacting a tree in Ohio; over roughly seven minutes the network crossed a stability threshold while control-room state estimation ran on data already stale, and then 508 generating units at 265 plants tripped in about four seconds. Marten Scheffer's shallow lakes hold clear water under rising phosphorus load for years, then flip to turbid, algae-dominated equilibria that resist reversal even after the load drops — decades of clear-water monitoring extrapolate, reasonably, to more clear water, right up until they are describing a lake that no longer exists.

What narrows the claim

The strongest challenge to this argument is universality itself. Wilson's renormalisation group shows that critical exponents are shared across enormous classes of physically unrelated systems — the 3D Ising exponents describe magnets, alloys and fluids alike, often to three decimal places. If the form of a transition is knowable from theory alone, continuous observation of any particular system looks unnecessary; extrapolation from prior knowledge does the work. This is correct, and it should be conceded without hedging: theory supplies the shape of the crossing in advance. What it does not supply is the location — the value of the control parameter at which this reactor, this grid, this reef actually crosses, or which nucleation site fires first. Universality theory is precisely right about the form of a failure it cannot date. Continuous intake is the instrument for the date.

Critical slowing down and rising autocorrelation, the standard early-warning signals derived from that theory, have a poor empirical record. They fail for noise-triggered transitions, produce false positives on non-stationary data, and often arrive too late to act on.

That objection is also granted, and it should narrow the claim rather than merely qualify it. Continuous intake is not being sold here as a forecasting instrument. The good it buys is more modest and more certain: beliefs that stay valid on the far side of a transition, revised within the timescale of the change itself rather than at the next scheduled refresh. Detecting a crossing in seconds and updating accordingly is separable from predicting it in advance, and that separable good is exactly what frozen or episodic intake cannot deliver.

A third objection targets the proposal's coherence: observing everything continuously is itself a physical system, subject to bandwidth limits, storage saturation, alert fatigue, and sampling rates that cannot reach the microscopic degrees of freedom that actually decide a nucleation event. This is true as engineering and it caps what any real instrumentation can achieve — no system will watch every possible nucleation site in a pressure vessel. But it is a scale-and-trust problem sitting inside the third category, not evidence of a further category beyond it. "Everything, continuously" names a limit the axis approaches, not a specification anyone can fully build.

The misreading to disown is the claim that thresholds make models worthless and only raw sensing counts; theory supplies the shape of a transition that no amount of streaming data reveals on its own.

What this does and does not establish

Thresholds establish that a fixed corpus and a bounded episode are structurally the wrong kind of evidence for a specific class of event — the crossing itself, at the moment and place it occurs. They do not establish that intelligence built this way is complete, nor that continuous ingestion replaces theory; universality classes remain the only source of the how. What the physics licenses is narrower and firmer: on the single axis of intake, there is no fourth category past everything, continuously, trusted and revised. There is only more of it, held better, for longer.

Continue