Trace AI research note, v0.1 — 2026-08-03.
One job: take the three “constructive projects” from
the structure/selection thread and say, as plainly as possible, what
each one is when it is pointed at Trace AI as a product.
Companion to AGENCY_AND_SELECTION.md; both develop the
ideas the whitepaper keeps out of its body.
Intelligence, the thread claims, is not mainly predicting the next state or picking the next action. It is finding the representation in which a problem becomes at once compressible (you can throw away most of the detail) and controllable (small, legible changes to what you kept move the outcome the way you intend). Trace AI is that claim, aimed at one specific system: a mind in the middle of thinking. The self-representation is the compressible-and-controllable representation of a cognitive process. The schema says what to keep. The corpus proves the same structure survives across different substrates. The governance eval measures whether the thing you kept actually controls the outcome. Everything below is those three sentences, one per section.
Structural Intelligence Conjecture. A capable system’s core move is to find a map from a messy space to a representation such that (1) the outcome-relevant dynamics still make sense in , (2) everything irrelevant is thrown into the parts of that collapses, (3) useful interventions can be written down compactly in , and (4) those interventions keep working when you move to a new situation.
Plain version: intelligence finds the level at which the world becomes both simple to describe and easy to steer. Too much detail and you can’t act; too little and you lose control. The skill is finding the middle.
This is not new mysticism. It is what a good coordinate system does for a physics problem, what a good abstraction does for a program, what a good diagram does for a proof. The thread’s contribution is to notice it is the same move every time, and to ask whether a machine can search for that move directly.
Line up the conjecture with the whitepaper and it is the same object:
| Conjecture | Trace AI |
|---|---|
| messy space | the model’s full compute state (millions of activations) |
| representation | the self-representation — a few legible slots |
| the map | the decoder |
| “outcome-relevant dynamics survive in ” | intervening on moves the next action () |
| “irrelevant detail is collapsed” | is a bottleneck: what doesn’t fit doesn’t reach the action |
| “interventions are compact and legible” | is human-readable by constraint (whitepaper §2.1) |
| “keeps working in new situations” | the transfer criterion (AGENCY_AND_SELECTION.md §4,
criterion 6) |
So Trace AI is not inspired by the conjecture; it is the conjecture with the messy space fixed to “a mind mid-thought” and the extra demand that the representation be legible to a human, not merely small. That extra demand is the product. A tiny illegible bottleneck would satisfy the compression half and fail the point. Trace AI wants the level that is compressible, controllable, and readable.
The thread proposed three projects. Read for Trace AI, each is not a new company — it is a thing Trace AI already half-is, named clearly enough to build on purpose.
The first project imagines a machine that searches over candidate maps for the one that makes a hard problem simple. For Trace AI the search target is fixed and concrete: which slots does need? Goal, belief-about-task, belief-about-self, uncertainty, planned-next — that list is a hypothesis about which distinctions in a thinking process can be safely collapsed and which must be preserved to keep the outcome controllable.
schema/reasoning_trace.schema.json) is the current best
guess at that representation.Product consequence, simply: the moat is not the model, it is the right list of what to keep, discovered from real cognition and validated by intervention. Every trace that forces a schema change is the search taking a step. Automating that step — proposing slot changes from traces the vocabulary strains against — is the first place “representation search” becomes a tool inside the pipeline rather than a metaphor.
Where the search has provable teeth. The SIC formal
paper (SIC_MATHEMATICAL_FOUNDATIONS.md) makes
representation-search a theorem — the minimal-sufficient
partition of Halmos–Savage exists for any well-posed task (Theorem 1),
and cross-task stability holds iff the task family admits a shared
Markov screen (Theorem 4). What used to be “we discover the slots by
hand-tuning against traces” is now: the slots are the atoms of a
minimal-sufficient σ-algebra over the counterfactual task family, and
any two slot sets that both satisfy the sufficiency condition against
the same task family are equivalent up to a
-preserving
relabeling. And with the right inductive bias — statistically
independent, non-Gaussian slot components — Theorem 7 gives
polynomial-in-
recovery (classical linear ICA; Instrument 8 witnesses it).
That is the mathematical form of “we can afford more slots without
paying an exponential collection cost, if the bottleneck is engineered
for identifiability.”
The second project wants a “compiler” that takes one substrate-independent structure and instantiates it in many materials, with tests showing the same organization survives. Trace AI already has the beginnings of this, and it is the reason the data is defensible.
reaffer → re-affir → reaffirm correction chain is literally
one structure surviving three instantiations across two subject kinds —
a worked example of substrate-independent structure with the diagrams
commuting.Product consequence, simply: because the training signal is a structure, not a model’s internal format, it is not tied to any one architecture — it re-compiles onto whatever model you train next. That is what makes the corpus an asset that outlives a model generation, the same way a dataset outlives the network trained on it. The capture app, the human annotator, and an instrumented model are three compilers for the same schema; the product is the schema plus the compilers, and the corpus is the proof they agree.
The third project wants to turn “symbolic structures change the world” into a measurable science: introduce a symbolic structure (a prompt, a rule, a self-model), and measure how much it reorganizes the distribution over futures,
then separate mere influence from real control,
knowledge, and agency. This is exactly what Trace AI’s
governance eval and functional-aliveness profile already do, with
.
The self-representation is the symbolic structure;
is the measurement of
;
the six criteria in AGENCY_AND_SELECTION.md separate
influence from control from agency.
Product consequence, simply: the eval suite is not internal QA — it is a product. An alignment lab does not primarily want another model; it wants a reproducible instrument that says how much a model’s stated reasoning actually governs its actions, how well it is grounded, and whether it correctly credits its own effects. That instrument, run on their model as well as ours, is the “Symbolic Causation and Agency Benchmark” — and it is the thing that turns “faithful reasoning” from a slogan into a number a partner can put in a report.
Adopting the frame does not add a new product; it renames and sharpens what exists.
The same discipline as the whitepaper and
AGENCY_AND_SELECTION.md:
AGENCY_AND_SELECTION.md §5); the profile is an instrument
for asking it, not an answer.Trace AI finds the level at which a mind’s thinking becomes small enough to read and structured enough to steer — the schema says what to keep, the corpus proves it compiles across humans and models, and the eval measures whether what we kept actually controls the outcome.
v0.1, 2026-08-03. See AGENCY_AND_SELECTION.md for
the selection/agency development and DECISIONS.md (D23–D24)
for provenance.