Hidden StructureResearch Group

The idea, step by step

Plain language first, then the mathematics

This page builds the central idea from nothing. Each step says it in words, then shows the formula behind it. You can skip every formula and still follow the story.

STEP 1Patterns come in sizes

Picture m switches, each on or off. A situation is one setting of all of them. Some patterns involve one switch ("switch 3 is usually on"). Some involve a pair ("switches 2 and 5 tend to agree"). Some involve three, or four, or all of them at once.

A classical result from mathematics, the Walsh or Fourier decomposition, says that any way of assigning chances to the situations splits exactly into pieces of these sizes, one piece for every group of switches. With m switches there are 2m groups, so 2m pieces, and together they rebuild the whole thing perfectly.

p(x)=2−m∑S⊆{1,…,m}p^(S)χS(x),χS(x)=(−1)∑i∈SxiEach group of switches S gets one number, its coefficient. The size of S is the size of the pattern.

STEP 2An observer is a filter

An observer that can compare at most t things at a time sees every pattern of size t or less, exactly, and nothing larger.

This is what depth means here. A depth-two observer can measure every single switch and every pair. It cannot measure any triple. The larger patterns are not faint to it. They are absent from everything it can record.

At={S:|S|≤t},kerΦt=span{χS:|S|>t}What a depth-t observer can see, and the hidden kernel: everything it can never see. This is the Observer-Kernel Theorem.
0123456size of patternvisible to depth 2: 22hidden kernel: 42
The same picture as the overview: 64 patterns of six switches, sorted by size. Teal is what a depth-two observer sees. Violet is the hidden kernel above the line.

STEP 3The smallest hidden pattern: three coins

Here is a pattern no shallow observer can ever detect. Toss three coins with one hidden rule: the number of heads is always even. Look at any one coin: heads half the time. Look at any two: all four outcomes, equally often. Every measurement of one or two coins says "pure chance."

Look at all three together and the rule is obvious: half of the possible patterns never happen. The structure exists only at the level of the whole.

Any two coinsall four outcomes, equally often25%25%25%25%All three togetheronly patterns with an even countfilled = heads, open = tails
Every pair of coins looks completely random. Only the three together reveal the rule.
p(x1,x2,x3)={14x1⊕x2⊕x3=00otherwiseEvery coefficient of size one and two is zero, while the size-three coefficient is not. This is the minimal example of non-reconstructibility.

The program measures how much structure sits out of reach with one number, the hidden higher-order mass:

SHOMt(p)=∑|S|>tp^(S)2

STEP 4The edge is sharp

How much is hidden? Count the pieces. Of the 2m pieces, those larger than t are hidden. The share of hidden pieces turns out to be a coin-flip probability: the chance that m fair coins show more than t heads.

Dt2m=Pr[Bin(m,12)>t]The Walsh Threshold Theorem. As m grows, this drops from nearly 1 to nearly 0 at t/m = 1/2, over a window of width about 1/√m.
0%50%100%0¼½¾18 switches256 switches32halfobserver depth, as a fraction of the systemshare hidden
The hidden share against observer depth, for systems of 8, 32 and 256 switches. Bigger systems switch more sharply at one half.

So a large system has a built-in horizon. An observer below half its size sees almost none of its structure. Exactly at half, an observer stays balanced, with almost exactly half visible, however large the system becomes.

STEP 5Deeper observers, and many observers

Depth makes a strict ladder: for every depth there is structure that is invisible one step down and visible one step up. And observers can pool what they see. Two observers with different windows, combined, see the union of their windows, and a family that covers every pattern sees everything a classical observer could.

It⊊It+1,kerΦfus=span{χS:S∉Ffus}The Strict Observer Hierarchy and the Observer Fusion Theorem.

STEP 6Return to the ground

Now run the filter as a process. Erase the largest patterns, then the next largest, and so on. What remains at the end is the uniform state, where every situation is equally likely and nothing can be told apart. The program calls it unity. From unity there is no way back: every starting point ends there, so the end cannot tell you where you began.

P4P3P2P1P0unity
Each step removes the largest remaining patterns. The last step leaves only unity.
P0p=pu=2−m for every pThe Dephasing Convergence Theorem and Unity Non-Recovery.

STEP 7The quantum version

The same picture carries over to quantum systems, where the patterns become products of the Pauli matrices X,Y,Z. The accessible data are the Z-type patterns. The X and Y types form a hidden coherent sector, and the program proves that the standard kind of measurement interface erases it completely.

Φ=Λ∘Δ∘U,Δ(UcU†)=0 for every coherence cThe Interface Structure Theorem and Coherence Invisibility. Rearrange, then erase, then post-process.

One consequence is easy to state. Looking at a hidden pattern always costs something visible: a look at a set U of sites wipes out exactly the visible patterns that overlap U an odd number of times. A single particle is always the odd case, which is the familiar fact that measuring spin one way scrambles it the other way. For a pair, both can be known at once.

[ZU,XU]=0⟺|U| is evenThe Parity Rule. Standard quantum algebra, restated in the program's language.

INTERPRETATIONWhat it might mean

Interpretation

The mathematics says that every bounded observer has a permanent hidden side, one that is not empty, only out of reach, and that some facts exist only at the level of the whole. Whether that says anything about minds, or about what lies beyond a single point of view, is a question the mathematics can sharpen but cannot settle. It is offered here as a question, not as a result.