halting probe: output-stable orbit, not state fixed point; no free ACT at state level; paper claims softened

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
Nils
2026-07-15 03:29:26 +02:00
co-authored by Claude Fable 5
parent 8981cda31d
commit 0a5cd80dc1
3 changed files with 1290 additions and 3 deletions
+10 -3
View File
@@ -81,7 +81,8 @@ not laws.)*
without recurrence matches it; stacking buys nothing (loop-training a without recurrence matches it; stacking buys nothing (loop-training a
distill-warmed adapter: 34.5%, below distill alone; running the distilled distill-warmed adapter: 34.5%, below distill alone; running the distilled
adapter in loop mode: drops to 20.0%); deeper k at inference is flat adapter in loop mode: drops to 20.0%); deeper k at inference is flat
(k=8: 40.0%). The recurrence is a *training-time scaffold* that lets the (k=8: 40.0%; output-stable despite residual state drift, §3.8). The
recurrence is a *training-time scaffold* that lets the
adapter find plan-shaped content — content that can equally be put there adapter find plan-shaped content — content that can equally be put there
by distillation if plans are available. by distillation if plans are available.
@@ -346,8 +347,14 @@ plan-representation overlaps; task-specific training still dominates.
### 3.8 Mechanism, verification, deployment ### 3.8 Mechanism, verification, deployment
The trained loop takes a large first step (cos(s₁,s₀)=0.926 vs 0.977 The trained loop takes a large first step (cos(s₁,s₀)=0.926 vs 0.977
untrained) and converges bit-exactly by k≈34; accuracy and lens-sharpening untrained); accuracy and lens-sharpening plateau by k≈34. A population
plateau there. P(latent concept) under the J-lens at the band exit rises probe (n=250, state-cosine threshold 0.9995) shows the plateau is
*output-level*: half the prompts' states are still drifting at 1e-31e-4
cosine scale at k=8 while generation is already depth-stable — an
output-stable orbit rather than a literal state fixed point, with no
difficulty gradient in state-convergence depth. Consequently,
convergence-based early exit ("free ACT") does not fall out of the state
trajectory; halting would need an output-level signal. P(latent concept) under the J-lens at the band exit rises
0.015→0.13 across iterations (~8× the untrained hold) — the lens that placed 0.015→0.13 across iterations (~8× the untrained hold) — the lens that placed
the implant also renders its silent content inspectable. The STaR labels the implant also renders its silent content inspectable. The STaR labels
train a free difficulty gate (route predicted-hard to k=4, else k=0); train a free difficulty gate (route predicted-hard to k=4, else k=0);
+14
View File
@@ -230,3 +230,17 @@ training depth) and no capability; map-sharing is load-bearing for the
anytime-usable gain. Depth-4 adapter overfit visible in val (hard k4 CE anytime-usable gain. Depth-4 adapter overfit visible in val (hard k4 CE
0.188@99 -> 0.371@599) — LTV concentrates small-pool overfitting into 0.188@99 -> 0.371@599) — LTV concentrates small-pool overfitting into
single depths. single depths.
--- Outcome, item 13b (scored 2026-07-15): accuracy prediction CONFIRMED
(k=8 halt run 52.0/90.2/42.9 = plateau level); convergence predictions
REFUTED. Per-item state-cosine (thresh 0.9995, k=8 cap): k_conv
distribution 4:3, 5:57, 6:47, 7:17, never-within-8:126 — mean ~7, and NO
difficulty gradient (easy 7.01 vs hard 7.00). The earlier "bit-exact by
k~3-4" was the single dynamics-probe example, not the population: outputs
plateau by k~2-4 while the state keeps drifting at 1e-3..1e-4 cosine
scale; the fixed point is an OUTPUT-stable orbit (suffix layers + decode
wash out residual state motion), not a literal state fixed point for most
prompts. Free-ACT via state-cosine therefore yields no early exit at this
threshold, and no ACT-like difficulty allocation falls out for free —
output-level halting signals would be needed. Paper's dynamics claims
softened accordingly.
File diff suppressed because it is too large Load Diff