halting probe: output-stable orbit, not state fixed point; no free ACT at state level; paper claims softened
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
@@ -81,7 +81,8 @@ not laws.)*
|
||||
without recurrence matches it; stacking buys nothing (loop-training a
|
||||
distill-warmed adapter: 34.5%, below distill alone; running the distilled
|
||||
adapter in loop mode: drops to 20.0%); deeper k at inference is flat
|
||||
(k=8: 40.0%). The recurrence is a *training-time scaffold* that lets the
|
||||
(k=8: 40.0%; output-stable despite residual state drift, §3.8). The
|
||||
recurrence is a *training-time scaffold* that lets the
|
||||
adapter find plan-shaped content — content that can equally be put there
|
||||
by distillation if plans are available.
|
||||
|
||||
@@ -346,8 +347,14 @@ plan-representation overlaps; task-specific training still dominates.
|
||||
### 3.8 Mechanism, verification, deployment
|
||||
|
||||
The trained loop takes a large first step (cos(s₁,s₀)=0.926 vs 0.977
|
||||
untrained) and converges bit-exactly by k≈3–4; accuracy and lens-sharpening
|
||||
plateau there. P(latent concept) under the J-lens at the band exit rises
|
||||
untrained); accuracy and lens-sharpening plateau by k≈3–4. A population
|
||||
probe (n=250, state-cosine threshold 0.9995) shows the plateau is
|
||||
*output-level*: half the prompts' states are still drifting at 1e-3–1e-4
|
||||
cosine scale at k=8 while generation is already depth-stable — an
|
||||
output-stable orbit rather than a literal state fixed point, with no
|
||||
difficulty gradient in state-convergence depth. Consequently,
|
||||
convergence-based early exit ("free ACT") does not fall out of the state
|
||||
trajectory; halting would need an output-level signal. P(latent concept) under the J-lens at the band exit rises
|
||||
0.015→0.13 across iterations (~8× the untrained hold) — the lens that placed
|
||||
the implant also renders its silent content inspectable. The STaR labels
|
||||
train a free difficulty gate (route predicted-hard to k=4, else k=0);
|
||||
|
||||
@@ -230,3 +230,17 @@ training depth) and no capability; map-sharing is load-bearing for the
|
||||
anytime-usable gain. Depth-4 adapter overfit visible in val (hard k4 CE
|
||||
0.188@99 -> 0.371@599) — LTV concentrates small-pool overfitting into
|
||||
single depths.
|
||||
|
||||
--- Outcome, item 13b (scored 2026-07-15): accuracy prediction CONFIRMED
|
||||
(k=8 halt run 52.0/90.2/42.9 = plateau level); convergence predictions
|
||||
REFUTED. Per-item state-cosine (thresh 0.9995, k=8 cap): k_conv
|
||||
distribution 4:3, 5:57, 6:47, 7:17, never-within-8:126 — mean ~7, and NO
|
||||
difficulty gradient (easy 7.01 vs hard 7.00). The earlier "bit-exact by
|
||||
k~3-4" was the single dynamics-probe example, not the population: outputs
|
||||
plateau by k~2-4 while the state keeps drifting at 1e-3..1e-4 cosine
|
||||
scale; the fixed point is an OUTPUT-stable orbit (suffix layers + decode
|
||||
wash out residual state motion), not a literal state fixed point for most
|
||||
prompts. Free-ACT via state-cosine therefore yields no early exit at this
|
||||
threshold, and no ACT-like difficulty allocation falls out for free —
|
||||
output-level halting signals would be needed. Paper's dynamics claims
|
||||
softened accordingly.
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
Reference in New Issue
Block a user