halting probe: output-stable orbit, not state fixed point; no free ACT at state level; paper claims softened
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
@@ -81,7 +81,8 @@ not laws.)*
|
|||||||
without recurrence matches it; stacking buys nothing (loop-training a
|
without recurrence matches it; stacking buys nothing (loop-training a
|
||||||
distill-warmed adapter: 34.5%, below distill alone; running the distilled
|
distill-warmed adapter: 34.5%, below distill alone; running the distilled
|
||||||
adapter in loop mode: drops to 20.0%); deeper k at inference is flat
|
adapter in loop mode: drops to 20.0%); deeper k at inference is flat
|
||||||
(k=8: 40.0%). The recurrence is a *training-time scaffold* that lets the
|
(k=8: 40.0%; output-stable despite residual state drift, §3.8). The
|
||||||
|
recurrence is a *training-time scaffold* that lets the
|
||||||
adapter find plan-shaped content — content that can equally be put there
|
adapter find plan-shaped content — content that can equally be put there
|
||||||
by distillation if plans are available.
|
by distillation if plans are available.
|
||||||
|
|
||||||
@@ -346,8 +347,14 @@ plan-representation overlaps; task-specific training still dominates.
|
|||||||
### 3.8 Mechanism, verification, deployment
|
### 3.8 Mechanism, verification, deployment
|
||||||
|
|
||||||
The trained loop takes a large first step (cos(s₁,s₀)=0.926 vs 0.977
|
The trained loop takes a large first step (cos(s₁,s₀)=0.926 vs 0.977
|
||||||
untrained) and converges bit-exactly by k≈3–4; accuracy and lens-sharpening
|
untrained); accuracy and lens-sharpening plateau by k≈3–4. A population
|
||||||
plateau there. P(latent concept) under the J-lens at the band exit rises
|
probe (n=250, state-cosine threshold 0.9995) shows the plateau is
|
||||||
|
*output-level*: half the prompts' states are still drifting at 1e-3–1e-4
|
||||||
|
cosine scale at k=8 while generation is already depth-stable — an
|
||||||
|
output-stable orbit rather than a literal state fixed point, with no
|
||||||
|
difficulty gradient in state-convergence depth. Consequently,
|
||||||
|
convergence-based early exit ("free ACT") does not fall out of the state
|
||||||
|
trajectory; halting would need an output-level signal. P(latent concept) under the J-lens at the band exit rises
|
||||||
0.015→0.13 across iterations (~8× the untrained hold) — the lens that placed
|
0.015→0.13 across iterations (~8× the untrained hold) — the lens that placed
|
||||||
the implant also renders its silent content inspectable. The STaR labels
|
the implant also renders its silent content inspectable. The STaR labels
|
||||||
train a free difficulty gate (route predicted-hard to k=4, else k=0);
|
train a free difficulty gate (route predicted-hard to k=4, else k=0);
|
||||||
|
|||||||
@@ -230,3 +230,17 @@ training depth) and no capability; map-sharing is load-bearing for the
|
|||||||
anytime-usable gain. Depth-4 adapter overfit visible in val (hard k4 CE
|
anytime-usable gain. Depth-4 adapter overfit visible in val (hard k4 CE
|
||||||
0.188@99 -> 0.371@599) — LTV concentrates small-pool overfitting into
|
0.188@99 -> 0.371@599) — LTV concentrates small-pool overfitting into
|
||||||
single depths.
|
single depths.
|
||||||
|
|
||||||
|
--- Outcome, item 13b (scored 2026-07-15): accuracy prediction CONFIRMED
|
||||||
|
(k=8 halt run 52.0/90.2/42.9 = plateau level); convergence predictions
|
||||||
|
REFUTED. Per-item state-cosine (thresh 0.9995, k=8 cap): k_conv
|
||||||
|
distribution 4:3, 5:57, 6:47, 7:17, never-within-8:126 — mean ~7, and NO
|
||||||
|
difficulty gradient (easy 7.01 vs hard 7.00). The earlier "bit-exact by
|
||||||
|
k~3-4" was the single dynamics-probe example, not the population: outputs
|
||||||
|
plateau by k~2-4 while the state keeps drifting at 1e-3..1e-4 cosine
|
||||||
|
scale; the fixed point is an OUTPUT-stable orbit (suffix layers + decode
|
||||||
|
wash out residual state motion), not a literal state fixed point for most
|
||||||
|
prompts. Free-ACT via state-cosine therefore yields no early exit at this
|
||||||
|
threshold, and no ACT-like difficulty allocation falls out for free —
|
||||||
|
output-level halting signals would be needed. Paper's dynamics claims
|
||||||
|
softened accordingly.
|
||||||
|
|||||||
File diff suppressed because it is too large
Load Diff
Reference in New Issue
Block a user