item 26 pre-registered: result-staging lens supervision at pre-'=' positions (no causal leakage — low loss requires computation); arms lg03 and lt03+lg03; item-25 in-flight note (lce 10.3→2.3)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
@@ -703,3 +703,32 @@ auxiliary supervision, A2, E2-N.
|
||||
temporal alignment is one choice among several (bag-of-tokens,
|
||||
result-digits-only are untested alternatives if this null's).
|
||||
Job: scripts/jobs/zzz_q_rungb_lt.sh.
|
||||
IN-FLIGHT NOTE (~03:20): λ=0.3 arm's lens-CE collapsed 10.3 -> 2.3
|
||||
by step 40 — world 1 (cannot encode) is eliminated before the eval;
|
||||
the open question is world 2 (writes but doesn't compute) vs
|
||||
world 3 (reopens the ladder).
|
||||
|
||||
26. **Result-staging supervision during generation (pre-registered
|
||||
2026-07-17 ~03:25, before running; Nils: "can we try to train the
|
||||
loop using jspace during generation?").** The microscopy's
|
||||
signature of the healthy board: each line's RESULT is on the
|
||||
carried state before it is emitted ("1/twelve" at the '=',
|
||||
P=0.997). This trains that signature directly. For every visible
|
||||
scratchpad line, at the pre-'=' positions (the result is NOT yet
|
||||
in the causal context there — nothing can be copied; low loss
|
||||
requires computation) lens-CE the L30 carried state against the
|
||||
line's result tokens; Answer-line analog via the ':' separator.
|
||||
Spans computed in token space (gen_staging_targets; 1102 spans on
|
||||
the d=1-transformed 427). Two arms, one submit, both otherwise
|
||||
item-22 d=1 (warm-start rung-A e400, 200 steps, adapter-only):
|
||||
(a) lg=0.3 alone — staging supervision without pause supervision;
|
||||
(b) lt=0.3 + lg=0.3 — the full lens curriculum (deleted step
|
||||
taught at the pauses, results staged during emission). Eval n=256:
|
||||
0:0, 2:12, 2:16 per arm; decision vs 31.6, same bands as items
|
||||
23-25. Distinct from item 25's question: 25 teaches WHAT the
|
||||
silent chain should hold; 26 teaches the compute-before-emit
|
||||
discipline on the visible chain (the behavior that separated
|
||||
carry from FF at the 430 divergence). Caveat: on-policy ("during
|
||||
generation" in the free-running sense) is NOT this — that's a
|
||||
rollout-based follow-up (latent DAgger) if either lens arm moves.
|
||||
Job: scripts/jobs/zzz_r_rungb_lg.sh.
|
||||
|
||||
Reference in New Issue
Block a user