item 32 scored: latent paper net-harmful — TF 20.3 (exposure catastrophe), ST 27.0 (quantization noise), analog 39.1 wins; loop=plan-machine / tokens=executor division final; architecture tree closed
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
@@ -1073,3 +1073,27 @@ confound flagged as the one loose thread.
|
|||||||
stands as final. Smokes: TF/ST train (loss arithmetic exact,
|
stands as final. Smokes: TF/ST train (loss arithmetic exact,
|
||||||
warm-start vals intact), eval generates with hard snaps.
|
warm-start vals intact), eval generates with hard snaps.
|
||||||
Job: scripts/jobs/zzz_y_symchain.sh.
|
Job: scripts/jobs/zzz_y_symchain.sh.
|
||||||
|
|
||||||
|
--- Outcome, item 32 (scored 2026-07-18 ~06:10). k=0 sanity clean both
|
||||||
|
arms. BOTH ARMS BELOW REFERENCE — latent paper is net-harmful at this
|
||||||
|
scale, with both failure modes mapped: (a) sctf (teacher-forced
|
||||||
|
symbols): lens-CE concentrated to 1.6-2.0 (below item 25's endpoint,
|
||||||
|
through the zero-init projector alone against a frozen merge) yet
|
||||||
|
free-running eval = 20.3 (easy .345!) — EXPOSURE CATASTROPHE: a wrong
|
||||||
|
snap is a hard corruption; a projector trained to trust symbols
|
||||||
|
propagates it and poisons the analog rail (-18.8 vs ablation). (b)
|
||||||
|
scst (straight-through self-exposure): lce plateaus 2.8-4.4 (never
|
||||||
|
fully concentrates under its own snap noise), eval = 27.0 — recovers
|
||||||
|
7 of TF's 19 lost points exactly as scheduled-sampling theory
|
||||||
|
predicts, but still -12.1 vs the pure analog 39.1. Conclusion: the
|
||||||
|
snap's error-correction is real but its error-INJECTION dominates at
|
||||||
|
2B/10-tick scale — discreteness in the loop costs more than it
|
||||||
|
corrects; visible tokens win not just by discreteness but by
|
||||||
|
discreteness + a VERIFIED sampling distribution (the LM head was
|
||||||
|
trained for token commitment; the lens readout was not). Per the
|
||||||
|
pre-registered decision rule: the division stands as FINAL —
|
||||||
|
the loop is a plan machine; tokens are the executor. The latent-paper
|
||||||
|
widenings (top-k, depth rails, tape) are closed unless a soft-snap
|
||||||
|
variant (mixture feedback, no hard argmax) is ever pre-registered.
|
||||||
|
Item 32 closes the architecture tree: pauses, bursts, KV memory,
|
||||||
|
analog TF chains, and discrete chains all have controlled answers.
|
||||||
|
|||||||
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
Binary file not shown.
Binary file not shown.
File diff suppressed because one or more lines are too long
File diff suppressed because one or more lines are too long
Reference in New Issue
Block a user