items 16 + 15-closure scored: cross-task transfer toxic (task-locality confirmed 3-point); noise-s0 50%+ was a lucky seed
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
@@ -303,3 +303,24 @@ the fidelity refutation replicates. easy 70.5/73.0/72.1 at k=2/4/8
|
||||
ordinary seed spread at n=28). Two-seed conclusion: contraction-with-
|
||||
free-B loses ~17 points of easy items regardless of seed; the phase
|
||||
diagram's Parcae point is solid.
|
||||
|
||||
--- Outcome, item 16 (code->GSM8K transfer, scored 2026-07-15): ALL THREE
|
||||
PREDICTIONS CONFIRMED, emphatically. MBPP-trained loop on GSM8K: hard
|
||||
0.8-1.6% at every k (prediction a: ~0 gain — plan content is task-local);
|
||||
easy 93.1 -> 27.6-44.8% (prediction b: damaged, in fact WORSE than the
|
||||
GSM-trained merge's 48%); overall strictly below k=0 at every k>0
|
||||
(prediction c). noise-s0 variant identical (easy 34.5, hard 1.6). The
|
||||
transfer-distance ladder ends cleanly: near (HumanEval) tie, far-code
|
||||
(LCB) trained-hurts, cross-task (GSM8K) trained-content actively toxic
|
||||
while gaining nothing. Task-locality of the learned content is now a
|
||||
three-point monotone result.
|
||||
|
||||
--- Closure of the item-15b/15c "ceiling nudged upward" question
|
||||
(2026-07-15, after ns seeds): LUCKY SEED, per the pre-registered rule.
|
||||
noise-s0 hard(k=4) across seeds: 53.6 / 39.3 / 35.7 -> seed mean 42.9,
|
||||
inside the 37-46 band. Fidelity across seeds intact (easy 90.2-94.3 —
|
||||
the factorial conclusion is seed-robust); the 50-54% cells (ns seed 0,
|
||||
h2048 single seed) were upper-tail draws of the same distribution the
|
||||
merge's 46.4 came from. No recipe amendment; the abstract's original
|
||||
"same level within noise" framing stands; single-cell records are not
|
||||
levels — only seed means are.
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
Reference in New Issue
Block a user